Skip to content

Commit

Permalink
Merge branch 'main' of https://github.com/crashr/gppm
Browse files Browse the repository at this point in the history
  • Loading branch information
crashr committed Sep 22, 2024
2 parents 0f9a586 + f628420 commit d6d34e9
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,8 @@ gppm power process manager
gppm is designed for use with llama.cpp and NVIDIA Tesla P40 GPUs. The standalone llama.cpp currently lacks functionality to reduce the power consumption of these GPUs in idle mode. Although there is a patch for llama.cpp, it switches the performance mode for all GPUs simultaneously, which can disrupt setups where multiple llama.cpp instances share one or more GPUs. Implementing a communication mechanism within llama.cpp to manage task distribution and GPU status is complex. gppm addresses this challenge externally, providing a more efficient solution.
gppm allows you to define llama.cpp instances as code, enabling automatic spawning, termination, and respawning.

> [!NOTE]
> Both the configuration and the API will most likely continue to change for a while. When changing to a newer version, please always take a look at the current documentation.
## Table of Contents

Expand Down

0 comments on commit d6d34e9

Please sign in to comment.