diff --git a/README.md b/README.md index 00b3441..a84c937 100644 --- a/README.md +++ b/README.md @@ -81,6 +81,8 @@ This will automatically configure the API for you as well as the bot in two sepe # Docker Compose with GPU This will automatically configure the API that supports cuBLAS and GPU inference for you as well as the bot in two seperate containers within a stack. +NOTE: Caching is currently broken for cuBLAS: https://github.com/abetlen/llama-cpp-python/issues/253 + 1. `git clone https://git.ssh.surf/snxraven/llama-cpp-python-djs-bot.git` - Clone the repo 2. `mv docker-compose.yml docker-compose.nogpu.yml; mv docker-compose.gpu.yml docker-compose.yml;` - Move nongpu compose out of the way, Enable GPU Support