diff --git a/README.md b/README.md index 2d8893a..49869e6 100644 --- a/README.md +++ b/README.md @@ -48,7 +48,7 @@ python3 -m llama_cpp.server Navigate to http://localhost:8000/docs to see the OpenAPI documentation. -# Usage +# Static Usage 1) Use ```npm i ``` @@ -60,5 +60,18 @@ Navigate to http://localhost:8000/docs to see the OpenAPI documentation. 6) Run the bot ```node llamabot.js ``` +# Docker Compose + +1. `git clone https://git.ssh.surf/snxraven/llama-cpp-python-djs-bot.git` + + +2. `cp default.env .env` + +3. Set DATA_DIR in .env to the exact location of your model files. + +4. Edit docker-compose.yaml MODEL to ensure the correct model bin is set + +5. `docker compose up -d` + Want to make this better? Issue a pull request!