MrTuxedo/llama-cpp-python-djs-bot
1
0
Fork 0
forked from snxraven/llama-cpp-python-djs-bot
Code Pull Requests Activity

update readme

Browse Source
This commit is contained in:
Raven Scott 2023-04-12 16:30:59 +02:00
parent d3162bce32
commit f98caa23cc
1 changed files with 14 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

15
README.md
View File

@ -48,7 +48,7 @@ python3 -m llama_cpp.server
Navigate to http://localhost:8000/docs to see the OpenAPI documentation. Navigate to http://localhost:8000/docs to see the OpenAPI documentation.
# Usage # Static Usage
1) Use ```npm i ``` 1) Use ```npm i ```
@ -60,5 +60,18 @@ Navigate to http://localhost:8000/docs to see the OpenAPI documentation.
6) Run the bot ```node llamabot.js ``` 6) Run the bot ```node llamabot.js ```
# Docker Compose
1. `git clone https://git.ssh.surf/snxraven/llama-cpp-python-djs-bot.git`
2. `cp default.env .env`
3. Set DATA_DIR in .env to the exact location of your model files.
4. Edit docker-compose.yaml MODEL to ensure the correct model bin is set
5. `docker compose up -d`
Want to make this better? Issue a pull request! Want to make this better? Issue a pull request!