MrTuxedo/llama-cpp-python-djs-bot
1
0
Fork 0
forked from snxraven/llama-cpp-python-djs-bot
Code Pull Requests Activity

update readme

Browse Source
This commit is contained in:
Raven Scott 2023-04-11 23:47:21 +02:00
parent a6117c729c
commit 19107543e9
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@ -41,8 +41,11 @@ llama-cpp-python offers a web server which aims to act as a drop-in replacement
To install the server package and get started: To install the server package and get started:
pip install llama-cpp-python[server] pip install llama-cpp-python[server]
export MODEL=./models/your_model.py export MODEL=./models/your_model.py
python3 -m llama_cpp.server python3 -m llama_cpp.server
Navigate to http://localhost:8000/docs to see the OpenAPI documentation. Navigate to http://localhost:8000/docs to see the OpenAPI documentation.
# Usage # Usage