update readme

This commit is contained in:
Raven Scott 2023-04-11 23:47:21 +02:00
parent a6117c729c
commit 19107543e9

View File

@ -41,8 +41,11 @@ llama-cpp-python offers a web server which aims to act as a drop-in replacement
To install the server package and get started:
pip install llama-cpp-python[server]
export MODEL=./models/your_model.py
python3 -m llama_cpp.server
Navigate to http://localhost:8000/docs to see the OpenAPI documentation.
# Usage