update readme
This commit is contained in:
parent
a6117c729c
commit
19107543e9
@ -41,8 +41,11 @@ llama-cpp-python offers a web server which aims to act as a drop-in replacement
|
||||
To install the server package and get started:
|
||||
|
||||
pip install llama-cpp-python[server]
|
||||
|
||||
export MODEL=./models/your_model.py
|
||||
|
||||
python3 -m llama_cpp.server
|
||||
|
||||
Navigate to http://localhost:8000/docs to see the OpenAPI documentation.
|
||||
|
||||
# Usage
|
||||
|
Loading…
Reference in New Issue
Block a user