MrTuxedo/llama-cpp-python-djs-bot
1
0
Fork 0
forked from snxraven/llama-cpp-python-djs-bot
Code Pull Requests Activity

Containerize bot and server in one stack.

Browse Source
This commit is contained in:
GooeyTuxedo
2023-04-11 19:29:41 -07:00
parent 19107543e9
commit e12f518bd7
10 changed files with 83 additions and 30 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
server/Dockerfile Normal file
View File

@ -0,0 +1,11 @@
FROM python:bullseye
RUN apt-get update; \
apt-get install -y --no-install-recommends \
build-essential
WORKDIR /usr/src/app
RUN pip install --no-cache-dir llama-cpp-python[server]
CMD python3 -m llama_cpp.server