MrTuxedo/llama-cpp-python-djs-bot
1
0
Fork 0
forked from snxraven/llama-cpp-python-djs-bot
Code Pull Requests Activity
d1807d37ad
llama-cpp-python-djs-bot/huggingface-config
History
Raven Scott d1807d37ad HuggingFace Deploy Instructions
2023-05-06 01:41:03 +02:00
..
Dockerfile HuggingFace Deploy Instructions 2023-05-06 01:41:03 +02:00
README.md HuggingFace Deploy Instructions 2023-05-06 01:41:03 +02:00
start.sh HuggingFace Deploy Instructions 2023-05-06 01:41:03 +02:00
startServices.json HuggingFace Deploy Instructions 2023-05-06 01:41:03 +02:00

README.md

How to Deploy on Hugging Face

  1. Put all of the bots files within your HuggingFace Git Repo.

  2. Move the files Dockerfile - start.sh - startServices.json. (Overwrite the docker file found in the root of the project)

  3. Edit Docker file as you need, the dockerfile is set to automatically download Vicuna 1.1 7B

  4. Push the changes

You should then see the bot being built and deployed on HuggingFace

pm2 log will run automatically so you can see frontend and backend logs.