MrTuxedo/llama-cpp-python-djs-bot
1
0
Fork 0
forked from snxraven/llama-cpp-python-djs-bot
Code Pull Requests Activity
7c7b5d11b7
llama-cpp-python-djs-bot/huggingface-config
History
Raven Scott 7c7b5d11b7 fix nodejs install for HuggingFace
2023-11-14 18:19:39 -05:00
..
Dockerfile fix nodejs install for HuggingFace 2023-11-14 18:19:39 -05:00
README.md HuggingFace Deploy Instructions 2023-05-06 01:49:21 +02:00
start.sh update hf 2023-05-06 14:34:53 +02:00
startServices.json Fix hugging face 2023-05-08 22:15:51 +02:00

README.md

How to Deploy on Hugging Face

  1. Move the "assets" directory and llamabot.js, package.json files into your HuggingFace repo directory.

  2. Move the files huggingface-config/Dockerfile - huggingface-config/start.sh - huggingface-config/startServices.json into the root of the hugging face repo.

  3. Edit Docker file as you need, the dockerfile is set to automatically download Vicuna 1.1 7B

  4. Move default.env into your repo as .env and edit for your needs

  5. Push the changes

You should then see the bot being built and deployed on HuggingFace

pm2 log will run automatically so you can see frontend and backend logs.

PLEASE NOTE: Your hugging face repo should remain private!