llama-cpp-python-djs-bot/huggingface-config/README.md

18 lines
685 B
Markdown
Raw Normal View History

2023-05-05 23:41:03 +00:00
# How to Deploy on Hugging Face
2023-05-05 23:45:01 +00:00
1) Move the "assets" directory and llamabot.js, package.json files into your HuggingFace repo directory.
2023-05-05 23:41:03 +00:00
2023-05-05 23:45:01 +00:00
2) Move the files huggingface-config/Dockerfile - huggingface-config/start.sh - huggingface-config/startServices.json into the root of the hugging face repo.
2023-05-05 23:41:03 +00:00
3) Edit Docker file as you need, the dockerfile is set to automatically download Vicuna 1.1 7B
2023-05-05 23:49:21 +00:00
3) Move default.env into your repo as .env and edit for your needs
2023-05-05 23:41:03 +00:00
4) Push the changes
You should then see the bot being built and deployed on HuggingFace
2023-05-05 23:45:01 +00:00
pm2 log will run automatically so you can see frontend and backend logs.
2023-05-05 23:49:21 +00:00
PLEASE NOTE: Your hugging face repo should remain private!