llama-cpp-python-djs-bot/huggingface-config/README.md
2023-05-06 01:45:01 +02:00

668 B
Raw Blame History

How to Deploy on Hugging Face

  1. Move the "assets" directory and llamabot.js, package.json files into your HuggingFace repo directory.

  2. Move the files huggingface-config/Dockerfile - huggingface-config/start.sh - huggingface-config/startServices.json into the root of the hugging face repo.

  3. Edit Docker file as you need, the dockerfile is set to automatically download Vicuna 1.1 7B

  4. Push the changes

You should then see the bot being built and deployed on HuggingFace

pm2 log will run automatically so you can see frontend and backend logs.

test on  main ls assets Dockerfile llama.js package.json README.md startServices.json start.sh