Spaces:
Running
Run it locally with same UI ?
Hi! I would like to know if it's possible to install hugging chat and star coder and run it locally within my Local network and have the same UI as hugging chat uses? Is there any tutorials on how to get it locally with UI?
You can run it locally as it based on https://huggingface.co/OpenAssistant/oasst-sft-6-llama-30b-xor
This is a huggingface space wo you can run it locally just by cloning it and installing all the dependencies. https://huggingface.co/spaces/huggingchat/chat-ui
Also make sure you have the proper hardware to run this.
Hi
@Daciansolgen9
, maybe this will it help you (although it does not cover star coder explicitely)
Running HuggingChat locally (VM) | Chat-UI + Inference Server + LLM https://youtu.be/EchfCSv1iNM
So, do you think it's possible to just store Chat UI in user's machines then run them offline, then connect to Hugging Face from it, like just by installing or running its repository?