Integrate Huggingface

Add huggingface as a liteLLM model on the "Models" tab by clicking "New Language model" and changing to the "Custom" tab, then filling out the form for HuggingFace

Use JSON formatting to input the LiteLLM parameters into the form, and click save.

Navigate back to the endpoints and add the huggingface model as an upstream to your endpoint by selecting the endpoint and switching to the LLM upstream tab, then clicking "New Upstream" and selecting "HuggingFace" from the "Language Model" drop down while on the "Language Model" tab:

Alternatively, for some models (including huggingface) you can select an endpoint and add a new upstream by switching to the "Upstream" tab and clicking "New Upstream", then changing to the HuggingFace tab and filling out the parameters including your API key.

Click save, and HuggingFace will be added as an upstream LLM to the selected endpoint.