Deploy an Open Source LLM

Navigate to Dreamcatcher's "Models" tab and click the "New Language Model" in the top right corner of the page.

Enter the desired values into the form and save. If the Ollama model you want is not listed, pull a new one under the Ollama tab.

If you want to use a custom model, switch to the custom tab on the form and input the LiteLLM parameters for the desired model using JSON format and the LiteLLM docs for reference

The new model will appear in the list of models