Ollama is the easiest way to automate your work using open models, while keeping your data safe.
For my server it is being tested with Home Assistant, supplying models to a Home Assistant Voice assistant. I also hope to use some models with PhotoPrism to help classify images.
Some settings can be configured, but haven't yet needed to.