winget install --id=nekomeowww.OllamaOperator -eDescription
While Ollama is a powerful tool for running large language models locally, and the user experience of CLI is just the same as using Docker CLI, it's not possible yet to replicate the same user experience on Kubernetes, especially when it comes to running multiple models on the same cluster with loads of resources and configurations. That's where the Ollama Operator kicks in: - Install the operator on your Kubernetes cluster - Apply the needed CRDs - Create your models - Wait for the models to be fetched and loaded, that's it! Thanks to the great works of lama.cpp, no more worries about Python environment, CUDA drivers. The journey to large language models, AIGC, localized agents, 🦜🔗 Langchain and more is just a few steps away!
Ollama Operator is available through winget as package ID nekomeowww.OllamaOperator, with version 0.10.7. Use the install command above to set it up on Windows without downloading a separate installer manually.
Related Apps
Provides a language-agnostic way to express coding assumptions in .NET programs.
.NET Reactor is a powerful code protection and software licensing system for software written for the .NET Framework, and supports all languages that generate .NET assemblies.
02Engine — A faster, stronger, richer creative engine for the hardcore.
Micropatching security vulnerabilities for many programs and in real time
Free Making Tax Digital VAT Software. HMRC recognised MTD VAT Bridging Software for Excel