Foundry Local
Foundry Local enables local execution of Small Language Models using the hardware on your device.
winget install --id=Microsoft.FoundryLocal -eDescription
Foundry Local brings the power of Azure AI Foundry to your local device. It allows you to run large language models (LLMs) directly on your hardware and keep all data processing on device for enhanced privacy and security. It also has an OpenAI compatible API and hardware acceleration out of the box, ensuring you're getting a simple and performant experience regardless of what hardware you are using.
Foundry Local is available through winget as package ID Microsoft.FoundryLocal, with version 0.8.94.38902. Use the install command above to set it up on Windows without downloading a separate installer manually.
Microsoft.FoundryLocal
foundry
10.0.19041.0
Related Apps
Provides a language-agnostic way to express coding assumptions in .NET programs.
A combination command-line and graphical tool that displays lockout information about a particular user account. It collects information from every contactable domain controller in the target user account's domain.
.NET Reactor is a powerful code protection and software licensing system for software written for the .NET Framework, and supports all languages that generate .NET assemblies.
02Engine — A faster, stronger, richer creative engine for the hardcore.
Micropatching security vulnerabilities for many programs and in real time