Aspose.LLM for .NET
Contents
[
Hide
]
Aspose.LLM for .NET
Aspose.LLM for .NET lets you integrate large language models into your .NET applications and run them on your own hardware. Use built-in presets for Qwen, Gemma, Llama, Phi, and other model families; start chat sessions with message history; save and restore conversations; and send images alongside prompts with vision presets.
The library is implemented in C# and targets .NET Standard 2.0. It runs on .NET 10, .NET 8 LTS, .NET 6, and .NET Framework 4.7.2 and later, across Windows, Linux, and macOS. Native llama.cpp binaries for CPU, CUDA, HIP, Metal, and Vulkan are downloaded automatically on first use.
Create an API instance from a preset, start a chat session, and send messages in a few lines of code.