🛠 TensorSharp is a new open-source inference engine for running LLMs locally in C#.
The project supports the GGUF format and offers a console application, a web chatbot interface, and an HTTP API compatible with Ollama and OpenAI. The engine runs on Windows, macOS, and Linux with GPU acceleration support.
🌍 The emergence of a high-quality C# engine expands the local LLM ecosystem, providing an alternative to Python-oriented solutions and simplifying integration into .NET applications.
👤 Users can now run powerful models locally in Windows/macOS/Linux environments using familiar C# and having access to an OpenAI-like API for their projects.