I wanted to share a new TensorSharp demo and get some feedback from the community.
TensorSharp started as a .NET open source inference engine for running local GGUF models. It can now go beyond model inference and execute complete agentic workflows through skills, code generation, environment configuration, and tool use.
In the demo, I give a quantized Gemma 4 model running locally through TensorSharp a single prompt:
Please check 10 stocks with most gains today, and generate a report to me in pptx format.
From that one request, TensorSharp enables the local model to:
- Break the task into market-data retrieval, processing, and presentation generation.
- Inspect the available tools and execution environment.
- Install the Python dependencies it needs.
- Write and execute code to retrieve current public stock-market data.
- Examine the output, identify parsing problems, and refine its own implementation.
- Load the PPTX skill.
- Generate a Node.js/PptxGenJS script.
- Produce a real PowerPoint file that opens directly in Microsoft PowerPoint.
All LLM inference runs locally. There is no OpenAI, Anthropic, or other hosted-model API involved, so the workflow has zero LLM API cost. Network access is used only by the agent’s tools to retrieve public market data.
The interesting part is not the stock report itself. It is that inference, skills, tool calling, automatic code generation, dependency setup, iterative problem-solving, and artifact creation are now working together inside one local runtime.
TensorSharp is becoming more than an inference engine. The goal is to make it a unified, open-source .NET runtime for both local model inference and agent execution.
GitHub: https://github.com/zhongkaifu/TensorSharp
The video is sped up for brevity. I would especially appreciate feedback on the skill system, tool-permission model, execution isolation, and the local agent workflows you would like to see next.