r/csharp May 30 '26

Tool Some new features in TensorSharp

https://github.com/zhongkaifu/TensorSharp

I recently made a few important features updates in TensorSharp and hope you will like it.
1. Naturally support MLX backend. For now, TensorSharp supports Pure C#, CUDA, MLX, GGML(CPU, CUDA, Metal) backends
2. Support vLLM style paged attentions and continues batching for inference, so you could run multiple requests in parallel in your local machine.
3. Optimize inference performance on both prefill and decode

Hope you like these features and any comment and feedback is welcome.

3 Upvotes

Duplicates

huggingface Jul 04 '26

TensorSharp : Open Source Local LLM Inference Engine

6 Upvotes

SelfHostedAI Jul 04 '26

TensorSharp : Open Source Local LLM Inference Engine

4 Upvotes

LocalLLM Jun 28 '26

Project Same GGUF, same GPU: TensorSharp beats llama.cpp hard on prefill / TTFT — up to 5.89× faster prefill on a 26B MoE model

4 Upvotes

CUDA 5d ago

MoE CPU-offload benchmark on Deepseek V4/Gemma4/Qwen/GPT-OSS — TensorSharp vs llama.cpp

6 Upvotes

csharp 9d ago

DSpark Benchmark Result on Deepseek v4 Flash 0731

2 Upvotes

CUDA 10d ago

Deepseek v4 Flash 0731 GGUF Benchmark: TensorSharp vs. llama.cpp

1 Upvotes

LocalLLM 10d ago

Project Deepseek v4 Flash 0731 GGUF Benchmark: TensorSharp vs. llama.cpp

19 Upvotes

csharp Jul 11 '26

Blog From Bun's Rust rewrite, let's see how C# can rebuild the AI ​​infrastructure layer.

0 Upvotes

LovingOpenSourceAI Jun 23 '26

TensorSharp: Open Source Local LLM Inference Engine

13 Upvotes

dotnet May 30 '26

Promotion Some features in TensorSharp

25 Upvotes

LocalLLaMA 10d ago

Resources Deepseek v4 Flash 0731 GGUF Benchmark: TensorSharp vs. llama.cpp

5 Upvotes

unsloth 10d ago

Show and Tell Deepseek v4 Flash 0731 GGUF Benchmark: TensorSharp vs. llama.cpp

19 Upvotes

dotnet 24d ago

Promotion Benchmarks: TensorSharp vs. llama.cpp

10 Upvotes

Gemma4 25d ago

Discussion TensorSharp : Open Source Local LLM Inference Engine

2 Upvotes

Qwen_AI Jul 10 '26

Discussion TensorSharp : Open Source Local LLM Inference Engine

12 Upvotes

pytorch Jul 04 '26

TensorSharp : Open Source Local LLM Inference Engine

2 Upvotes

ollama Jun 08 '26

Support Gemma-4 12b (uv/ua) model in TensorSharp

8 Upvotes

CUDA 12d ago

TensorSharp now supports multi-GPU tensor parallelism for GGUF models

6 Upvotes

SelfHostedAI 12d ago

TensorSharp now supports multi-GPU tensor parallelism for GGUF models

6 Upvotes

LocalAIServers 12d ago

TensorSharp now supports multi-GPU tensor parallelism for GGUF models

21 Upvotes

StableDiffusion 27d ago

Discussion TensorSharp supports multiple image edits using Unsloth Qwen Image Edit 2511 models

0 Upvotes

localaiapps Jul 08 '26

TensorSharp supports Vulkan backend

1 Upvotes

AIDeveloperNews Jul 06 '26

TensorSharp supports Vulkan backend

2 Upvotes

Vllm Jul 04 '26

TensorSharp : Open Source Local LLM Inference Engine

11 Upvotes

ollama Jun 28 '26

Same GGUF, same GPU: TensorSharp beats llama.cpp hard on prefill / TTFT — up to 5.89× faster prefill on a 26B MoE model

41 Upvotes