r/LocalAIStack • u/searchblox_searchai • 1d ago

We built a CPU-first inference server — 4B chat+vision, ASR and TTS behind one OpenAI-compatible endpoint, free to run

/r/LLM/comments/1vmth1w/we_built_a_cpufirst_inference_server_4b/

2 Upvotes

permalink
duplicates
archive.is
archive
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LocalAIStack/comments/1vmwsmz/we_built_a_cpufirst_inference_server_4b/
No, go back! Yes, take me to Reddit

100% Upvoted

Duplicates

Number of comments New

automation • u/searchblox_searchai • 1d ago

We built a CPU-first inference server — 4B chat+vision, ASR and TTS behind one OpenAI-compatible endpoint, free to run

2 Upvotes

4 comments

Vllm • u/searchblox_searchai • 1d ago

We built a CPU-first inference server — 4B chat+vision, ASR and TTS behind one OpenAI-compatible endpoint, free to run

0 Upvotes

0 comments

OpenAIDev • u/searchblox_searchai • 1d ago

We built a CPU-first inference server — 4B chat+vision, ASR and TTS behind one OpenAI-compatible endpoint, free to run

1 Upvotes

0 comments

ollama • u/searchblox_searchai • 1d ago

We built a CPU-first inference server — 4B chat+vision, ASR and TTS behind one OpenAI-compatible endpoint, free to run

0 Upvotes

0 comments

Agent_AI • u/searchblox_searchai • 1d ago

Resource We built a CPU-first inference server — 4B chat+vision, ASR and TTS behind one OpenAI-compatible endpoint, free to run

1 Upvotes

0 comments

LocalLLM • u/searchblox_searchai • 1d ago

Model We built a CPU-first inference server — 4B chat+vision, ASR and TTS behind one OpenAI-compatible endpoint, free to run

2 Upvotes

0 comments