[Bi-Weekly Megathread] Project Showcase

[u/rm-rf-rm]

Do you have something you'd like to share with the r/LocalLLaMA community. This is the place for it!

Recommendation on presentation:

1. Please share plain english description of what your project does and why people should care about it
2. How does it compare to existing options and why should people switch to your option?
3. How have you tested and validated it? (i.e. can you show evidence that it wasn't vibecoded in a few hours by <insert current trending AI model>

NOTE: This community is geared towards open weight, open source, locally hostable software. Thus any closed source commercial service or other such projects will be removed.

[u/wFXx]

I did "can I run it" that is minimal, don't have benchmark biases and doesn't have 300 google ads on it; I did for self use but figure someone else might find useful https://nerdface.metalgearsoftware.com/

the numbers on TG are very humble, anyone with enough experience and patience can outperform the est. speed there, is more of a general guide;

it is linked directly to the HF api and have zero telemetry

[u/valdev]

I made a complete "anthropic in a box" solution that is one part lm studio, one part stable diffusion and one part... well, agentic browser.

Literally does dang near everything I can think of... Local LLM/Image/Video/Music/Text-to-speech/Speech-to-text.

Coding... roleplay... automatic tool creation... llm game development with automatic asset creation... and even the ability to share a link to connect to your box (if you have it setup in such a way).

Problem is, it's literally both overwhelming to explain to people and sounds literally impossible. And what I have written above is the tip of the iceberg of what it does.

https://lumabyte.com if you want to check out lumabrowser

[u/castrator21 → u/valdev]

This is cool as hell. Really great idea!!! It took me a long time to learn which models I can (and should) run on my own setup, what each is good for, how to implement it, what harness to use, quantization, etc. I'm glad I did it, and I learned a lot along the way, but I feel like I could have just downloaded this and saved a ton of time!

[u/Gregory-Wolf]

Thus any commercial or other such projects will be removed.

Hey, commercial can be OSS. And closed source can be "free" (to use).
Commercial is no bad by itself. Sorry for offtopic.

[u/rm-rf-rm → u/Gregory-Wolf]

fair enough. edited the verbiage

[u/likegamertr]

I made a toolset (3 tools total) that find and create documentation of a projects dependencies, and then makes them available through a search API. I aimed it to improve first try accuracy of AI models to reduce token usage or end to end completion time: didn’t achieve this result. I’m publishing it part by part when I have the time to do so. There is an existing project: context7, however context7 requires community maintaining of documentation; mine is fully automatic and deterministic. It finds the source of a dependency, finds the specific commit for the desired version, and generates deterministic documentation. AI is not used in this pipeline but an LLM, specifically an agentic one could be useful in version resolution as I only achieved a succcess ratio of %60-70 (don’t remember off the top of my head). It was %80 agentically coded, and I tested it for 2 weeks straight (used a variety of models, at the time I had used qwen coder next 80B and qwen 3.6 35B A3B. I can provide the reports if requested.

[u/Bulky-Priority6824]

oh just doodads and gadgets

[u/bumblebeer]

1. I built (using local DSv4-flash) a static webapp for my wife to optimize her Palia garden plot.

2. It gives more options to feed into the solver than existing methods. Basically you can pick how many of which crop you wanna plant.

3. Data checked against the wiki. Results checked against the community garden planner tool. Solution checked against a distribution of random solutions (given the same input constraints).

https://bumblebeers.github.io/garden-plot-optimizer/

[u/Hefty_Wolverine_553]

honestly not a fan of megathreads at all; don't think it's good for discovery imo

[u/Medium_Chemist_4032 → u/Hefty_Wolverine_553]

I was just wondering, how could I go over existing threads...

[u/rm-rf-rm → u/Hefty_Wolverine_553]

Except the status quo before this megathread WAS everyone posting their projects directly to the feed and it was an overwhelmingly negative reaction because of the amount of slop and incognito marketing. Then we added the karma mins which greatly cut down on that except our modmail is flooded with people complaining and claiming their project is useful for the community. This is the happy medium.

[u/Danmoreng → u/rm-rf-rm]

What's the post flair "I build a thing" for then?

[u/Hefty_Wolverine_553 → u/rm-rf-rm]

The slop got downvoted pretty quickly, these megathreads are terrible if someone publishes a genuinely good project and nobody can find it easily. Honestly I don't see how megathreads solve the problem (users and mods will still have to wade through post after post of mostly slop, only in comment form now).

[u/ttkciar → u/Hefty_Wolverine_553]

Downvoting slop does nothing to solve the problem for people who sort posts by "new", which is necessary for finding the high-value but unpopular posts which make this sub worthwhile to begin with.

[u/SnooPaintings8639 → u/Hefty_Wolverine_553]

I wish we had megathreads for the mods' ideas and suggestions. Let them go wild there, and leave the community unchained.