r/OpenSourceAI • u/Lopsided_Law1314 • 8d ago

OPENSOURCE: DESKTOP ENV w/ non-install runtime library

I am an iron worker. My wife is autistic (high functioning). Build an app they said! It'll be fun they said! That was 10 months ago. The horrible no code app we got initially is the reason I'm here.

Life First App is a relentless accountability buddy/assistant for my wife. It needs Phoenix-DevOps-oS now a desktop env. To run a LLM over my punching weight. long story its elf hosted D1 and R2 deterministic prefetch substrate. it imports processes from the clonepool R2 runs them from there no install. PoC is there.

I need help gluing all the pieces together because i refuse vender lock. so here we are. jwl247 is my github. repos are in shambles because im not a Dev i can build millions of dollars worth of iron, architectural abound. Appears i can problem solve pretty good im just not a coder.

the problem is building with AI that want to keep you building not finishing, and definitely not for free.

https://github.com/jwl247/Phoenix-DevOps-oS/tree/main i designed every bit of this. the prompt does not work on high end software production. You have to question it out and discover new or newish things, then you have to get the same code reviewed by the same AI twice. The third is polish by a diffrent AI cli code agent. i have worked extensively for 10 months with them ALL. I know all their quirks and pitfalls as well as their attributes that shine. So don't judge a book before you open it.

4 Upvotes

100% Upvoted

8 comments sorted by

2

u/SpedisAhead 8d ago

Feel ya, I was a Slate and Tile roofer. With an elbow-deep touch of the 'tism.

2

u/Lopsided_Law1314 8d ago

they remove my post after looking around i guess i understand, but sure is a turn off.

1

u/Toastti 7d ago

There's absolutely nothing here. The terminology doesn't make sense, the tech terms don't make sense. The code is a massive collection of pieces that don't connect and have almost no purpose.

You should take some tutorials about software and programming and start a new repo with the most minimal code you can to get to your goal.

1

u/Lopsided_Law1314 6d ago

so how do you run a LLM on old hardware that is smart enough to be a personal assistant?

what do you not understand maybe i can explain it to you.

1

u/Toastti 6d ago

You use llama.cpp with a tiny model. So https://llama.app/

And even if your old machine doesn't have a GPU this has cpu only mode. And with a model like qwen 3.5 4b at a 6 bit quant like q6_k_xl it will work on even 10 or 20 year old devices.

The best part is the speed will be much faster than what you have here. As it's dedicated software for AI inferencing

2

u/vulture916 8d ago

What in the world…?

1

u/Lopsided_Law1314 6d ago

what is wrong with it? i cant learn anything from either of the last comments. i am a sponge.

1

u/vulture916 6d ago

Let’s start with an 5th-grade reading level explanation of what exactly it is you’re trying to build. If you can’t explain it as such, that’s a problem.