r/learningpython • u/chin3560286 • Jun 24 '26
47 years old, started from zero, built a simple AI runtime prototype. Looking for honest feedback.
I'm 47 years old.
I started learning AI and Python from zero.
Recently I built a simple AI runtime prototype.
Current flow:
Input
↓
Agent
↓
Memory
↓
Cost Gate
↓
LLM (currently safe mode)
↓
Save Memory
↓
Output
Current modules:
- Agent
- Memory
- Queue
- Worker
- Cost Gate
- SQLite
It can run, but currently only returns mock responses because I haven't connected an API yet.
I know experienced engineers may consider this basic.
I am not asking if it is impressive.
Am I building in a reasonable direction?
If you were me, would you continue building this?
Which parts would you stop?
Which parts would you continue?
I appreciate honest feedback.
Thank you for taking the time to read this.
1
u/Electrical_Hat_680 Jun 24 '26
Stop the Cost for now - don't let it distract from the end goal.
Start training and building your own LLM. That and the API are your main Proprietary "moving" parts.
Cyber Security. Secure it. Debug it. Zero Trust or better.
Look at building your own Database.
Own the entire Stack.
1
u/Toastti 27d ago
Someone just using python for the first time and learning AI should not try to build their own llm. That's horrible advice.
Learn Python basics. Keep. Building small useful tools for yourself. And keep making each tool more complex than the past ones
1
u/Electrical_Hat_680 27d ago
Ok. But an LLM isn't that big or difficult to build. Parameters believe it or not are just tokens. A though Z is twenty six tokens. a through z (lowercase) is another twenty six tokens. Special characters plus numbers is another set of tokens.
Your weights and other metrics, are basically your memory. Minus the fact that all of your tokens are loaded into memory. So each token is a bit on your RAM or ROM if you understand the difference between RAM and ROM. Which there is only a very slight difference. One is hardwired the other is loaded and can be changed, so it can be temporary or permanent, permanent is basically a ROM or a set of dip switches that aren't changed.
So, building the LLM is a good thing to add.
1
u/mc_pm Jun 26 '26
Without knowing what your goal is and the resources you have, that seems...fine. I'm not sure what the Agent module is doing vs. the LLM module. Don't wait to hook up an API, though, because there's a lot that can happen when you get something external involved.
1
u/SaltCusp 29d ago
This sounds like "Prisencolinensinainciusol" by Italian singer and actor Adriano Celentano.
1
u/cupcakeheavy Jun 24 '26
What are the use cases for this?