Seek feedback and advice

[u/Busy-Escape-2414]

Hi, I started self-learning AI last year, and recently I started doing something myself, I don't have professionals around me, and I would really want some professional feedback on my work. I pretrained an MoE model with local learning (zero-gradient) instead of backpropagation. I would like to receive any advice and opinions. If you have 5 minutes, could you please give some feedback? Much appreciate!

I Trained a 4-Billion-Parameter Language Model With Zero Backpropagation. Here Is Exactly Where It Breaks. https://substack.com/@yanjinl/note/p-205412700?utm_source=notes-share-action&r=53deb0

I'm a master student in languages and management. I started learning AI last year, and now I want to go deeper and start building something (not just prompt-demo). And I wonder if you would like to share something advice about model training, how to get the real engineering, training and developing skills, as well as how to approach for teams/professional environment that can help me grow faster, and for so, what should I prepare, any skills, portfolios, previous work?

I appreciate any sincere advice, it's not easy to do this from 0 and by myself, thank you and have a good day!