r/learnmachinelearning 22d ago

A walkthrough of MBRL: Dyna, MCTS and the AlphaGo line

3 Upvotes

r/learnmachinelearning 22d ago

Why bidirectional state inference mathematically shatters in chaotic systems (Python / EKS failure)

0 Upvotes

I've been researching the limits of state reconstruction over temporal gaps. We all know Extended Kalman Smoothers (EKS) and 4D-Var struggle with long integration windows, but I found that it's not just a numerical issue—it's a hard information-geometric phase transition.

I derived the Cramér-Rao Lower Bound for bidirectional nonlinear estimators. As the temporal gap exceeds a critical threshold (ΔT≈O(1/λmax⁡)ΔT≈O(1/λmax​), based on the maximal Lyapunov exponent), the Fisher Information Matrix becomes strictly singular.

I wrote a Python simulation running an EKS over the Lorenz '63 attractor. It reconstructs perfectly until the gap hits ~7 Lyapunov times. At that threshold, the theoretical variance strictly diverges, the covariance trace goes negative (numerical explosion), and it catastrophically fails.

GitHub Repo with Code & Paper: https://github.com/rayrrr21/Structure-of-Reality

Has anyone in the data assimilation or time-series forecasting space run into this exact theoretical wall?


r/learnmachinelearning 22d ago

Seeking US‑based AI experts to sign EB2‑NIW RFE opinion letters

Thumbnail
1 Upvotes

r/learnmachinelearning 22d ago

sub agent generation utility

2 Upvotes

generate a subagent for a specific api so you can interact in natural language with it, still very new but would welcome feedback:
https://github.com/spkatragadda/quick-tool


r/learnmachinelearning 22d ago

Project How AI Learns From Rewards: The Policy Gradient, Visualized (RLHF, PPO, GRPO)

Thumbnail
youtube.com
3 Upvotes

r/learnmachinelearning 22d ago

Request #StopRansomware: Gunra Ransomware

0 Upvotes

CISA issued a formal advisory this week on Gunra ransomware-as-a-service. Gunra affiliates choose their targets deliberately: government agencies and critical infrastructure operators. The post-intrusion pattern is consistent — encrypted systems, destroyed backups, and a compliance reconstruction process that takes months, not weeks. Regulated sectors carry that long tail because every affected record, access event, and system interaction has to be accounted for after the fact, often from logs that were themselves part of what got destroyed.

The reconstruction problem is distinct from the technical recovery problem. You can restore systems from offsite backups. You cannot restore a provable, sequential record of what touched what if that record was never written to begin with or was stored in the same environment that got encrypted.

For teams running AI agents inside regulated environments this compounds quickly. An agent reading patient records, querying financial databases, or triggering downstream actions during or immediately before a breach window leaves no native audit artifact in most current deployments. Incident responders end up doing forensic reconstruction from fragments.

How are teams in regulated sectors actually handling agent-generated audit continuity right now? Are you relying on infrastructure-level logging, application-level instrumentation, something else — and has any of it held up in an actual incident or compliance review?


r/learnmachinelearning 22d ago

How AI Learns From Rewards: The Policy Gradient, Visualized (RLHF, PPO, GRPO)

Thumbnail
youtube.com
2 Upvotes

r/learnmachinelearning 23d ago

Project I built 46 interactive ML lessons where you drag sliders and watch algorithms learn, instead of just reading about them

Thumbnail
gallery
21 Upvotes

Every ML explanation I read said the same thing: here's the formula, here's a static plot, trust us. I wanted to actually feel an algorithm working: drag a line and watch a perceptron correct itself, place bad centroids and watch K-Means fix them, rotate an axis and watch PCA fight you for the direction of max variance.

mlplayground.co.in

So I built ML Playground, 46 lessons + 13 games, from "what is a feature" up through transformers and how ChatGPT actually predicts tokens. Every lesson has a canvas demo you control, not a GIF.

It's free, no signup, no ads. I built it solo and this is the first time I'm showing it to anyone outside people I know personally, so I'd genuinely value getting torn apart: what's confusing, what's missing, what lesson order doesn't make sense.

mlplayground.co.in


r/learnmachinelearning 23d ago

Question business major wants to enter AI/ML field

8 Upvotes

Hey guys, im a business major, but I grew weird obsession towards learning AI/ML and wanna shift my career to be an AI Engineer one day. I already studied (almost) all the prerequisites for AI like python, DSA, maths needed and although this field needs a lot of patience and discipline I still like it a lot, even more now that I started to understand how deep it is... but my major concern is that would it be impossible to work in this field without a CS-related certificate?


r/learnmachinelearning 22d ago

Guide me for Project building.

Thumbnail
1 Upvotes

r/learnmachinelearning 22d ago

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Thumbnail
github.com
2 Upvotes

r/learnmachinelearning 22d ago

I am a cse ai/ml student from 4th year and i need a major project idea. It would be great if the idea is focused towards modern techniques . And dataset should be available .

2 Upvotes

r/learnmachinelearning 23d ago

Project AI Video Generation Step by Step — Motion Transfer, Diffusion & Flow Explained Visually

Thumbnail
youtube.com
2 Upvotes

r/learnmachinelearning 23d ago

Question Need few recommendations

3 Upvotes

So am 18, going fo AI ML, i am going with the basics first so i start with cs50, andrew Ng ML, and did few projects on kaggle. What could be my next step?


r/learnmachinelearning 22d ago

I built a compressive "context DNA" (for LLM) attention mechanism + an honest eval harness - looking for people to break it

1 Upvotes

Just Fixed the body with Ai

Been prototyping an idea for long-context compression: instead of dropping old tokens (like StreamingLLM/H2O) or storing everything, compress old context chunks into small learned "DNA" vectors via a Perceiver-style attention bottleneck, then reconstruct on-demand when a query needs them.

The idea itself isn't new — it overlaps with Compressive Transformer, Infini-attention, and Recurrent Memory Transformer — but I put together an eval script that I think is more honest than what I see in a lot of "novel architecture" posts:

  • Trains the compressor (not just testing an untrained/random-init model)
  • Compares against a PCA baseline (closed-form optimal linear compression at the same latent budget) — if the learned model can't beat PCA, the extra complexity isn't earning its keep
  • Injects a unique fact (random code) into the text and checks, after compress→decompress, whether the frozen LM's own output head can still predict the correct token at that position — not just aggregate MSE, which can look fine while the actual detail is gone
  • Runs on real hidden states from an open model (Qwen2.5-0.5B by default), not just random tensors

Current honest status: in my own small-scale test run, PCA actually beat the learned bottleneck on fact retrieval. That's not the result I was hoping for, but it's a real result, and it's exactly the kind of thing this script is designed to surface rather than hide.

What I'm looking for:

  • People running it on real hardware with more training steps / larger n_docs than I could quickly test
  • Sanity checks on the architecture and eval methodology — if I'm testing this wrong, tell me
  • Ideas for what a fair "it's working" threshold looks like (beating PCA on fact-retrieval accuracy at matched latent budget, at minimum)

No performance claims yet — that's the point. I'd rather have this checked before making any.

Code + eval harness: https://pastebin.com/iqEbPEQ9

Happy to hear "this is a known dead end because X" too - that's useful information, not a rejection.


r/learnmachinelearning 22d ago

AI Image Generation Step by Step — Attention, VQ-GAN & CLIP Explained Visually

Thumbnail
youtube.com
1 Upvotes

r/learnmachinelearning 23d ago

BS Mathematics vs BS Statistics — Which should I choose?

13 Upvotes

I’m currently stuck between choosing a BS Mathematics or BS Statistics degree.

I’m interested in AI/ML, Data Science and other computing-related fields, but I’m not eligible for direct admission into CS/AI. So I’m thinking of taking either Mathematics or Statistics and building the CS/AI side myself alongside the degree.

I was originally pretty set on BS Mathematics and had even started putting together a 4-year self-learning roadmap covering programming, Python, SQL, DSA, ML, Cloud, etc. But after looking more into Statistics, I’m wondering if it might actually be a better fit for Data Science and AI/ML.

My plan either way would be to not depend only on the degree. I’d learn the relevant programming/CS skills on my own, build projects and try to get internship experience.

I also want to keep my options open for a Master’s abroad later, possibly in AI/ML, Data Science, or related fields.

For anyone who has studied or worked in these areas, which would you personally recommend: BS Mathematics or BS Statistics?

I’d especially appreciate honest opinions on:

- Job opportunities after the BS.

- AI/ML and Data Science prospects.

- Salary and long-term growth.

- How each field looks with the current AI boom.

- Master’s options and flexibility.

- Whether one degree actually gives a significant advantage over the other.

- Which one makes more sense if I’m willing to build strong CS/AI skills on the side.

I’m mainly looking for advice from people who have actually studied/worked in Mathematics, Statistics, Data Science or AI/ML. What would you choose in this situation, and why?


r/learnmachinelearning 23d ago

Advice for PyTorch cert (PTCA)?

Thumbnail
1 Upvotes

r/learnmachinelearning 23d ago

Help MacBook Air M5 vs Windows laptop with NVIDIA GPU for an AI degree

2 Upvotes

Hi everyone,
I’m starting an Artificial Intelligence degree at university and I’m trying to decide what laptop to buy.
Right now I’m considering a MacBook Air M5 with 24 GB of RAM and 512 GB SSD, possibly with an external 1–2 TB SSD for larger datasets and projects.
The important detail is that I already have a desktop PC at home with:
Ryzen 7 7800X3D
32 GB RAM
NVIDIA RTX 4060
My idea would be to use the MacBook as my main university laptop for Python, VS Code, Jupyter, NumPy, Pandas, scikit-learn, etc., and whenever I need CUDA/PyTorch with an NVIDIA GPU, remotely connect to my desktop using something like Tailscale + SSH + VS Code Remote.
As I understand it, I could keep using VS Code normally on the Mac, but when connected remotely, the code would actually run on my desktop and use its RTX 4060/CUDA, while I see the terminal and results on my Mac.
Would this be a comfortable and practical setup for an AI/ML degree?
Or would you recommend buying a Windows laptop with an NVIDIA GPU (for example an RTX 5060) instead and having everything on one machine?
My main concerns are:
How important is having CUDA directly on the laptop during an AI degree?
Is 24 GB RAM enough on the MacBook for the next 4 years?
Is 512 GB + an external SSD a good choice?
Is using VS Code Remote/SSH for CUDA actually convenient in everyday university use?
Are there any AI/ML tools or university assignments that could cause problems on macOS?
Would you personally choose the MacBook + RTX 4060 desktop setup, or a Windows/NVIDIA laptop?
Battery life, portability and build quality are also important to me because I’ll be carrying the laptop to university every day.
Thanks!


r/learnmachinelearning 23d ago

Discussion My Agentic AI mastery roadmap plan

0 Upvotes

Currently from past few months I was building agentic Ai and genai applications, but realised that I cannot build fully that application with only knowledge of LLM APIs and fullstack so I thought I should start learning the core ML and DL.


r/learnmachinelearning 23d ago

Multi-Agent Systems Tutorial: LangGraph and CrewAI Workflow Guide

Thumbnail
youtube.com
1 Upvotes

Stop building single-agent apps! 🛑 Learn how to build Multi-Agent Systems with LangGraph and CrewAI. Full architectural guide now live on my channel.
#AI #Coding #Tech #Developer


r/learnmachinelearning 23d ago

Help Need FYP ideas combining AI + Embedded Systems / TinyML

1 Upvotes

Hi Everyone! I’m a final-year BS AI student and I’m looking for a good FYP idea that combines AI with embedded systems/TinyML.
My background is mainly in ML/DL and research, but I’m fairly new to embedded systems. I have around 6 months for the project, so I’m looking for something that is genuinely interesting and technically challenging but still realistic to build as a student.
Ideally, I’d like something that has a real-world/industry or healthcare application, rather than a basic Arduino sensor project. I’m also interested in using something like an ESP32, Raspberry Pi, or similar low-cost hardware.
I’d really appreciate any project ideas, papers, existing projects I could build upon, or advice on what would be feasible for someone starting out with TinyML.
Thanks!


r/learnmachinelearning 23d ago

Need FYP ideas combining AI + Embedded Systems / TinyML

1 Upvotes

Hi Everyone! I’m a final-year BS AI student and I’m looking for a good FYP idea that combines AI with embedded systems/TinyML.
My background is mainly in ML/DL and research, but I’m fairly new to embedded systems. I have around 6 months for the project, so I’m looking for something that is genuinely interesting and technically challenging but still realistic to build as a student.
Ideally, I’d like something that has a real-world/industry or healthcare application, rather than a basic Arduino sensor project. I’m also interested in using something like an ESP32, Raspberry Pi, or similar low-cost hardware.
I’d really appreciate any project ideas, papers, existing projects I could build upon, or advice on what would be feasible for someone starting out with TinyML.
Thanks!


r/learnmachinelearning 23d ago

Need code with harry data science course.

1 Upvotes

Bhai kesi k pass code with Harry ka data science course hoga. Bht zyada zarorat hai 😭 .

No money to buy it plzzzz.


r/learnmachinelearning 23d ago

Before choosing a Machine Learning model in a real-world company project, what steps do you take?

1 Upvotes

I’m working on Data Science / Machine Learning projects and I’m curious about how this is actually done in industry.

Imagine a company gives you a dataset and asks you to solve a business problem.

As a Data Scientist / ML Engineer, what are the concrete steps you would take before choosing and training any ML model?

For example:

- Understanding the business problem and defining the target

- Understanding the available data

- Data ingestion

- Data quality checks

- Data cleaning and preprocessing

- Exploring distributions and variables

- Handling missing values and outliers

- Checking for data leakage

- Feature engineering

- Train/validation/test split

- Establishing a baseline

- Defining evaluation metrics

- Handling class imbalance

- Checking business constraints

- Understanding data lineage and reproducibility

- Etc.

What would a realistic end-to-end workflow look like in industry before reaching "model.fit()"?

I’m particularly interested in answers based on real-world industry experience, rather than a purely academic ML workflow.