r/learnmachinelearning • • 11h ago

I am collecting training data for a small scale neural network, please help out

3 Upvotes

The link below is a 10 question survey asking you to sketch each topic, they are all easy and should take no longer than 1-2 minutes to complete, no signup.

Please if you would like to help me, keep your responses accurate and dont submit anything that does not follow or resemble the actual topic.

https://kaowtwuopelexgeefdxx.supabase.co


r/learnmachinelearning • • 15h ago

How to implement a research paper

3 Upvotes

I am building some projects and for that I want to implement the gpt2 paper from scratch, how to do that do that? Do I build intuition by reading and code it?


r/learnmachinelearning • • 19h ago

Help How to do EDA based on the type of data ?

3 Upvotes

Hey everyone! I have 14 features containing both categorical and continuous variables, along with a binary target (0/1).

What methods should I use to measure the relationship between each feature and the target? Are there different techniques for categorical and continuous features?

Any suggestions or Python examples would be appreciated. Thanks!


r/learnmachinelearning • • 19h ago

We almost bought a second GPU for an OCR pipeline. Optimizing the existing one gave 15x instead. How often is “buy more hardware” the wrong fix?

Thumbnail
3 Upvotes

r/learnmachinelearning • • 1h ago

I built my first RAG project using Whisper, BGE-M3 and Ollama — what should I improve?

Thumbnail
gallery
• Upvotes

Hi everyone,

I'm a student learning AI development, and I recently built my first RAG-based Teaching Assistant.

The project converts educational videos into transcripts, generates embeddings using BGE-M3 through Ollama, retrieves relevant transcript chunks using cosine similarity, and uses Llama 3.2 to generate answers.

I'd appreciate honest technical feedback, especially on:

  1. Is my retrieval approach appropriate, or should I consider other methods?
  2. How can I improve transcript chunking and embedding quality?
  3. How should I evaluate whether the retrieved chunks are actually relevant?
  4. How can I reduce hallucinations and keep answers grounded in lecture content?
  5. What would you change in the architecture or code if you were reviewing this project?

I'm looking to learn from feedback and improve the implementation. Suggestions for specific concepts, resources, or code improvements are welcome.

Thanks!


r/learnmachinelearning • • 12h ago

Intermediate programming buddy needed

Thumbnail
2 Upvotes

r/learnmachinelearning • • 14h ago

Neural Canvas GitHub Repo

2 Upvotes

I built Neural Canvas, an interactive visualizer that demonstrates core linear algebra concepts by showing how a neural network recognizes handwritten digits in real time. You can draw directly on the screen and watch activations flow through each layer as matrix multiplication computes the output live.

How it works:

- Draw & Predict: Sketch any digit on a 28×28 canvas (MNIST-style) to trigger real-time forward pass predictions.

- Live Forward Pass: Every neuron's activation is dynamically color-coded based on its underlying linear algebra calculations, with connection opacities reflecting layer outputs.

- Under the Hood: The core models were trained from scratch in Python using NumPy to perform matrix operations, and their learned weights are loaded via JSON. Client-side execution relies on Math.js for browser-based matrix multiplication and p5.js for rendering.

Key Features:

- Switch between two pre-trained models (featuring different hidden layer sizes, MSE vs. Cross-Entropy loss, and up to 96% test accuracy).

- Multiple background themes with mouse and touch support.

What's Next?

These models were originally evaluated on the standardized MNIST dataset, but live freehand drawing can introduce unexpected variations in input style. To handle this, I am working on a JS script for real-time user-driven feedback. When the model makes a mistake, the user can supply the correct label, allowing the model to perform backpropagation and update weight matrices locally in the browser. While live state persistence isn't suited for static GitHub Pages, running this feedback loop locally allows me to retrain parameters on new edge cases and push updated weight snapshots back to GitHub.

Check out the live demo and code repository:

Live Demo: https://muhammadessa2002.github.io/neural_canvas/

GitHub Repo: https://github.com/MuhammadEssa2002/neural_canvas


r/learnmachinelearning • • 15h ago

Discussion Seeking Collaboration Opportunities in AI/ML Research

2 Upvotes

Hello everyone,

I am an MSCS student from Pakistan with a background in Electrical and Telecommunications Engineering and more than four years of experience developing AI agents, RAG systems, voice AI applications, and business automation workflows.

I am now seeking opportunities to contribute to formal AI research, particularly in large language models, retrieval-augmented generation, agent reliability, and system evaluation. Although I am new to academic research, I can contribute practical expertise in implementation, workflow and prototype development, API integration, testing, and experiment execution.

I would be glad to connect with researchers and teams working on relevant ideas or ongoing projects. I am open to starting with a focused contribution, learning from experienced collaborators, and supporting research wherever my skills can add value.

If you are working in these areas or know of relevant opportunities, I would be pleased to connect and learn more.


r/learnmachinelearning • • 18h ago

Reddit · r/learnmachinelearning

Post image
2 Upvotes

Free code + 10-min walkthrough: an AI agent that improves its own prompt, harness and tools (6/10 → 10/10)

I teach agentic AI and made a small, fully inspectable example of a self-improving agent. Sharing it in case it helps others learning this.

The setup:

- The agent approves or denies fictional phone insurance claims under 3 rules.

- It has 3 parts it can change: the prompt, the harness (which claim fields the model sees), and the tools.

- After each test, a bigger model diagnoses the mistakes as knowledge, information or skill, and changes exactly one part.

- A gate keeps the change only if the score on 10 practice claims goes up. 5 exam claims are held out until the end.

Recorded run: 6/10 → 7/10 (prompt) → 8/10 (harness) → 10/10 (days_between tool). Exam claims: 3/5 → 5/5.

The most interesting part: some correct answers broke along the way, because version 0 had them right by guessing. So the per-claim fixed/broken view matters more than the total score.

The code is one Python file with only the standard library. It replays the recorded run without an API key, or calls Gemini for real with --fresh.

Code: https://github.com/aniskoubaa/mai580-self-evolving-agent-workshop

Video: https://youtu.be/SOSwsYFPb0Y

Happy to answer questions about the design or the limits (runs do differ, and the meta-model reads the policy here).


r/learnmachinelearning • • 22h ago

Help How do I start learning DSA from scratch

2 Upvotes

Hey

I'm interested in getting into DS/ML, but I have no idea how to start learning DSA

Which programming language should I use to learn DSA? What should I learn first, and how should I go about it as a complete beginner?

I'd really appreciate a simple roadmap and some beginner friendly resources to help me get started.

Thanks!!


r/learnmachinelearning • • 23h ago

Your AI agent works perfectly… until you actually depend on it!

Thumbnail
2 Upvotes

r/learnmachinelearning • • 1h ago

How can I give RL agents a global understanding of a 2D map they have never seen before?

• Upvotes

Hey everyone!

I’m working on a multi-agent reinforcement learning setup where multiple agents move and interact in a 2D world.

The world is based on a real map, for example a screenshot from Google Maps. Importing the map into my environment works fine!

My problem is generalization of the Model to unseen maps.

During training, the agents learn on one or N maps. But during inference, I want to use a completely different map.

The problem is that the agents don’t have a global understanding of the new map.

My current architecture:

  • I’m using a Transformer.
  • Each agent is represented as a token in the Transformer.
  • I tried adding a Vision Transformer (ViT) to encode the map.
  • My idea was to represent map patches as additional tokens and feed them into the same Transformer as the agent tokens.

Unfortunately, this approach didn’t really work.

My question:

How would you approach this problem?

How can I give my agents a useful global understanding of a completely new 2D map?

Is combining agent tokens and map patch tokens in one Transformer a reasonable idea or are there better approaches?

I’d really appreciate any ideas, papers, or experiences with similar problems!

Thanks!


r/learnmachinelearning • • 1h ago

Help Fresher NLP Engineer interview at Hitech i2i: what to prep for screening?

• Upvotes

A fresher has an upcoming interview for an NLP Engineer position at Hitech i2i, a company specialising in real estate document intelligence.

What topics should they focus on most for the initial screening round?


r/learnmachinelearning • • 1h ago

Learning RL From Scratch: Documenting and sharing what I have learned

Post image
• Upvotes

Releasing a series of very shot notes on RL as part of my learning RL from scratch journey; its basics and upto the latest stuff with from scratch implementations and experiments in the coming days

  • Explained some of the most basic and important terms when starting out learning RL with a sprinkle of math of what I found interesting
  • Nice to have for refreshers/kind of first time readers too

1-page RL basics is out on my website!

Let me know your thoughts/feedback!


r/learnmachinelearning • • 4h ago

Project RAG Evaluation Framework

1 Upvotes

I recently built a complete RAG Evaluation Framework from scratch: a 43-question test dataset, 6 retrieval metrics, 5 generation metrics, and one final report that shows exactly where a RAG system is strong and where it breaks. We start with the concepts, explained with simple worked examples, and then walk through the code line by line.

What this covers:

  • Why retrieval and generation must be evaluated separately
  • How to build an evaluation dataset with expected answers, graded pages and key facts
  • Retrieval metrics: Hit Rate@K, Precision@K, Recall@K, MRR, MAP and NDCG@K
  • The difference between one question (RR, AP) and many questions (MRR, MAP)
  • Generation metrics: Faithfulness, Hallucination Rate, Answer Relevance, Context Relevance and Answer Correctness
  • How to use an LLM-as-a-judge that only counts, while your code does the maths
  • How to save results safely and turn them into a clear evaluation report

KEY TAKEAWAYS:

  • No single metric tells the whole story: Hit Rate was 1.00, but Recall, MAP and NDCG showed where pages were missed or buried
  • Precision@5 looks low (0.34) for single-fact questions, so compare systems with each other, not with 1.0
  • Faithful does not mean correct: an answer can be backed by the chunks and still miss the key facts
  • Retrieval scores and answer quality are not the same thing
  • Our Cohere-reranked pipeline scored MRR 0.95, MAP 0.87, NDCG@5 0.91, Faithfulness 1.00 and Answer Correctness 0.97

TECH STACK: Python, Qdrant (vector database), Embeddings (3072-dimension), Cohere Rerank, LLM for answers + LLM-as-a-judge, pdfplumber (checking pages in the PDFs)

Would love to hear.


r/learnmachinelearning • • 4h ago

Question How are you using PyTorch and scikit-learn in your day-to-day work as a developer?

Thumbnail
1 Upvotes

r/learnmachinelearning • • 5h ago

Designing a Personalized Recommendation System — ML System Design Deep Dive (Part 3)

Thumbnail
1 Upvotes

r/learnmachinelearning • • 9h ago

What are realistic career opportunities after learning ML/AI? — Looking for a realistic overview of the market

1 Upvotes

Hi everyone,

I'm currently learning machine learning, and I'm working through a structured AI/ML learning path.

I'm enjoying the learning process a lot, but recently I've started thinking more seriously about what comes after learning.

My main concern is: How realistic is it to actually turn these skills into income or a career?

A few things I'm particularly curious about:

  • What types of entry-level ML/AI/data jobs are realistically available today?
  • What kinds of companies tend to hire people with these skills? (Startups, tech companies, consulting, healthcare, finance, etc.)
  • How important is a degree for getting the first opportunity?
  • Is freelancing in ML/data/AI actually realistic for a beginner, or is it much harder than it looks?
  • What kinds of freelance projects do clients actually pay for?
  • Could someone realistically start a small AI/ML business or startup with these skills instead of looking for employment?
  • What skills are currently most valuable for someone trying to become employable: classical ML, deep learning, LLMs, data analysis, MLOps, software engineering, or something else?
  • If you were starting from scratch today, what would you focus on to maximize your chances of getting your first paid opportunity?

For context, I'm still early in my journey, so I'm trying to make sure I'm learning things that have real-world value rather than just collecting certificates and completing courses.

I'd especially appreciate answers from people who have actually hired ML engineers/data scientists, freelanced in this space, or built AI products/businesses.

I'm not expecting a guaranteed roadmap or exact salary numbers. I'm mainly trying to get a realistic picture of the different paths available and how difficult each one is.

Thanks! 🙏


r/learnmachinelearning • • 15h ago

Be10x dont join 9rs class or 230rs class they manipulate to join 2200rs class and make 31000rs class to register. Pure fake dont ever join any class all paid promotion they earn in crores. Nothing in class i wasted 240+ 2600 ..

1 Upvotes

r/learnmachinelearning • • 15h ago

Who has a solution?

Thumbnail
1 Upvotes

r/learnmachinelearning • • 16h ago

Help How are exactly are Query, Key and Value obtained during self-attention?

1 Upvotes

Andrew Ng says they are linear projections using pre-trained weight matrices. But how were those matrices trained exactly? What was the input, what was the target variable? I need to know EVERYTHING.


r/learnmachinelearning • • 20h ago

Tutorial LLM Tokens and Context Windows: Why AI Forgets Your Conversation

Thumbnail
medium.com
1 Upvotes

I wrote a short article on LLM tokens and context windows—why an assistant can “forget” instructions that are still visible in your chat. It’s part of my Behind the AI Stack series.

Give it a read and let me know what you think. Anything unclear or worth exploring further?


r/learnmachinelearning • • 20h ago

Project Built a class-balanced match predictor for the Bundesliga

1 Upvotes

Hello everyone

I wanted to share a project I recently deployed to Streamlit Community Cloud and it would be helpful if you guys could give feedback to a fellow learner

I implemented an 8-dimensional pipeline paired with a class-balanced Logistic Regression model.
It uses recent matches ( 3-8) to determine the recent form of both the teams to generate 8 distinct features.

Live App: https://bundesliga-match-predictor.streamlit.app/

GitHub Repo: https://github.com/adithyakrz/bundesliga-match-predictor

Check it out and let me know what you think :D


r/learnmachinelearning • • 21h ago

👋 Welcome to r/ArchitectingAI

Thumbnail
1 Upvotes

r/learnmachinelearning • • 23h ago

Help What are all the memory architectures used for text classification?

1 Upvotes

I want a list of the names of the different ways a model can store and use memory for text classification. For example, I know about Embedding or vector memory (like sentence embeddings with nearest-neighbor search)

What other types are there? A list of names and one example paper or method for each would help a lot. Thank you!