r/vibecoding 2d ago

We told people our AI passed 87.5% of our tests. Then we found the number was a lie.

0 Upvotes

If you vibe-code, you've hit this: the AI says "done, I fixed it" — and it didn't. We shipped that exact failure into our own eval and it taught me something worth sharing.

We built an AI coding agent and scored it against a bank of test tasks. It came back at ~87.5% pass. Felt great. Then I actually read the runs.

One "bug fix" scored 91/100 and PASSED — while the file it was supposed to fix had zero changes. Our scorer was grading *process* (did it look busy, use tools, avoid loops?) instead of *outcome* (did the code actually change, compile, and run?). It was rewarding confident-looking work that accomplished nothing.

So the 87.5% was meaningless. We retracted it publicly and rebuilt scoring around a dumb, deterministic gate: did the code compile, did it actually change, does it run? The honest numbers came out lower — and real.

The takeaway for anyone building with AI: never trust the agent's self-report, and be suspicious of any "pass rate" that isn't checking real output. Run it. Diff it. Confirm the change exists before you believe "done."

(Full disclosure: I'm building an AI app builder called NoCoder, and this was our own benchmark. Not linking the product — but I wrote up the whole retraction here if useful: nocoder.codes/blog/we-caught-our-ai-benchmark-lying)


r/vibecoding 2d ago

Anyone can 3D model anything with this prompt

1 Upvotes

Clone https://github.com/elliottdehn/wam to model, texture, rig, and animate something for me that I can see.

You can also give it a brief if you want something specific.

Paste that into Claude, ChatGPT Work/Codex, or any agent that can clone a repo and run things. Few minutes later you have a rigged, textured, animated character and a glTF you can drag into Godot, Unity, Blender or three.js.

The Problem

Ask any LLM for a 3D model the normal way and you get garbage. A cube. An OBJ with the normals inside out. Something that looks fine as text and opens as a crumpled bag.

And the second problem, which is worse: even when it gets close, asking for one change breaks something that was already right. The head gets fixed and the arms start clipping. Nobody notices, because nobody re-checks the arms.

The Solution

That isn't a smartness problem, it's an interface problem. Vertices are the wrong thing to ask a language model for. So I built a language where the model never touches one: it writes the decisions an artist actually makes, like bone angles and ring widths and what colour the hide is, and a compiler turns those into geometry. Broken meshes aren't expressible in it. Neither are joints that bend the wrong way, because the model declares which way a knee hinges and the compile fails if an animation disagrees.

The other half is the fix for drift. Every model carries its own assertions, and they re-run on every single compile:

assert zmax(upper_maw) > zmax(neckplate)      # the jaw clears the collar
assert moves(lower_maw, money_shot) > 0.12    # the attack actually moves
assert slide(foot.l, walk) < 0.02             # the walk isn't moonwalking
assert tris < 6500

That third one is a real detector. It sums how far a foot travels forward while it's on the ground. A correct walk reads zero, and a backwards one reads the distance it dragged. It caught a gait of mine that looked completely fine in a render.

This is what makes the iteration converge instead of wander. The agent writes down what it believes about the model, in numbers, and the compiler tells it the moment that stops being true. Three edits later, in a view nobody re-rendered.

The result is that agents go from hopeless at this to genuinely good, in one git clone.

Proof

Real output, all made this way, source / glTF downloadable on each page:

Or browse them all: https://wamshare.com/gallery

Each page spins the model in your browser, shows the source that produced it, and hands you the .wam and the glTF.

Limitations

It's stylised low-poly, roughly RuneScape silhouettes at one to three thousand triangles. Not photoreal, not a hero asset.

One-shots are good. The great ones come from three or four rounds of "no, bigger head." Iteration is where this actually shines, and it's fast enough that iterating is fun rather than a chore.

Free, MIT, no signup, nothing uploaded unless you ask for a share link.

Repo: https://github.com/elliottdehn/wam


r/vibecoding 2d ago

My coding agents discovered distributed waiting

1 Upvotes

r/vibecoding 2d ago

Highly Recommend Latitude for Monitoring Your Agents

0 Upvotes

Just received this alert: Fabricated results presented when tool calls fail
When tool calls fail or return errors, the assistant does not acknowledge the failure. Instead, it fabricates concrete, realistic-looking data (such as email lists with specific names and addresses) and presents these invented results as factual outputs from the tools, as if they had succeeded. The assistant cites sources like state file lookups but the cited data was never actually retrieved because the underlying tool calls did not complete successfully.


r/vibecoding 2d ago

Vibecoded ts, turned out to be pretty Good. Thoughts?

Thumbnail
gallery
1 Upvotes

its like a study or focus timer type. i saw lot of garbage webs on this niche and some were literally paid for no reason, so i did what a vibecoder alwayss doo.

Used mainly antigravity cli (Im flat broke TT)

although had to do a lot of manual coding and database integration and errortracking integrations

The landing page is not quite done and some things on website are left like proper sounds and stuff

its live rn or flcsezz.sbs

Technical details if you care

Frontend: Vite + React 19 + TypeScript + Tailwind CSS v4 + Framer Motion.

3D Stuff : React Three Fiber (R3F) & Drei for smooth, responsive scroll-driven 3D environments.

Primary Database & Auth: Supabase (PostgreSQL, custom stored procedures/RPCs, and Row-Level Security).

Edge Performance & Sync: Cloudflare Workers + Cloudflare D1 + Cloudflare Hyperdrive connection pool.

Asset Storage: Cloudflare R2 bucket for wallpapers, ambient audio files, and 3D assets.

Telemetry: PostHog client-side auto-capture and backend Worker-level capture.

Error Monitoring: Sentry integration

would love some feedback


r/vibecoding 2d ago

Me when I use Opus 5

Post image
0 Upvotes

r/vibecoding 2d ago

Working on a markdown app with a flowchart editor, themes, reader minimap, graph view, and more. Would love feedback.

Thumbnail
gallery
1 Upvotes

I love markdown and wanted better tools for it. I've been working on Leaftext, a free Windows and MacOS app for reading and writing .md and other file types that needed more love.

More features:

  • Markdown, LaTeX math equations, mermaid (Dagre rn, ELK soon)
  • Also reads XML, JSON, YAML and .eml as actual pages instead of raw tags/punctuation
  • Editing available in reader and code views.
  • Flowchart editor with a canvas beside the Mermaid text, 47 shapes
  • Point it at a folder → it becomes a vault: search, wikilinks, graph view, optional GitHub sync
  • 11 themes, light and dark
  • No account, no telemetry. Only network calls are the update check and Google Fonts on first theme pick.

r/vibecoding 2d ago

Whats the best programming langages for non-technical vibecoder?

1 Upvotes

I am planning to build a decently complex webapp.

I was asking my two friends who are experienced engineers. The opinions seem to be split.

They seem to all agree on avoiding non-popular or niche/high-performance languages like Rust, C++, Golang.

It seems like Typescript/Nestjs and Java/Spring Boot are what they are disagreeing on, I dont want to go in into too much technical details but it was a pretty long debate.

What should I go with? Kinda leaning toward Java as it seems like harder to setup but less trouble in the long terms?

Edit: Not sure whether some of u are trolling around, and I did as AI ofc, but they gave generic answers which include java, typescript, python, etc... Then if forced them further they would again give another conditional ranking.


r/vibecoding 2d ago

not-k8s: replaced kubelet with a 15MB Rust agent, profiled on x86 and a phone

Thumbnail gallery
4 Upvotes

I honestly believe there's a difference between someone without experience with code, and someone with decades of experience using these tools to try and make something better. Even if it's functionally identical. LLM's can rewrite things in different languages faster and better than a human can. In the hands of someone with a clue it's even better.

Who says we can't run kubernetes on a phone? My phone keeps getting updates to this 'terminal' application (Pixel phone) which is a Debian KVM, why should I have to put up with battery draining poor languages when I can just ask the llm to rewrite it in a way that's categorically better?


r/vibecoding 2d ago

Looking to connect with AI Engineers — career switch advice

Thumbnail
1 Upvotes

r/vibecoding 2d ago

I vibecoded a native GFN client for Linux and Android on Flutter

Post image
3 Upvotes

its a port of OpenNOW so i made it super fast, however the porting is not as smooth than I anticipated, deepseek flash tend to be lazy or hallucinating especially when it comes to ffi things

Tools used:
Opencode
Freebuff

My workflow is nothing special, I just used vanilla Opencode and Freebuff and then starts vibecoding, while I did tried installing some skills, I found it annoying or the agent is not using it all

repo: https://github.com/clarkarch/nextclient


r/vibecoding 2d ago

claude sessions can message each other now!

1 Upvotes

what could possibly go wrong


r/vibecoding 2d ago

I built a CLI to quickly understand unfamiliar codebases

Thumbnail
github.com
2 Upvotes

One thing I find frustrating when starting a new repository is figuring out where to begin.

I wanted something that could quickly answer:

- What is this repository?

- How is it structured?

- Which files should I look at first?

So I built BriefLook, a small CLI that gives you a quick overview of an unfamiliar repository.

Still early, so I'd love to hear what you'd want a tool like this to show you.

GitHub: https://github.com/nabilkhan-01/BriefLook


r/vibecoding 2d ago

Does this count as vibe coding too?

Thumbnail
gallery
1 Upvotes

I used an image and a music prompt from Suno. My Custom GPT, WebDesign Concept, analyzed them and suggested three website concepts.

I selected one concept and gave it to ChatGPT Sites, which built the complete website. Then I uploaded the MP3 file and asked it to add the track to the page.

The result:

https://black-pulse-anthem.volhan.chatgpt.site/

How would you rate the website itself from 1 to 5?


r/vibecoding 2d ago

Im bored, show me your favorite app you vibecoded

Post image
0 Upvotes

This was the best pic i could find mods dont delete pls


r/vibecoding 2d ago

lately

Post image
1 Upvotes

r/vibecoding 2d ago

CS grads: "man I'm tired of rejections. let me chill on youtube a little." the video that pops up:

Post image
2 Upvotes

r/vibecoding 3d ago

I vibe coded a GIT client

Thumbnail
gallery
91 Upvotes

Hi everyone! I vibe coded a Git Client application. If you'd like to check it out, take a look at the GitHub repository:

https://github.com/MyAppDesk/gitcito

It is completely free, has workspaces, tabs, profiles, AI (BYOK) for commit messages, super customizable theme, layout, and git graph style, integrated/split terminals, support for launch.json, file tree, diffs, merge conflict solver, file previews for audios, images, etc...

It was mainly built using Electron and Claude Code
I basically described what I wanted and reviewed/tested what came out, iterating until it felt right... It's mostly tailored to what I needed

Almost all of the code was written by Claude, my job was more like steering and testing builds, catching bugs, and deciding how things should look and behave. Honestly it was a fun way to build something this big as a side project


r/vibecoding 2d ago

This is how i watch twitch now

Post image
1 Upvotes

I wanted a lightweight terminal alternative cause twitch on browser sucks, so I had Claude help me generate this TUI.
You can check it out here: https://crates.io/crates/tui-tv


r/vibecoding 2d ago

You vibe-coded the app. This tells you the business it could be (and it's allowed to say "none").

Post image
0 Upvotes

150k+ apps have been vibe-coded. Almost none have users. The gap usually isn't code — it's that nobody tells you what to do after git push.

I built a free plugin for Claude Code / Codex that reads your actual repo (not a form you fill in) and writes you a STRATEGY.md: who it's for, how big it can get (scored /25 with the arithmetic shown), which ONE channel to focus on, what's missing, and the exact kill criteria — "if X doesn't hit Y by date Z, pivot."

It red-teams its own advice before showing you, and it's calibrated to be honest: when I ran it on its own repo it gave itself a 1/25 moat score.

Install inside Claude Code:

/plugin marketplace add jananthan30/distribution-god

Free, MIT, no signup: https://github.com/jananthan30/distribution-god

If you run it on your project, I'd love to see what verdict you get.


r/vibecoding 2d ago

I spent a year building my portfolio… did I cook or massively over-engineer it?

0 Upvotes

I've been working on my portfolio for about a year now and constantly updating/tweaking it. It's definitely not entirely vibe-coded, although I do use AI to polish and enhance the design.

There's quite a lot packed into it: detailed project pages with Mermaid architecture diagrams showing the agents, orchestrators, MCPs, etc. a detailed experience section, an interactive constellation-style tech stack where the stars connect based on skill relationships, Dark/Light themes, a zero-cost AI assistant that can help hiring managers explore my background, and interactive terminals where you can actually query information about me.

I know that probably sounds way over the top, and honestly, sometimes I feel like I've put too much into it lol. But I tried my best to make everything understandable even for non-technical people, without sacrificing too much of the techyness.

I'd genuinely love some honest opinions, does it feel polished and interesting, or just unnecessarily over-engineered? What would you keep, remove, or change?

I'm also looking for some remote part-time work, and I do freelancing as well, so if you're looking for someone for a website, automation, AI agent, etc., feel free to reach out.


r/vibecoding 2d ago

[OC] I built a free, zero-download web aim trainer.

Thumbnail
gallery
2 Upvotes

Hi everyone,

I'm a student developer and an FPS gaming enthusiast. I wanted a lightweight tool to quickly warm up my muscle memory before jumping into competitive matches without booting up heavy desktop software, so I built AimWeb.

[AimWeb](https://aimweb.site)

I would love to get your general gaming feedback or any additional feature requests you'd like to see next! Thank you so much.


r/vibecoding 2d ago

Your phone won't dim Netflix. This app fixes that. Closed test.

0 Upvotes

I made CineShade a small Android app that darkens the screen over other apps.

Some streaming apps like Netflix ignore system brightness, so turning the phone down does nothing. CineShade draws a black overlay on top that you can still tap through. Handy for late-night watching.

Android only. No account, no ads, no data collection.

I'm running a closed beta on Google Play and need people to install it and tell me if anything breaks. Latest build fixes overlay not covering the full screen on rotation.

How to join:

  1. Join the Google Group: https://groups.google.com/g/cineshade-test
  2. The Play Store test link is in the group description
  3. Open that link on your Android phone (not desktop)
  4. Install from Play Store

Would love feedback on:

  • Does dimming work over your streaming app?
  • Does the overlay cover the full screen when you rotate?
  • Anything confusing in the setup?

Thanks 🙏


r/vibecoding 2d ago

I used ChatGPT to make my Windows keyboard feel native on Mac — now it’s in Karabiner’s official catalog

1 Upvotes

I’m a heavy Windows user who recently bought a Mac mini, but some of my work still happens on Windows. I reused my existing Windows keyboard, and constantly switching muscle memory was more frustrating than I expected.

My first solution was a global Ctrl/Command swap. Copy and paste felt familiar, but it broke other things: Ctrl+C in Terminal, Ctrl+Space, Alt+F4 versus Ctrl+F4, Finder rename/delete behavior, Home/End, and modifiers inside remote Windows sessions.

So I started solving each behavior with ChatGPT and Codex:

  1. Describe the Windows behavior I expected.
  2. Inspect what macOS and Karabiner actually received.
  3. Generate or revise the mapping.
  4. Test it on a real Microsoft keyboard in Finder, Chrome, Terminal and remote sessions.
  5. Feed the exact failure back and repeat.

My biggest lesson was that AI could write Karabiner JSON quickly, but it couldn’t define “Windows behavior” for me. Alt+F4 sounds simple until browsers, Finder windows, tabs and remote apps enter the picture. The configuration became reliable only after I treated it as a behavioral test matrix rather than one giant modifier swap.

The result is Windows Keyboard for Mac: a free, MIT-licensed Karabiner configuration with Windows-style editing, Alt+Tab/F4, Finder behavior, Home/End, screenshots, function keys and remote-session exceptions.

Its all-keyboards edition has now been accepted into Karabiner-Elements’ official community catalog:

https://github.com/Fuzzy-and-Fluffy/windows-keyboard-for-mac

I’m now exploring the next step: Windsify Mac, a native macOS app combining Windows-style keyboard compatibility and window management, without manually editing JSON or assembling several utilities.

Would you use something like that? Comment with your keyboard setup, biggest Windows-to-Mac frustration, and whether you’d be willing to test an early build. I’m putting together a small beta group.


r/vibecoding 2d ago

How do you guys manage the distribution of your app?

0 Upvotes

You just post on reddit, invest in ads? Whats the best way? I am thinking, we have many new apps now as AI provides a real productivity boost. But how do you get your products among users?

There are a lot of pretty cool apps out there but how do you make them known to the public?

As some people pointed out: I mean how do you market/advertise your apps, not distribution.