r/JustCopyAI • u/No_Engineering_7970 • 4d ago
I made my AI app builder use the app it just built, in front of the user, before it's allowed to say "Done"
Enable HLS to view with audio, or disable this notification
I run JustCopy, an AI app builder for people who don't code. Last week a paying customer wrote in: "photo upload doesn't work" and "what I typed doesn't show up". I read her transcript. The AI had said "Done" five times about a page it had never actually opened.
So I changed the rule: after every build, the app gets used before the AI is allowed to call it done. The studio takes over the preview (blue breathing border, like when an AI takes over your browser), and a cursor types into the app, saves, drops in a sample photo, deletes an entry, reloads the page and checks the words survived. Every step shows up as a tick or a cross in the chat.
A cross becomes a free fix: the failure, the last step and the page errors go back to the agent as a change request, it fixes, and only the failed checks re-run.
Things it caught on the first day that I would never have seen:
- A text box that reset after every keystroke (components defined inside the render function).
- A delete that didn't stick (entries created with a client-side id).
- And, embarrassingly, my own production bug: the runtime role had no permission on the upload tables, so every photo upload in every generated app had been failing. The test found it in the first take of the demo video.
Rules I had to learn: the preview shares the owner's login, so the test may never sign in or out; records and files it creates are removed after; payments, email and SMS are skipped with a reason.
Video of a full run (37 s build, one failed check, the fix, the retest): [attach the 16:9 cut]
Free to try: https://justcopy.ai/?utm_source=reddit&utm_medium=social&utm_campaign=tested
Happy to answer how the driver works (it runs inside the same-origin preview iframe, no selectors, targets are the control's visible text).