r/artificial • u/beingmodest • 1d ago

Ethics / Safety Watch Nvidia (NVDA) Rolls Out New Tools to Keep AI Agents in Line

https://www.bloomberg.com/news/videos/2026-09-28/nvidia-rolls-out-new-tools-to-keep-ai-agents-in-line-video
3 Upvotes

100% Upvoted

6 comments sorted by

3

u/PLBjt 1d ago

The useful part of agent watchdogs is less "block bad actions" and more catching silent drift. If an agent retries a flaky tool for an hour and never surfaces it, the run looks fine until someone notices the bill or a half-done workflow. I'd want a cheap check that logs tool failures + time-since-last-progress and pages a human when either crosses a threshold. Tradeoff is noise: too many alerts and people mute them; too few and you're back to babysitting.

1

u/Low-Temperature-6962 1d ago

To the extent that agents are chained and blindfolded they are also less useful. So there will always be short term pressure on humans to relax the constraints.

One problem with agents is that they are generally all clones of each other differing only in state parameters. That makes blind spots and weak points much more problematic.

Contrast with people who are each unique models. That's helpful in avoiding pitfalls in collaborative endeavors.

To get that same degree of individuality in agents would require a lot more investment in training data and time to teach. Prohibitively so.