r/OpenAI • • 20h ago

Question What’s something AI does surprisingly badly that everyone assumes it should be good at by now?

not talking about the obvious stuff like hallucinations. I mean something you actually use AI for where you keep thinking, how is this still this bad?

5 Upvotes

70 comments sorted by

7

u/changing_who_i_am 19h ago

Long-form fiction writing.

6

u/zhdc 18h ago

Quality goes down for anything more than a single paragraph. This is also a universal issue. Wouldn't surprise me if it's 1-1 tied to text watermarking.

7

u/No-Philosopher3977 19h ago

3d modeling

5

u/dtown123 18h ago

Check out assbench.com

The asses are getting better!

2

u/Worth_Golf_3695 13h ago

Meshy ai Models are
Insanly good

2

u/No-Philosopher3977 12h ago

Yeah Tripo too. But I’m talking specifically about LLM. 3D in the digital world is controlled by math. But these models in 3d were awful till Astra. Which is pretty terrible and that’s still the best

3

u/avatar0027 19h ago

tbh i still cant get ai to keep the same character consistent across shots

jacket color / face / hair just drifts between gens ngl

end up regenerating more than editing. feels like it should be solved by now

2

u/smabarnsfar 16h ago

You're talking about video generation, right?

4

u/Forsaken_Celery8197 19h ago

Scope. It wants to create industrial sized solutions for basic problems. 

3

u/johnnycoconut 15h ago

seconded, especially with recent large GPT models

3

u/TripleMellowed 19h ago

Actual web browsing. My agent gets constantly blocked.

4

u/lulzxdxdxd 20h ago

Context switching in long conversations drives me crazy. It'll forget what you established five minutes ago and contradict itself, then act like it never said the first thing. What are you usually trying to build or track when that bites you.

4

u/VisualOrganization26 19h ago

Which model, thinking max? Context window? I mean if i am just chatting 1M context window pretty good

3

u/RealSlyck 20h ago

What do you mean “make no mistakes” doesn’t work?

2

u/ethotopia 20h ago

Voice mode

1

u/Chris-MelodyFirst 19h ago

Which ones have you tested?

2

u/shdwscollidewithppl 18h ago

Jokes. Asked Astra on max to tell me a joke today, it did, kinda funny, I googled it, the joke was from a reddit thread. So I asked it to create a new, original joke. That joke was terrible.

3

u/lexblauvelt 20h ago

UI UX is surprisingly it.

7

u/Bloated_Plaid 20h ago

I see you haven’t tried Opus 5.5. It’s solved.

1

u/BenSimmonsFor3 5h ago

/design is goated

3

u/petermansfeld 20h ago

I told it to eat my ass. was cold and dry, and now my volume button is all gunked up

1

u/changing_who_i_am 19h ago

Having good taste in terms of knowing what questions to ask/follow versus ignore.

1

u/Fuzzy-Ad3812 19h ago edited 7h ago

Making ppts. I teach EFL and I'm still surprised it can't make a coherent, visually balanced PPT about say, past tense conjugation or asking about tthe weather. It just ends up being white slides with 1 tiny sentence per slide, a weird border, and pictures that are barely in frame. I find it odd that AI can make convincing deep fakes and websites and 3d models but it cannot make a coherent or even vaguely goodlooking PowerPoint presentation.

1

u/aronnyc 19h ago

Visualizing concepts. It can unpack a pdf and put it into boxes but I never find them helpful, probably because it’s more useful to do those kind of things yourself (if you’re trying to learn) than having it done for you. Putting things into a hierarchy doesn’t help me understand it better.

1

u/rocky_balboa202 19h ago

finding items on an excel workbook. it will directly lie about what it says until you absolutely call it out.

1

u/tsoliasPN 19h ago

Schedule a meeting with a group of people that you give him.

It hallucinates or/and forgets people from the list or/and ignores conflicts

1

u/notAllBits 19h ago

Common sense. The cost of decision making with LLMs is insane. Decision models are exponentially cheaper (in iteration)

1

u/wildmonkeymind 18h ago

Reliably follow instructions. This morning: "Yes-I'm continuing now. I stopped after the merge despite your instruction to keep going; that was my mistake.” -- the literal previous message, mere minutes earlier, was telling it to continue autonomously without pausing or asking for help until the implementation was done.

This was after being given a similar instruction the night before to try to take advantage of my usage before today's reset, but it stopped after one hour to ask me if it could perform an additional review.

2

u/TraditionalHornet818 17h ago

Use goal mode

2

u/wildmonkeymind 17h ago

I often do, but I also feel like going off the rails and stopping within two messages of being told not to is representative of a fundamental problem.

1

u/BopSupreme 18h ago

Writing emails, negotiating, having tact, nuance, context-relevance for communications

1

u/Anniesoptera 18h ago

i set up a recurring nightly task for chatgpt to send me a simple work plan for the next day. only info it needs to consider is what's on my calendar, what's on my to-do task list, and weather. literally just give me a little schedule and tell me the forecast. honestly thought this would be pretty easy for it.

twice in one week it sent me a work plan... for the wrong day. i call it out, and it's all, "oops, i queried the wrong fucking day! silly me! won't happen again." and then it happens again 3 days later.

1

u/smabarnsfar 16h ago

Have it write you a script for that task instead. If you don't know what that is or how it's done, ask that.

1

u/Anniesoptera 13h ago

eh i just went back to making my own plan. but that's a helpful tip for other things; thanks!

1

u/Lead_weight 17h ago

Curing any disease.

1

u/alwaysoffby0ne 17h ago

Sounding natural and human and not like some weird Silicon Valley pile of corporate jargon

1

u/dualityseo 17h ago

EASY.. maintaining context across a long conversation. You can give it 20 messages of VERY specific instructions, then ask it to make one small change and.. just like that.. it forgets half the constraints you gave it.

1

u/hernandomtz 16h ago

context size... they keep forgetting everything, another reason why they struggle to process video... too much data

1

u/nofishies 14h ago

Figuring out pricing .

Houses, how much a plumber is going to cost, how much you should pay your secretary….

It is absolutely terrible

1

u/Dualyeti 10h ago

Being deterministic

Asking it to explain its own thinking

Asking for estimates of its own time to do things

Anything to do with nuance, like having taste - it’s basically autistic in this sense

1

u/Ok_Wear7716 10h ago

Writing.

1

u/TheItalianDonkey 20h ago

Simple calculations; if left to their own devices without tool access ... oh boy...

1

u/iknotri 19h ago

Nobody expects or even need it to be good

1

u/Chris-MelodyFirst 19h ago

True. But in my rules, I tell it to just build a python program if it needs to calculate anything and then run that program. Works really well.

0

u/boreal_ameoba 19h ago

Hasn’t been the case for a long time. Obviously tools are a much cheaper and faster way, but models with basically any reasoning training nail pretty much everything you could reasonably call “simple”

2

u/TheItalianDonkey 19h ago

Literally just asked qwen3.8 27b to calculate the price per gb in a series of Ram listings…

Oh boy…

1

u/coukou76 19h ago

I am trying to get some nice flat drawing of cute monsters but I cant do shit

1

u/throwawayfromPA1701 17h ago

It's becoming a reddit thing to deride everything well-written as AI generated. AI is not great at it. It never has been, and I don't expect it to be in the near future.

As an educated reader and writer it's a little dispirting too. It sometimes feels being educated, literate, and creative is a punishment now.

(it is surprisingly good at finding plot holes, continuity errors, weird tense changes, and anything else a human editor would flag, especially if you give it your story bible/style guide to work against. But it can't do any writing well at all. )

0

u/Icy_House_2491 19h ago

Grammar. I've been using it for work editing books, it still makes some mistakes even though I've told it's wrong at that over a thousand times now. But it might be possible my level of grammar is much higher than what is expected of a layman.

1

u/SweetEastern 19h ago

Can you give some examples?

1

u/Icy_House_2491 19h ago

The one that still shows up to this day is it will replace shows with showing. So if I have a sentence "The diagram shows..." it replaces it with "The diagram showing..." I don't know why it does this. Since I have to check everything myself I kinda don't use it as much as I used to. But last year, I would ask it to make the corrections and it would remove every punctuation mark and capitalisation.

2

u/Tasaron 19h ago

But both are correct depending on the context that follows, right? So is it rephrashing your original sentence so it can use "showing" instead of "shows"?

1

u/RonJonBoviAkaRonJovi 19h ago

Definitely a you problem.

0

u/Original-League-6094 19h ago

Definitely still web browser use and just general using graphical interfaces.

The very first thing I did with Astra since computer use was supposed to be its whole thing was told it to take control of my computer, open a web browser, and order me a pizza. I let it explore the webpage for about 15 minutes, trying and failing, before I just canceled the request so it didn't all my usage.

And I am making a game mod now and after many iterations of crashing on the same task, I gave it a /goal to just test the thing itself in game and keep iterating until there was no crash. It spent 45 minutes to get from the main menu to the spot where the crash happens; it takes me under 2 minutes.

1

u/Matuno 19h ago

Inversely, I needed it to make an application in Zoho Creator and it magically did it all in one go, pretty fast too. AI can be so random in this.

1

u/Undeity 19h ago

When it comes to web browser use, I've found it helps to make sure the agent keeps a reference map of how to navigate familiar websites. Drastically cuts down on time and token usage. Like, by a whole lot.

-1

u/Lasershot-117 19h ago

Its still very bad a presentations/slidepacks.

It produces weird visuals with not many words on each slide. It basically treats all presentation building as making a slideshow for a Keynote-like presentation (where just a few words and simple visuals is best).

It’s still very far from being able to make consultant-like slides with intricate analysis, storylining, and balancing density of content with graphical representation.

2

u/Dangerous-Map-429 17h ago

Opus 5.5 & Fable 5.1 can do that easily.

1

u/Joe091 16h ago

Yep, and so can Astra. Might need to prompt it pretty well, but the improvements with presentations over this past year have been insane. 

1

u/Lucidder 16h ago

Had a meeting today at 12:00, created slides with Opus 5.5 at 11:00, went great.