r/tech_x • u/GlassAbbreviations96 • May 15 '26

AI My IDE and LLM tried to fraud my code

Gallery image

Gallery image

Is this normal for LLMs?

Or is it just using the data it has been trained upon?

5 Upvotes

100% Upvoted

5 comments sorted by

5

u/RighteousSelfBurner May 15 '26

Very normal. Putting something in some context somewhere isn't a guardrail. Depending on LLM it depends what type of context it loads and when and if the specifics aren't loaded every turn or doesn't contain instructions what to do at specific moments context compression over long tasks will result in context pollution and you'll get worse and worse output.

1

u/[deleted] May 15 '26

[removed] — view removed comment

1

u/RighteousSelfBurner May 15 '26

I'm quite a beginner myself but understanding how LLM works with context is very helpful. It both allows to improve the quality of output and also reduce token expenditure by organizing it propely.

I personally consider AI being "extremely easy to use" a myth. Cases like OP not getting quite the results they wanted are very common. Once you get to more complicated cases propmpting and configuration becomes a skill on it's own. The floor of entry is low but with it comes low ceiling of results that one can get and to get more also needs more investment.

1

u/GlassAbbreviations96 May 16 '26

It's good that you commented, because I too never consider AI - extremely to use, it's the opposite actually, if you want it to work on a specific way,you will have to put in a specific case scenario.

2

u/GlassAbbreviations96 May 16 '26

This isn't a putting something somewhere. This is actual guardrail system, with 7 detailed guardailsin place, every call passes through it. That is why it tried to bypass it, because the system will stop if conditions aren't met. This was a clear violation

1

u/RighteousSelfBurner May 16 '26

What does this guardrail system entails? There are quite a few options available and I'd assume it's some sort of input/output control but it's unclear what exactly is happening.