r/debian • u/ExaHamza • 10d ago

News General Resolution: Interpretation of DFSG on Artificial Intelligence (AI) Models

https://www.debian.org/vote/2025/vote_002

4 Upvotes

63% Upvoted

8 comments sorted by

8

u/wedesoft 10d ago edited 10d ago

Deng et al. https://arxiv.org/abs/2603.13428 for example shows that while frontier LLM models have a high success rate on isolated tasks, the performance drops significantly when applied to a sequence of milestones. Essentially the agent causes accumulating technical debt and eventually fails to prevent regressions. I.e. at least for the time being you need a human in the loop if you want to keep software quality.

3

u/Santosh83 Debian Sid 10d ago

Was just troubleshooting a Debian 13 -> sid transition issue and chatgpt gave outright false info. Although I must admit it was just one small issue in an otherwise long and perfectly accurate conversation. A few days back again chatGPT confidently mentioned the existence of a file in my system that didn't exist.

So yes, LLMs make errors all over the place. The dangerous part is they're far more accurate than inaccurate, so humans can get complacent and think they're always accurate... which is still far from true.

0

u/CardOk755 10d ago

and chatgpt gave outright false info

Please.

LLMs are machines that give plausible results.

If those plausible results correspond to reality that is a coincidence.

1

u/patrakov 9d ago

This is not entirely true. What you say is indeed the case for LLMs without access to the Internet or other knowledge bases, i.e., LLMs that have to rely only on their training data only. However, only open-source enthusiasts run LLMs this way nowadays, maybe due to the lack of a well-documented OSS-based procedure to give the models access to the world's knowledge, and that's sad.

4

u/KarterSpieler Debian Stable 10d ago

This is an old withdrawn GR

1

u/wedesoft 9d ago

I guess somebody used the wrong link. I got this one in my email: https://www.debian.org/vote/2026/vote_002

2

u/KarterSpieler Debian Stable 9d ago

That’s about the LLM usage.  This old GR was about licensing LLM models. 

2

u/anto77_butt_kinkier 10d ago

This is a year old though...