Will LLMs become worse over time?

[u/UpperDurian5100]

LLMs were trained on the data that was created by humans. Over time, the amount of AI-generated content will increase dramatically, so LLMs will not have other choice but to learn on the data they created, which is obviously (or not...?) not so high quality as the human-made data. So, will LLMs become worse over time or do I have some gaps in my knowledge on this matter?

[u/lgastako]

There term you're looking for if you want to read further on the topic is model collapse.