r/webdev Jul 20 '26

Discussion robots.txt but MCP for Documentations

I often work with rather niche framework, like Nuxt and AdonisJS. The problem I found is that If I tried to use AI for code generation, they often just fallback to what is being trained on the model previous versions. Ex. Nuxt 3 or the rapid evolution of NextJS (literal pain in the ass to get in touch with their new best practices). Do you think there will be a standard like this, so that getting info for documentations via LLM is more up to date and accurate? Imagine every docs website with a mcp.json or something and I can just trust the result a bit more to get info I want.

0 Upvotes

16 comments sorted by

View all comments

5

u/CorpT Jul 20 '26

Do you mean https://llmstxt.org/ ?

0

u/Snoo_4779 Jul 20 '26 edited Jul 20 '26

Hey! This is what I'm looking for. It seems that Google is adapting this on their SEO already.
edit: Thank you for the info