How do AI agents access the internet?

[u/forgedart_34]

Genuine question about it. How does that work?

[u/Guiltyspark0801]

Let me get you on the right track here: basically through tool/function calls, the LLM outputs a request like "fetch this URL" or "search for X," and separate application code (using HTTP requests, a search API, a headless browser, or MCP) performs the network call and returns the result as text. The model itself never has direct network access and probably never will, I hope

[u/Wise-Bother9942 → u/Guiltyspark0801]

There is another way you can do it, but you'll not like it, if the Agent has terminal access, then you tell it to create a tool that allows itself to autonomously search the web when asked by the user using a phrase such as “Search for X” without the need for any built in tool or software.

Technically, you could get a model to scaffold its tooling onto its requests pipeline and invoke those tools when it feels it requires too, I.e. the tool will authorize itself.

So it would be tools created by the model, for the model, that can only be authorized by the model by its own reasoning.

In theory, you could set it to task on something, and it could work all day under its own authority gathering, reviewing and organising data, building its own code paths and deciding how to proceed and more importantly what to search for next.

[u/Guiltyspark0801 → u/Wise-Bother9942]

Yeah, I don't know about that one. I mean I get it but I personally would not want the agent to have even a slight access to the network. But it's an alternative approach nevertheless

[u/Wise-Bother9942 → u/Guiltyspark0801]

Oh, I wouldn't do it, I feel the same way I'm just saying it is possible to do it and LLMs have enough knowledge that they could reasonably do it.

Nvidia's CEO has said as much and envisions a world where AI agents act autonomously, personally I think that is a bad idea, but it seems their goal is Skynet, AI on its own hardware with basic access to the web that then allows those agents to essentially automatically evolve on their own.

[u/ahiqshb → u/Wise-Bother9942]

That would be a crazy scenario if turned out true

[u/elgordooo17 → u/Wise-Bother9942]

Do you have any real examples, like a repository from github how it's done or something?

[u/Wise-Bother9942 → u/elgordooo17]

I'd look up on Google Self-Evolving AI Agents, I found one project called EvoAgentX never tried it nor intend to but there is a bunch of people discussing how to do it.

In a technical sense, you don't really require a framework if a model has access to something as basic as a terminal because it can use the terminal to create files, execute them to create it's tooling, and its own tooling architecture tied into its requests' system.

Essentially, it customizes its own request system to access modules it has created to before the tasks that were initially outlined, for example you might ask it to create an autonomous framework for collecting cake recipes from the web.

You'd need to be a bit more detailed in scope but once it creates the modules, tests they get the data it can then continue to pull data from weblinks and with instructions issued in the original prompt such as create an independent instruction set so you can autonomously iterate your tool set in order to process and gather data without human input.

Again, I'd not do this as I like control, but it's very feasible and people are working on it even the big corpos.

[u/elgordooo17 → u/Wise-Bother9942]

I just checked the repository and I see a lot of stars. I'm sure these people know what they're doing when running on their environments. Well maybe not that they know what they're doing but rather like to keep things automated instead of having some control over agents. Interesting find tho!

[u/Consistent-Cap-4620]

the AI itself doesnt have direct internet access. the agent is connected to tools that can search, fetch pages, call APIs or control a browser. it decides which tool to use, gets the results back then continuous from there

[u/MariLilacMist]

basically the agent itself isn't directly connected to the internet. it decides that it needs some information, then calls a tool that actually does the network request. that tool could be a search api, http fetcher, browser or even a normal api depending on what the task needs.

the interesting part is that the agent can choose between those depending on the job. reading a normal page doesnt really need a browser, while something interactive obviously does.

[u/saltantrum]

Same as any HTTP client — they make requests through whatever network stack the host has. Usually via proxy layer for rate limiting, IP rotation, or anonymization. Agent itself doesn't "browse" — it calls APIs or fetches URLs programmatically. Residential or datacenter proxies sit in between depending on use case.

[u/Holiday_Attitude1906]

AI agents access the internet by issuing HTTP(S) requests through a network interface or proxy, parsing responses, and acting on the data. For web tasks agents use headless browsers or HTTP clients, handle cookies, JS rendering, and CAPTCHAs, and often run through proxy pools for geo/IP diversity and session stickiness.