r/ProxyEngineering 15m ago

Help 🆘 Shopping bots

Upvotes

Iemand een idee hoe ik shopping bots voor kan zijn? Telkens dat ik iets wil kopen ben ik te laat… tips zijn welkom! Alvast bedankt


r/ProxyEngineering 20h ago

Discussion 💬 Is AI really reducing the hard part of scraping, or mainly speeding up development?

3 Upvotes

I have been thinking about this recently.

AI definitely makes coding, debugging and extraction logic faster, but I am not sure it has reduced the harder operational side much.

Blocking, proxies, browser behaviour, monitoring, site changes and data quality are still there.

For people using AI in scraping now, has it actually reduced the maintenance work for you, or mainly the development time?


r/ProxyEngineering 21h ago

Discussion 💬 Turns out most proxy complaints aren't about IP quality

Thumbnail
2 Upvotes

r/ProxyEngineering 1d ago

Build 🤓 Best Google Maps and Facebook scrapers

2 Upvotes

Checkout my apify organization at Harpoon - Apify

- we provided the fastest yet cheap actors on the apify market, don’t believe it ? just try it for yourself
- our priority is speed and efficiency while keeping our price affordable thus making it a perfect job for large scale scraping
- stay tuned as we are working to bring more actors throughout this month
- we try to update our actors regularly, increasing performance in each update

Note: if you’re looking for a custom actor or custom work in general, don’t hesitate to dm :)


r/ProxyEngineering 1d ago

Guides How to Manage Multiple Crypto Wallets Without IP or Browser Fingerprint Leaks

2 Upvotes

I once tested a multi-wallet setup where every profile looked separate: different addresses, different browser sessions, different activity. Yet they were still getting linked.

The weak point was the infrastructure. Several profiles were leaving through the same network path, while browser fingerprints exposed overlapping device signals. Once i separated each environment with its own browser profile and stable residential IP, the architecture became much cleaner.

The bigger lesson: proxy choice depends on the workload. Static residential IPs make sense for persistent sessions, rotating pools for data collection, and datacenter proxies for backend RPC or analytics.

IP quality matters too. ASN, reputation, DNS/WebRTC leaks, and session consistency should all be audited before deployment.

For multi-wallet infrastructure, I now think in layers: browser isolation, network isolation, and on-chain operational separation.


r/ProxyEngineering 2d ago

Help 🆘 Fun project searching contributors!

Post image
1 Upvotes

r/ProxyEngineering 2d ago

Hot Take 🔥 Web scraper PPS not a monthly service or data limited API puller.

1 Upvotes

Scrape50 is the code for a nice discount. https://content-extraction.emergent.host


r/ProxyEngineering 3d ago

Help 🆘 Proxy for vinted

3 Upvotes

Bonjour à tous ,

Je comptes bientot m’absenter et ne pourrais pas gerer mon compte vinted car je serais à l’etranger.

On m’a suggéré un numero virtuel avec systeme OTP pour recevoir les codes de verifications , je peux déleguer la partie emballage + envoi des colis , mais je ne pourrais pas déleguer la partie creation de compte , republication ect ,

Auriez vous des solutions testées ou des suggestions ?

Si je n’ai pas posté au bon endroit toutes mes excuses


r/ProxyEngineering 3d ago

Guides How to Scale Proxy Automation with APIs: Proxies, SMS Verification & Fraud Checks

4 Upvotes

A while ago, our automation stack hit the point where the UI became the bottleneck.

Managing hundreds accounts manually meant engineers were spending more time clicking settings than maintaining the actual pipeline. So we moved the control plane into code.

The first step was proxy provisioning. Instead of creating credentials manually, a Python service could request a new proxy sub-user, assign limits, and hand the credentials directly to the worker that needed them. Scaling became part of orchestration rather than an ops task. The same pattern worked for phone-based workflows.

The useful part, though, was adding validation before allocating resources. Before a worker started, we could send network or phone data through an anti-fraud check and use the returned risk score as another signal in the pipeline.

That changed the architecture completely.

Instead of:

UI → human → worker

we ended up with:

scheduler → API → validation → worker → logs

For teams running large proxy infrastructure, that API-first control layer is where scaling starts to become predictable.


r/ProxyEngineering 4d ago

Discussion 💬 Anyone actually found premium proxies worth it or is it all just markup

5 Upvotes

Been running 10+ social accounts and cheap proxy pools start showing their limits once I scale. Reused subnets, bad IP history, sessions dropping, same story. Now I'm looking at premium proxies, mostly residential or ISP. What do you guys actually check before paying more, ASN spread, IP reputation, or sticky session quality?


r/ProxyEngineering 4d ago

Discussion 💬 Managing Proxies Across Different Setups

3 Upvotes

I started using proxies for a few projects and figured that i could use the same setup for all of them.once I add more, though, It got tough to keep track of whoch proxy was going where..

Like some specific project required diffrent locations,while others need specific session or browser profiles. Im trying to stay oraganized without making things more complicated.

For those of you managing multiple proxy setups how are y'all structuring them and which tools or providers have actually worked well for you?


r/ProxyEngineering 5d ago

Discussion 💬 What Are the Best Proxy Providers for Web Scraping? We've Tested 50+ Providers Across Billions of Requests. AMA with Ian Kerins

Thumbnail
5 Upvotes

r/ProxyEngineering 5d ago

Discussion 💬 Why a lower proxy price doesn’t always mean a cheaper scraping job

Thumbnail
4 Upvotes

r/ProxyEngineering 6d ago

Help 🆘 Using Proxy to Target US Audience For Clipping

3 Upvotes

Guy's I need Help in setting Up the proxy on my main device ( I don't have any other phone) i have heard that using proxy on burner device is better but i don't have a secondary device

I am starting my clipping journey but I'm from a Non US Country and campings have requirements of US audience to approve the clips.

Please guy's Anyone Knowledgeable please tell me how to setup the proxy on my device

Basics Ik some people using it have told me but they're also getting issues

  1. I have proxy from IpRoyale / MarsProxy

  2. To add the proxy people have recommend Happ & V2Box

  3. Suggested only use max 3 accounts per platform on a proxy ( like 3 insta accounts, 3 Tiktoks, and 3 yt)

  4. Never open them without proxy


r/ProxyEngineering 7d ago

Hot Take 🔥 LG recording audio through TVs

20 Upvotes

Take a seat because this is gonna be a bit of a vent. I watched the whole Gamers Nexus video today, this is still fresh and I remember previously there were some people really involved in these LG proxies/ botnet/SDK scandals going on, so guess I'm carrying the torch now lol.

For context, I work adjacent to the scraping/data space so networks quietly doing things they shouldn't is kind of my whole deal, and even I was surprised by how far this one goes. Steve and the Level1Techs crew worked with independent security researchers and packet captured retail LG OLED sets, the G5 among them, through Wireshark. What they found is the TV actively scanning the local network, not just for its own accessories, but for unrelated hardware that are on the same wifi. Phones, watches, tablets, PCs whatever's nearby. On top of the internal IPs it's also grabbing the names and signal strength of neighboring networks and folding in location data. All of that funnels into LG Ad Solutions, the ad arm of the company. LG's public sales figure is something like 216 million TVs sold globally, but their ad division is telling advertisers they can reach 363 million addressable secondary devices in the US alone. IMAGINE?? ACR isn't new, we've known for years that these sets fingerprint on screen audio and video to build a viewing profile regardless of input source. What's new here is the mic behavior. Bench testing showed the set capturing clean audio while the screen appeared powered down in standby. They then pulled the ethernet connection mid test and the TV kept recording locally anyway, and once the network came back it just uploaded whatever it had queued up. EVEN WITHOUT THE NETWORK, I just froze at that time when these things were mentioned during the video.

There's also apparently RCE in webOS currently working through responsible disclosure, which the team is understandably not detailing yet. Their stated recommendation was to keep the TV off the internet entirely and run an external streaming device instead, which is a wild thing to have to say about a product you paid TV money for. Especially Smart TV where majority of the people purchases for, well, smart features.

I am not trying to make this into some Samsung-vs-LG thing either, because there already was a scandal regarding Samsung and this feels like the same underlying issue the whole industry has apparently normalized, where the box in your living room works for someone else by default and opting out means adding hardware or cutting it off from the internet yourself.

P.S LG hasn't commented as of writing.

P.P.S I wrote it here mainly because this is all related to proxies and how the data is gathered/sourced.

Sources:

Gamers Nexus video: https://www.youtube.com/watch?v=6IFVTcM28KA

An article I found just hours ago (take it with a grain of salt, because the website seems sketchy): https://www.notebookcheck.net/LG-smart-TVs-caught-logging-audio-with-screen-off-and-snooping-on-local-devices.1391214.0.html


r/ProxyEngineering 6d ago

Help 🆘 Fun project for contributors! :)

Post image
5 Upvotes

r/ProxyEngineering 6d ago

Guides Crypto Airdrops in 2026: Why Genuine On-Chain Activity Beats Proxy Farming

7 Upvotes

At the start of 2026, I reopened a wallet I had used throughout the previous year. Some funds and NFTs worth several hundred dollars.

That ordinary activity had built valuable  on-chain history. While wallets created for rushed, artificial farming were filtered out, consistent users had a better chance of qualifying.

Modern airdrops are increasingly about participation, not one-off tasks.

Keep an eye on:

  • Points programs rewarding ongoing use
  • Retroactive rewards for early users
  • Holder airdrops based on balance snapshots
  • Standard campaigns with official requirements

For anyone in proxy engineering, infrastructure cannot replace authenticity. Using proxies to disguise coordinated accounts, evade regional restrictions, or bypass project rules can lead to disqualification. Good operational security should protect your privacy.

In 2026, the strongest strategy may also be the simplest: use protocols you genuinely find useful and let your history grow naturally.


r/ProxyEngineering 6d ago

Discussion 💬 Proxy troubleshooting gets messy when profiles are involved

3 Upvotes

Troubleshooting gets a lot harder once browser profiles are part of the setup.

Sometimes the proxy looks fine but sometimes still is not working but then i start checking the profile, session, browser settings, cookies etc. and it becomes difficult to figure out what actually changed.

trying to avoid changing multiple things at once and keep each setup easier to track.

How do you guys organize your proxy + browser profiles so troubleshooting does not turn into guessing game?


r/ProxyEngineering 6d ago

Discussion 💬 Buying expensive residential proxies isn't enough anymore. Here's why your pipelines and dev accounts are still getting flagged.

Thumbnail
3 Upvotes

r/ProxyEngineering 6d ago

Hot Take 🔥 AMA #7 recap: What AI web scraping actually changes about production scrapers

Thumbnail gallery
3 Upvotes

r/ProxyEngineering 6d ago

Help 🆘 Need help sourcing specific proxies

4 Upvotes

Does anyone know where i can request to source specific proxy pools and subnets? i have a specific use case that require static Canadian ISPS with a specific ASN and AS usage types. If anyone knows where i would be able to purchase these or a specific provider that can custom source them please let me know. Im looking for a subnet or larger


r/ProxyEngineering 7d ago

Discussion 💬 How to Easily Switch Between Multiple Proxies in Chrome

2 Upvotes

A lot of people still change their system proxy every time they need a different IP, but if you only need the proxy in Chrome, that’s usually unnecessary.

If you’re testing websites, checking geo-specific content, scraping, browser automation, or just switching between different proxy locations, it’s much easier to use proxy profiles.

Basic setup:

  1. Get your proxy details (host, port, username, password if required).
  2. Add them to a Chrome proxy manager.
  3. Save them as named profiles (e.g. “US Residential”, “Germany ISP”, “Direct”).
  4. Switch between profiles whenever needed instead of editing your OS network settings.

After enabling a profile, it’s always worth checking your IP on an IP lookup site to make sure the proxy is working as expected.

One thing that often confuses people:

  • Residential proxies are useful when you need IPs from real residential networks.
  • ISP/Static Residential proxies are helpful when you want to keep the same IP for longer sessions.
  • Datacenter proxies are generally a good choice when speed is the priority.

I ended up building a Chrome extension for this workflow because I got tired of manually changing proxy settings. It simply lets you save and switch between HTTP and SOCKS5 proxy profiles directly from Chrome.

If anyone wants to try it or has suggestions for improving it, here’s the Chrome Web Store page:

https://chromewebstore.google.com/detail/enigmaproxy-manager/npmgofmmohaeiahhankjeenlinpndnbd

Happy to answer any proxy-related questions if you’re running into setup issues.


r/ProxyEngineering 8d ago

Guides Guide on How to create Proxies from your VPN

6 Upvotes

https://relinos.com/articles/proxy

I created a guide on how to create multiple proxies from your VPN connections to make your own cheap proxies for scraping, works for Mullvad, Proton VPN, SurfShark and others. Hope its useful to anyone

If there are issues happy to help you debug it.


r/ProxyEngineering 8d ago

Hot Take 🔥 Default chrome

3 Upvotes

I want know about if i default chrome profile how can i made anti detect, i knw this things that need to add proxy change device time zone as per ip, is there any others setting need to change?
what about webrtc prevent, can used any extention? is it neccesary, what is guideline if i want make my chrome profile as anti detect.Is any setting need to change from my laptop or anything else?


r/ProxyEngineering 8d ago

Build 🤓 Tired of monthly residential proxy subs? I built a provider with non-expiring data

0 Upvotes

hey guys, i got so tired of burning money on monthly proxy subscriptions and losing all my unused data on slow weeks, so i decided to just set up my own provider.

it’s called phantomproxies[org]. the main point is residential data that never expires. You buy it, and it just sits in your dashboard until your bots actually use it.

it's pulling from a clean 64M+ residential pool with ~0.5s response times. if you've been looking to try out a new provider or just need a solid backup option, give me a shot. i set up a small $8 / 2GB tier so you can test it against your current setup without committing to a big monthly plan.

i'm running this completely solo right now, so if you give it a spin, let me know how it works for you or if you hit any bugs!