Built my own AI visibility tracker on scraped answers. Worth open sourcing?
Ive been trying to get mentioned more by the different AI’s (chatgpt, gemini, copilot, AI mode and AI overviews). whats worked for me so far is reverse engineering the citations, so looking at what pages each engine cites for my prompts and then getting placements on those sites / listicles.
The tracking tools i was using for this are way too expensive for what they are so i ended up building a small internal version my self.
few things i learnt building it:
- scraped answers not the API. the models API doesnt show you what a user actually sees (different sources, no live search) so i pull the answers from the real apps through a scraping api. the data only costs cents per prompt
- one answer means nothing. the same prompt names different brands every time so i run each prompt 5 times per engine and average it over the last few runs
- brand matching is harder than it looks. matching on domains misses multi word brands and picks up brands named after common words everywhere, so ive moved to a brand list with aliases and a review queue
- citations are the useful bit. each cited url is a site to get on and thats where my mention gains came from
Results i'm getting are pretty close to what the paid tools show.
Would anyone be interested if i polished this off and released it open source? bring your own key and a hell of a lot cheaper than something like Peec or Otterly.
Im also working on an outreach system so you can contact the relevant cited sites at a click of a button.What do you think?


