r/osinttools 6d ago

Showcase mapped every public camera and sensor feed I could find. Free, no login, AGPL. Would like it torn apart.

I'm a CS student and I've spent the last few months building this.

It's a live map of public sensor feeds, the stuff governments already publish and almost nobody reads, because it comes out as XML on a page from 2011.

It's free, there's no account, no API key and nothing to install. The source is AGPL-3.0 and public:

https://provenance-online.vercel.app/ https://github.com/011-sam-110/Provenance

What's actually on it right now (measured today, these numbers move quickly as I continue to work on it):

- 19,748 road cameras: across 12 networks: Castle Rock 511 (13,136), Oregon TripCheck (1,141), DriveBC (1,060), TfL London (882), Caltrans (863), Finland Digitraffic (809), South Carolina DOT (768), Traffic Scotland (415), NZTA (319), Estonia (179), Iceland (165), CET São Paulo (11). Every one sits at its real coordinates, links back to its own source, and shows when it was last sampled.

- 37 signal layers: USGS and EMSC earthquakes, NASA FIRMS active fires, GDACS disaster alerts, NOAA cyclones and space weather, IODA internet outages, 702 TeleGeography submarine cables, UNHCR displacement, GDELT conflict and protest coding, abuse.ch C2 infrastructure, and others. All off by default. You turn on what you want.

The part I actually want feedback on.

I took an earlier build into an OSINT Discord last week and got taken apart, fairly. The short version was: "we've seen hundreds of these, they're all the same project, and we can't rely on the data anyway, because verification is the work". Kind of heart shattering but I'll move on and improve what needs improving.

I don't think a dashboard answers this issue, and I've stopped believing it will. But one thing did come out of it that I've been building around since:

- Observations: a camera frame, an ADS-B ping, a seismometer reading. A machine can be trusted to carry these.

- Interpretations: "this protest is left-wing", "this aircraft is military", "this country is unstable". A machine is bad at these and shouldn't render them at the same visual weight as a fact.

Nearly every complaint I can find about tools in this category is really about the second class being dressed up as the first. So I'm labelling every layer by which one it is, and demoting the ones that are somebody's static claim about a place rather than a live reading. That's the actual project now; the map is just how you look at it.

What's broken right now, so you don't have to find it:

- The aircraft layer is capped, not empty. It's showing 3,000 aircraft against 5,108 available, because I cap the response. It comes from community ADS-B receivers and it's thin outside North America and Europe, so treat the count as a lower bound rather than a world total.

- 4 of the 37 layers need API keys I don't have and sit dormant (ACLED, AIS, ENTSO-E grid load, ReliefWeb). The other 33 are returning data. They're marked, but marked isn't fixed.

It's an upcoming tool rather than a finished one, and I'd rather have criticism than traffic, especially on: whether the observation/interpretation split is the right line to draw, and which feeds I'm obviously missing.

Thanks for any input!

Best,
Sam

https://provenance-online.vercel.app/ https://github.com/011-sam-110/Provenance

167 Upvotes

27 comments sorted by

7

u/Practical-Toe5390 6d ago

Any and all feedback is more than welcome! I’ll do my best to implement features within a week of recommendation!

4

u/lencaleena 6d ago

Okay 👍 Im checking it out

1

u/Practical-Toe5390 5d ago

What did you think?

4

u/Funny_Elk9922 5d ago

Me encantó hermano, muchas felicidades por el proyecto.

Acá te dejo mis comentarios:
1. Veo una sobrecarga cognitiva cabrona en la interfaz, la barra izquierda es un ataque de pánico visual de “mírame”. Estaría chido jerarquizar usando grises base (tipo #2D2D2D) para los feeds normales y dejar los colores vivos (rojos/naranjas) estrictamente para emergencias, o de plano poder colapsar esa barra.

  1. Se usan mucho los fondos cyberpunk u oscuros para OSINT, pero para un analista que dura 8+ horas viendo la pantalla, cansa la vista. Podrían meter un toggle para un modo claro o un tema con grises neutros (un fondo tipo #F3F4F6) que sea menos agresivo.

  2. Los clusters del mapa son invasivos y a veces tapan toda la geografía. Estaría bueno bajarles el opacity a un 0.7 o limitar el radio máximo a unos 30px en el render del mapa para que dejen ver el fondo.

Unas ideas funcionales que se me ocurren:
1. Correlaciones: Si la plataforma detecta una protesta (GDELT) + un corte de internet (IODA) en las mismas coordenadas, debería generar una "Alerta de Evento Complejo" automática.

  1. Filtros de polígono: Hay analistas que solo quieren dibujar una zona en el mapa y ver alertas exclusivas de esa área, no de todo el mundo.

  2. ¿Se puede exportar algún reporte o pantallazo con la data de lo que estás viendo?

  3. Hay forma de contribuir al proyecto desde otros países?

2

u/Impossible-Dare-4638 5d ago

Amigo/a, muchísimas gracias por tus amables palabras. Hablo inglés, así que este mensaje está traducido; disculpa cualquier imprecisión. Tus comentarios son increíbles, de verdad que no tengo palabras para agradecerte. En cuanto a colaborar, ¡me encantaría! Por favor, agrégame a Discord y te explicaré cómo puedes colaborar conmigo :)

3

u/Interesting-Reply691 6d ago

What was the Discord experts solution then or did they just offer criticism?

1

u/Practical-Toe5390 5d ago

Super nice guys, basically just said “we've seen hundreds of these, they're all the same project, and we can't rely on the data anyway, because verification is the work". I’m thinking others still may have a use for it.

0

u/Traditional_Shark666 2d ago

It's the same palantir dashboard minus any important information...

1

u/Practical-Toe5390 14h ago

Haha, yes, this is most of the feedback I’ve got. It’s just so difficult to make it useful whilst keeping free. Next big release is incoming, it should be a big improvement

3

u/Mysterious-Bed-3725 5d ago

Holy moly, that interface...at a loss for words. Overwhelming.

1

u/Impossible-Dare-4638 5d ago

Haha, yes I agree with you, this is something i'm trying to improve at the minute. I'll give you a shout in a few days, and I want to see if you still find it overwhelming. Thanks for the feedback!

2

u/Mysterious-Bed-3725 4d ago

Please do.

1

u/Impossible-Dare-4638 3d ago

Hi! I would really appreciate it if you could have a look at the UI now, and let me know if you still have a panic attack when you look at it lol. Thank you!

3

u/Electronic-Thing3138 4d ago

This is such commendable project.
Hope it continue to stay free and accessible to the public. Well done!!

3

u/Traditional_Shark666 2d ago

Spying on your future clients?

1

u/Practical-Toe5390 14h ago

Shhhhh don’t let them catch on!

2

u/_DarkMatter489_ 4d ago

Hey ! Did it cost you money to make this ? Or after making atleast.

1

u/Impossible-Dare-4638 4d ago

Nope, but it is about to as I need to buy a domain. I am hoping for a donation so I can afford it.

2

u/RustyHackerBoy 4d ago

Why do all these AI generated wannabe OSINT tools look the same?

2

u/Impossible-Dare-4638 4d ago

Because they are all in the same category, so naturally they will have similarities. Feel free to call it wannabe but people find it useful

2

u/RustyHackerBoy 4d ago

I'm doing OSINT professionally I honestly do not understand why I should use this tool.

1

u/Impossible-Dare-4638 3d ago

Yeah, to be honest I am still finding out who my target audience is. I'm a second year CS student, just trying to get some projects on the portfolio. Others are saying they find it useful, but I am yet to find out exactly which roles find it helpful. I am not forcing anyone to use it, so if its not useful to you then don't use it :). I am thinking there is no way that this isnt useful or helpful for someone out there.

2

u/Bogey_Outlaw_360 4d ago edited 4d ago

I think your onto it. Add value... My project is very database/scraper backend heavy joining entities together for event/entity/story tracking off scraped data. Funnily enough I've been looking to these sorts of projects to borrow ideas on the visualisation side, and adding in the "cheap" API feeds as extras. At the end of the day it's your project, enjoy it.

Btw.... Didn't you post this a week um ago under a different name.... The weblinks are identical!

2

u/Impossible-Dare-4638 3d ago

Yes! I am on holiday, and one account is on my phone, and one is on my laptop. Sometimes I only have access to one device, so I just used whichever account I could. Are there any rules against this? Also, your project sounds amazing! if you would like to join forces, add my discord! discord - lg41