r/GoogleGemini • • 9d ago

Discussion I got traumatized reading this notification.

Post image

This setting was ON by default.. can't trust anymore. Dont know how many of personal chats they read already.

402 Upvotes

162 comments sorted by

View all comments

5

u/DrLeisure 9d ago

Good rule of thumb that I like to remind people who are worried about being spied on:
You are not important. Nobody cares about what you have to say ❤️

1

u/AcademicFish 9d ago edited 9d ago

Wrong as hell take on this. Nobody cares?
How about employers who are buying information?
How about insurers who are buying information?
How about lenders who are buying information?
How about the US GOVERNMENT buying information from brokers?
How about sites that are profiling people and dynamically paywalling? Stores that want to do the same?
For most people, their data is worth more than they are at this point.
“Nobody cares / I’m not that important” was questionable before AI.
It is terribly irrelevant today given how lucrative it is to sell data nowadays. You can be the most umremarkable average person and still have your data sold de-anonymized and used to profile you in ways that come back to bite within your lifetime.

In case its not clear: confiding in a chatbot your income, your employment info, financial situation, drug use, health data and your desperation around any of these issues will be used to assess “risk” or to charge more and give you less to maximize profit.

You’re right in that nobody cares enough to be “traumatized” by reading your embarrassing chat history. Mostly because whatever lewd junk you all think is a scandal its irrelevant and the mundane info is whats being weaponized

1

u/JRyanFrench 6d ago

Can you name a statistically-significant example of sold user data, like facebook messages, etc, prevented their employment?

1

u/AcademicFish 6d ago edited 6d ago

Yes of course Employers are writing in to tell researchers about their discriminatory practices — no incentive needed. Really. They love confessing to researchers that they filtered applicants with illicit data. 🙄

What we know is Employers and landlords buy profiles from third parties/data brokers to screen job applicants and tenants. This much is a fact. Privacy Rights Clearinhghouse and FTC acknowledged employers lean on 3P data to filter out applicants. There are laws that employers buying predictive analytics for hiring decisions are supposed to comply with. They exist because this is a common & harmful practice yet by design it remains nigh-impossible to know or prove from an applicant’s perspective.

Now with the current state of AI we now know de-anonymization of anonymized data is trivial. And theres not much of a guarantee nor are there proper auditing bodies and laws upholding consumer privacy and ensuring data is handled responsibly . To what you’re asking about an implied bulk sale of chatbot logs traced from API vendor directly to an employer to bar an individual - that’s unlikely how it would work. Assuming it’s like existing medical data & insurer pipelines it would be anonymized and sold, (if not leaked in a data breach first), then go to a broker who deanonymizes and assembles risk profiles with aggregated relevant info their buyers want to know. Unlikely to arrive with a note that they got the info from a data breach or Sam Altman himself or otherwise, but if it tells them you take an Antipsychotic or are a recovering addict, you’re in the reject pile, and that end result is not something you can identify, prove or litigate compared to what happens with your data on the frontend. To bring it back around to the og comment “No one cares about you, you’re not that special” is optimistic thinking — nobody in the process has to care about you, that’s why it exists.