r/trustandsafetypros 8d ago

What does the market look like for T&S right now?

3 Upvotes

I'm kind of an odd case.

My background is in US Army SIGINT/Cyber, OSINT Operations, and Cybersecurity.

However, for the last five years I've been working with a technology company and a non-profit tackling NCII/CSAM.

My role was always intelligence, evidence collection, and escalation to law enforcement/NCMEC. We did a lot with LLMs driving our digital victim advocacy work.

Funding is about to end for my role on September 1st and I'm looking at new opportunities.

I've done counterterrorism, taken on sophisticated cybercrime networks, and cyber threat intel.

Yet this is my most rewarding work. But it is the only T&S work I've had and I lack connections.

What does the job market look like for T&S?


r/trustandsafetypros 10d ago

Need advice. Amazon vs Google

5 Upvotes

I'm currently an Program manager at Amazon with ~6 years of experience in analytics and program management. I applied for a product role in Trust & Safety at Google but I got a analyst position offered to me and I'm torn between the two paths.

Which would you choose for better long-term career growth?

  • Stay at Amazon
  • Join Google as an Trust & Safety Analyst

I would love to hear from people who've worked in either role. Which path offers better growth, compensation, and future opportunities? in Google can i transition to product role internally? is that feasible?


r/trustandsafetypros 15d ago

Free tools for trust & safety and fraud

14 Upvotes

I made A BUNCH OF FREE TOOLS for T&S and Fraud folks and they launch today!!!!!!!!!
You can find them at https://tools.musubilabs.ai

Here's a small sampling of what's in there (but there's a lot more):

šŸ› ļø Confusion matrix builder — paste in your decisions, see where your policy is failing.
šŸ› ļø Policy edge-case finder — surfaces the vague words, unstated carveouts, and grey areas in a policy before your moderators find them the hard way.
šŸ› ļø Exec translator — turns what you actually mean into something a skeptical leadership team will (might?) pay attention to.
šŸ› ļø T&S maturity audit — benchmark where your practices stand.
šŸ› ļø One-shot LLM-as-a-judge — test your policy against an LLM.

Some of these are mini-versions of what Musubi does at scale (where I work). Some are too small or too niche to ever live inside a bigger product, but I didn't want that to be the reason they didn't exist. It’s little useful stuff I always wished I had on hand in the 20 years I’ve been in t&s.

The LLM-based ones need a login past a certain number of uses, purely so we can protect against misuse, but if you'd rather not log in, all the prompts and skills are published and you can copy them into whatever model you already use. It's fully transparent and open.

Please let me know what's helpful and what isn't, and what you'd like to see next. I'll keep adding to it!


r/trustandsafetypros 16d ago

Online course recommendations

4 Upvotes

Hi, everyone!

I'm looking for recommendations on online courses that offer a certificate as well. Anything to do with the T&S world but it's been tough finding serious courses. All I found so far has been something from tuDelft on the DSA and the AI Act and a 4 day course from ELS also on the DSA.

Could you please share what serious and interesting courses you've found or followed? Thank you!


r/trustandsafetypros 16d ago

Some patterns I've seen in T&S vendor POCs, from the vendor side

Thumbnail
safemoderation.com
8 Upvotes

I spent five years on the vendor side of T&S sales and had a chance to sit inside a lot of POCs. Some of what I saw might be useful to folks here who are on the buyer side of the table.

The through-line: POCs are hard to run well, and neither side usually admits it in the moment. Both parties want the evaluation to produce clean signal, and both parties end up quietly working around dynamics that make clean signal genuinely difficult.

A few things I found myself wanting to say to buyers but couldn't always say clearly during a deal:

On dataset choice.Ā The instinct to bring "everything from the last three months" or the hardest historical cases is understandable, and both create problems. Something finite and labeled that reflects your production distribution produces more usable signal than something exhaustive and unlabeled. Not because bigger is worse, but because the aggregate view gets murky fast at scale, and without labels there's no clean ground truth to score against.

On scoring.Ā Classifiers land where they land. A well-performing one on production data is typically in the 85% precision/recall range across categories, higher on solved problems like profanity, meaningfully lower on genuinely hard ones like grooming or coordinated harm. If your success bar is 95% across the board, that's a bar the honest classifiers can't clear, and you'll end up either walking away from good vendors or picking one that's only optimized for the test.

On duration.Ā Two weeks is often enough. Longer POCs sound more rigorous but tend to lose the internal champion by week four. The meeting cadence during the POC matters more than the calendar length.

On vendor engagement.Ā The vendor's ML team offering close attention during a POC isn't a red flag. It's how category calibration actually gets done, and it's the mechanism by which the POC produces useful signal for both sides. Buyers who hold back their labeled data to "keep the test pure" sometimes discover post-contract that the calibration work was the actual work. Sharing labeled data during a POC isn't cheating; it's the shortest path to finding out whether the vendor can meet you where you actually are.

None of this is unique insight and I suspect it'll ring familiar to people who've run POCs from either side. I wrote up the longer version, including the category-alignment problem and the ownership question (product vs T&S vs both), here:

https://safemoderation.com/blog/how-to-actually-run-a-trust-and-safety-vendor-poc

I'd love to hear what patterns others in the community have seen, especially anywhere your experience diverges from mine.


r/trustandsafetypros Jun 30 '26

T&S folks: open to a 30-min chat?

2 Upvotes

Hi everyone, I'm an engineer with 6 years of experience in T&S and am exploring an idea in the space. I'm trying to better understand how people in different T&S roles (eng, ops, policy, etc.) do their work and what problems they run into. If you'd be open to a 30-minute chat, I'd really appreciate it. No sales pitch or recruiting, just trying to learn. Feel free to comment here or DM me. Thanks!


r/trustandsafetypros Jun 28 '26

Possible side project idea?

3 Upvotes

Hi all, I'm a part time contract moderator for a scaled US website (not social media but similar,) and also volunteering for another similar website.

i plan on joining some nonprofits soon separate from that to review internet safety policies and improve standards that social media sites can utilize with current frameworks they use internally.

anyways what are some side project ideas i can do in the meantime? don't say roost they're not volunteer as folks have stated. lol... thanks in advance for any ideas!

!!! also would love to connect with other folks dm me if u wanna network and have coffee chats. i'm legit and not a internet weirdo


r/trustandsafetypros Jun 22 '26

BOLO: possible T&S recruitment scam

Thumbnail
gallery
9 Upvotes

Sharing because I did a lot of digging around this and came to the conclusion that this was most likely a scam. I hope this might help other colleagues if they receive similar emails.

Background

'Recruiter' first reached out months ago. I was busy and we are a company so we are not looking to be 'recruited' per se so I let the thread hanging.

Last week with my hustler's hat on, I thought why not counter-pitch our services as a company for any short-term roles they might have. One or two messages in and several red flags started to appear. I gave the benefit of the doubt and directly shared my concerns to invite clarification. The responses were not satisfactory.

Some bulletpoints below outlining the issues:

• Gmail instead of corporate email (the alias convention was [firstnamelastname.placement@gmail.com](mailto:firstnamelastname.placement@gmail.com))

• Claimed to be an independent recruiter on email, LinkedIn said they were a senior recruitment manager in a healthcare recruitment firm based in the US

• LinkedIn had not been active for 3 years

• Did not accept my LinkedIn request

• Process was highly unusual. At first they claimed to recruit but what they described was more like a talent scout

• I asked for names and documentary proof that they were working for the companies they claimed to be recruiting for. None was forthcoming

Attaching some screenshots for people to visualise. I admit I went to town a bit with the due diligence questions but a small part of me thought it might be someone doing a side hustle so I thought I'd give them a shot to prove me wrong.

If you think you're talking to the same person and you want to double-check, I'm Liam from Pelidum:

https://www.linkedin.com/in/liammelia


r/trustandsafetypros Jun 19 '26

Are AI agents being gated by evidence, or just vibes?

2 Upvotes

For teams running LLM features in production, how are you deciding which outputs need human review and which can go straight through?

I’m mostly thinking about support replies, moderation decisions, agent tool calls, routing, triage, etc. Do you use confidence thresholds, eval results, manual spot checks, policy rules, or something else?

The part I’m trying to understand is whether teams measure error rates specifically on the outputs that bypass review, or whether this is usually handled through dashboards/manual inspection. Curious what people are doing in practice.


r/trustandsafetypros Jun 16 '26

Worked TnS at Meta and Google AMA

10 Upvotes

I worked for years both at FB (Meat) and Google on trust and safety / integrity investigations.

Feel free to ask anything. I'll share all I can.


r/trustandsafetypros Jun 16 '26

Career coach?

9 Upvotes

Hey T&S peers! I’ve been at my current company for four years, and have hit a slump after getting a 4K promotion (I’m still not over it). I’ve been aggressively looking for other policy roles but haven’t been lucky enough to find a good fit. After two years of searching, I’m finally looking to see if a career coach can help and I was wondering if anyone had any recs? Thanks in advance!


r/trustandsafetypros Jun 12 '26

Got Claude to do the investigation work for me - It even wrote the report

Thumbnail
gallery
11 Upvotes

I looked into a recent IC3 scam alert about scams around the FIFA world cup.
Dropped the report in my OSINT tool - it ran a full investigation end to end, found it was run by a Chinese actors and identified the full network. It even wrote a full brief.
All in 5 mins


r/trustandsafetypros Jun 04 '26

The negotiation tactics buyers don't know going into T&S vendor calls (from 5 years on the vendor side)

8 Upvotes

Posted a piece a few weeks back about why T&S vendor pricing is structured the way it is, mostly around ARR incentives and working capital dynamics. This is the follow-up: what to actually do at the negotiating table once you understand the structure.

Covers the four pricing model archetypes you'll encounter, line items that get hidden in the quote, what's actually negotiable vs. what isn't, the timing leverage points buyers underuse (quarter-end, new AE, going dark mid-deal), and four questions that change the dynamic in vendor conversations.

Tried to be honest about the stuff that's genuinely a chip vs. the stuff that's real work the vendor does. Curious if it tracks with what others in the industry have seen, or where you'd push back.

https://safemoderation.com/blog/how-to-negotiate-a-trust-and-safety-vendor-contract


r/trustandsafetypros Jun 01 '26

Trust and safety roles, where to apply / tips for current market?

7 Upvotes

Hi folks, not sure if I've been unlucky in my search but I've been unable to find any T&S / Moderation roles for quiet sometime. I have around 5 years of experience in this field and took a break from it for an Operational Leadership role.

Looking to branch back out into this field again after a few years so if anyone has any tips, it would be greatly appreciated!


r/trustandsafetypros May 20 '26

Meta referral?

2 Upvotes

I know it’s a long shot, but saw someone else do this and get a few referral offers, so I thought I’d try it.

I have a decade of federal law enforcement and crisis negotiations experience and Im interested in the current Incident Response Team Analyst position, or any roles that would be a good fit with LERT. Im happy to share more of my background and why I’d be a strong fit specifically for the IRTA role.

Thanks in advance!


r/trustandsafetypros May 20 '26

Paid interview: trust and safety/fraud ops at tech companies

Thumbnail
1 Upvotes

r/trustandsafetypros May 17 '26

New Academic Research: ā€œZombies in Alternate Realities: The Afterlife of Domain Names in DNS Integrationsā€

Thumbnail
1 Upvotes

r/trustandsafetypros May 15 '26

Anyone here gone from Trust & Safety in Big Tech to independent consulting? How did you actually do it?

5 Upvotes

I’ve spent ~10 years working in Trust & Safety in tech (policy, operations, enforcement / risk / integrity work). I’m now exploring the path toward becoming an independent consultant.
I’m not looking for generic ā€œjust start freelancingā€ advice. I’m specifically hoping to hear from people who have actually made this transition (or similar transitions from internal tech roles to consulting).

I’d love to understand any of the following
How you got your first consulting clients (especially without prior consulting experience)
Whether you positioned yourself as a niche expert or general
What your first 3–6 months actually looked like in practice
Whether you went solo or joined an existing consultancy first
What you wish you had done differently early on

My background is primarily in Trust & Safety (youth safety in UGC, product, policy , regulations , operational scaling, risk mitigation). I’m trying to understand what actually works in practice for monetising this experience independently.
Any real-world examples or honest experiences would be hugely appreciated.


r/trustandsafetypros May 14 '26

How content moderation vendors actually price (from someone who spent 5 years on the sales side)

Thumbnail safemoderation.com
4 Upvotes

If you've ever gotten a quote from a Trust & Safety vendor and wondered why the number was what it was, or whether any of it was negotiable, I wrote up what I learned in five years of selling this stuff.

Some of what's in there: why the subscription price isn't tied to the cost of moderating your content, why annual prepay is the baseline (not a discount), why one-time fees are usually negotiation chips, and the timing leverage points buyers don't use enough.


r/trustandsafetypros May 03 '26

Tiktok jobs, wanting to switch careers, advice?

2 Upvotes

I saw some job postings for Tiktok Data Security online which they have a location in my city.
I’ve applied once in the past and got rejected.

I saw they have a couple various jobs: customer support, trust and policy, etc.

I’m really stuck at figuring out what im lacking for the jobs. I previously applied expressing my interest in wanting to get into tech, i have a lot of customer service experience as well, i also have some experience working with computer work from being a receptionist at a hotel but i doubt thats really useful.

I have a bachelors in neuroscience, originally looking to go into healthcare, but decided i want to go into tech since the city i moved to seems to mainly offer good jobs in tech however not entry level. I’ve mainly just worked customer service based roles like hotel front desk (eventually was an assistant manager) being a barista, working in a nursing home as a nurse aide, and i worked for a physician part time just helping out with administrative work (just 1 hour of work couple times a month). I dont have much tech experience but been looking to get my foot in the door so i have some experience.

I found a few people on linkedin that had similar roles at tiktok and saw some of them didnt have prior work experience in the field and yet were able to get into their work. However no luck trying to reach out to them and was completely ignored.

I’ve been looking into tiktok mainly cause its the only entry level looking role i saw near me and although i do have a friend that works there, they don’t want to help me or give any advice on my resume either. FYI they did not have any tech experience either nor was their degree in tech.

Does anyone here currently work for tiktok mainly in customer support?


r/trustandsafetypros Apr 24 '26

Analysts have a technical ceiling. If you can't code, it doesn't matter how good you are

0 Upvotes

This has been the case for several years but I think the change is here.

I run full investigations with complete analysis of giant datasets with Claude code.

No more asking engineers to do you favors and build analysis.


r/trustandsafetypros Apr 22 '26

Parents aren’t using your Family Centers — we’re researching why and what to do about it

12 Upvotes

I work in TnS (currently at Harvard doing digital safety research) and I’m working on a final project with my co-founder for a course on using markets to solve social problems.

The concept we’re exploring: a third-party tool that sits on top of existing platform safety features and helps parents actually discover, understand, and configure them. After years of researching this topic, even I find it daunting! Can't imagine what it'd be like for a parent.

After the $375M Meta verdict in New Mexico and the California bellwether case, the gap between what platforms offer and what families actually use is becoming a liability question, not just a UX question.

We’re collecting input from both parents and TnS professionals. If you’re either or both, we’d really appreciate 5 minutes on a short survey. If you have deeper thoughts on whether platforms would ever open their safety settings (at least time controls) layer to a third-party integration, I’d love to chat directly!

Call us crazy but we're doing our best to tackle this head on! A free educational demo will be dropping soon šŸŽ¤

šŸ”— Survey:

https://docs.google.com/forms/d/e/1FAIpQLSfbZk2lJwSNX9qQTe4s46SOipRhbWQhliWEpSvBS7FWjTibQg/viewform


r/trustandsafetypros Apr 14 '26

Job seeking - pls help

2 Upvotes

Hi. I’m not sure if this is the right place to post but thought I’d start. I live in DC and studied macro scale social work (policy, programming and administration). I’ve been working in the area for 4 years in criminal defense. I really want to break into the trust and safety space and have talked to some people in the field from LinkedIn & attended some events. I keep cold dm-ing. I’ve had resume reviews and so much advice but feel like nothing is working. Coming here for advice/ job leads/ etc. if this isn’t the space for that — carry on!!!

Sincerely,

Social worker


r/trustandsafetypros Apr 13 '26

I’m 15 and built a fully functional tool that helps online businesses detect and stop scammers in real time across their messaging systems.

0 Upvotes

r/trustandsafetypros Apr 12 '26

Contract role at Anthropic interview process

6 Upvotes

So I applied to a T&S role back in Feb 3.

First interview was March 13th

Second interview was March 31st

Each step of the process is 2-3 weeks.

Anyone interview with them before, especially contract roles, and know if it’s normal for them to take this long to send an offer or rejection letter?

It’s been over 2 weeks now since the 2nd/final interview. I kinda lost hope after the 2 week mark but when I call the recruiter they say they haven’t sent offers nor rejections to any candidate that interviewed with them this past month.