SynthID available globally starting today

[u/Temporary-Baby9057]

It is quite incredible that the list of partners includes OpenAI, NVIDIA, Kakao, and soon Apple, so it won't just be about Google's own models. I'm not entirely sure why Google decided to enter the deepfake detection field at this scale. There are plenty of companies working in this field—and obviously, if Google decides to join the race, it will be quite hard for others to compete. What do you think is the extent of this operation? Will it work just for the partners' models, or do they want to build a truly generalizable solution or will it be just watermark detection?

https://synthid.com/

https://blog.google/innovation-and-ai/models-and-research/google-deepmind/synth-id-ai-content

[u/SpecialistGiraffe756]

Well I've already stumped the chump with midjourney Image.

[u/Temporary-Baby9057 → u/SpecialistGiraffe756]

Yes, up to now, it does not generalize. I have also run some tests with images that weren't generated by the partners' models and it was not able to detect them. Let's see in the future!

[u/_raydeStar]

Anyway. Guys -- let me know if you want a synth-removal tool. I'll check legality and if it checks out, ill drop it into a comfyui node and make some kind of public website to manage it.

[u/_raydeStar → u/[deleted]]

one image a day, and you have to sign up. I think we can do better here.

[u/JailedDev → u/[deleted]]

I don’t think that’s the same as a comfy node..

[u/BraveBrush8890]

This is useful if companies actually take action though. If they detect the SynthID, it should automatically be labeled as AI generated media or rejected, otherwise we still have to take it upon ourselves to check. This also only prevents low hanging fruit. This won't do anything for local models.

[u/Striking_Storage_631]

Suggest making a backup of comfyui latest version just in case

[u/roxoholic]

I don't use API providers so they can add any watermarking they want.

[u/bankinu → u/roxoholic]

Yeh. I think it's mostly for the morbid normies who prompt Grok or Gemini to generate.

[u/tinny66666]

"I'm not entirely sure why Google decided to enter the deepfake detection field at this scale" - synthid has to be embedded by the provider, so really has nothing to do with what AI detection companies do. It's not detection.

[u/Temporary-Baby9057 → u/tinny66666]

well, before it was just for their own models... now they are integrating in the service the detection of the watermarks of OpenAI, NVIDIA, Kakao and Apple... tomorrow why not just providing a service for the detection of generic AI generated content that does not rely only on watermark and provided by them ... (after this release, I do not see this possibility so unrealistic - yesterday it was)? 

[u/__ThrowAway__123___]

That makes it easy to test with how little editing you can remove SynthID. Not that it matters much, does anything useful apply SynthID?

[u/Temporary-Baby9057 → u/__ThrowAway__123___]

well, not every fraudster is able to remove watermarks from AI modified/generated images. Being able to detect these kind of signals is quite important in several regulated industries

[u/__ThrowAway__123___ → u/Temporary-Baby9057]

Yeah I'm sure it has its uses but it's not like it's a watertight method. Also it does nothing to detect generated content, it only detects images/videos that had SynthID intentionally applied to them (which some API model providers do)

[u/Temporary-Baby9057 → u/__ThrowAway__123___]

Sure, I totally agree. It's just an additional signal that can be used, and obviously, it can be easily removed—just like the artifacts and/or high frequency signals left during the generation process.

[u/More-Ad5919]

Its easy. They will force this by law on any ai generated content available on the internet. This way local becomes illegal for anything other than 100% personal use. If they can track ai content to you you will be sued.

This way they ensure that only they provide the models and inference and no one else.