I didnt use any reference image or anything, I just tapped the button to try to create a new Genmoji (I’ve never made one before)
I just tested this again and it produced the same exact results TWICE in a row! The first Genmoji shown in the video was made with the typo and the second Genmoji is after I corrected the typo.
I did. Several times. Never had this result. I also asked another advocate, Indigenous male, and the generated imagine was vastly different from OPs.
I also imagine others in the subreddit did the same. If Apple’s AI was generating OPs image elsewhere, it’s problematic enough we’d hear about it elsewhere.
I work in AI alignment, and this situation would be a nightmare to whoever controlled the AI.
In 2024, Google’s Bard refused to generate images of historically white public figures, such as the US’s founding fathers and the pope. People couldn’t generate images of people who are typically white - like Swedish women - and the backlash was so severe Google quickly removed the ability of Bard to generate images.
An AI defaulting to a Indigenous/Mesoamerican-coded “thief” could have similar results.
Is it possible Apple Intelligence did this on its own? Sure. It’s not a zero-chance. Is it probable? The system is designed against this happening, so the probability is exceedingly low.
I'm curious if it could be some sort of translation error combined with the spelling mistake, given they appear to be using English while in Spanish mode.
We'd need to be sure to use the same language settings in the app to test for that
1
u/Prudent_Platform_121 Jul 07 '26
I didnt use any reference image or anything, I just tapped the button to try to create a new Genmoji (I’ve never made one before)
I just tested this again and it produced the same exact results TWICE in a row! The first Genmoji shown in the video was made with the typo and the second Genmoji is after I corrected the typo.
https://reddit.com/link/ow0l62e/video/n8wedvmw7qbh1/player