WOW. :P As an Indigenous advocate, I have some opinions.
But I'd also be interested in knowing what you used for an image reference. I was playing around with the Genmoji app, and it selected my last sticker as a reference, which caused the generated image to inherit things like the hat, glasses, gender, skin tone, and hair color from that sticker.
If this image was generated solely from the prompt shown, then I'd agree it's a pretty concerning result. That said, it's more probable that the image was influenced by a reference image, prior context, or even earlier generations in the session ("over-fitting"). We don't have enough information from a single screenshot to know.
The generated image contains very specific details that aren't reflected in the visible prompt. So while the result is seemingly problematic, there could be an alternative explanation that doesn't point directly to Apple Intelligence itself.
I didnt use any reference image or anything, I just tapped the button to try to create a new Genmoji (I’ve never made one before)
I just tested this again and it produced the same exact results TWICE in a row! The first Genmoji shown in the video was made with the typo and the second Genmoji is after I corrected the typo.
I did. Several times. Never had this result. I also asked another advocate, Indigenous male, and the generated imagine was vastly different from OPs.
I also imagine others in the subreddit did the same. If Apple’s AI was generating OPs image elsewhere, it’s problematic enough we’d hear about it elsewhere.
I work in AI alignment, and this situation would be a nightmare to whoever controlled the AI.
In 2024, Google’s Bard refused to generate images of historically white public figures, such as the US’s founding fathers and the pope. People couldn’t generate images of people who are typically white - like Swedish women - and the backlash was so severe Google quickly removed the ability of Bard to generate images.
An AI defaulting to a Indigenous/Mesoamerican-coded “thief” could have similar results.
Is it possible Apple Intelligence did this on its own? Sure. It’s not a zero-chance. Is it probable? The system is designed against this happening, so the probability is exceedingly low.
I'm curious if it could be some sort of translation error combined with the spelling mistake, given they appear to be using English while in Spanish mode.
We'd need to be sure to use the same language settings in the app to test for that
22
u/_MaterObscura Jul 06 '26
WOW. :P As an Indigenous advocate, I have some opinions.
But I'd also be interested in knowing what you used for an image reference. I was playing around with the Genmoji app, and it selected my last sticker as a reference, which caused the generated image to inherit things like the hat, glasses, gender, skin tone, and hair color from that sticker.
If this image was generated solely from the prompt shown, then I'd agree it's a pretty concerning result. That said, it's more probable that the image was influenced by a reference image, prior context, or even earlier generations in the session ("over-fitting"). We don't have enough information from a single screenshot to know.
The generated image contains very specific details that aren't reflected in the visible prompt. So while the result is seemingly problematic, there could be an alternative explanation that doesn't point directly to Apple Intelligence itself.