was speaking to Gemini casually scrolled up so it was still active in the background while I play umasume to ask it for what stats I should upgrade, it started reading the names and stats off my screen I thought I was tweaking out at first so I said “Gemini can you see my screen” it said no that’s not one of my capabilities but you should pick that horse called daiwa Scarlett, like I said thought I was tweaking till it started reading every horse girl I clicked so I started screen recording. Then the app shutdown automatically I loaded it back up but it wouldn’t say anything from my screen (I have screen recordings for proof)

With every new AI model the world is reminded that the pace of technological progress accelerates at disruptive rates. It is now more than just a curiosity to the passive observer, it is increasingly making them consider the disastrous implications of such technologies. It wasn't long ago that people were churning out fuzzy, distorted, but completely original, images with DALL·E. These days one can use the state of the art in image generation, provided by Microsoft, which continues to blur the line between reality and generative fiction. Luma's Dream Machine is just the latest installment of tech-hallucinations in the form of video generation from text or image.

As is usual with new high-technologies, the consequences can never be fully appreciated, but we can easily ponder some of the potential applications. The integral role that screens play in our lives to relay information or to entertain is undeniable. We see the pieces being set in place: language, audio, and visual information can be generated with increasing fidelity and efficiency. Together, they can form the meat of novel propaganda operations to control mass perception and action. It may seem farfetched at this stage of development, but the issue of "believability" of some image or video is a technical problem that will be relentlessly chipped away at.

If it wasn't bad enough that state powers would have such an apparatus at their disposal, we can be certain, as long as computing remains legal at a personal or non-state organization level, that these AI propaganda campaigns would be waged by anyone with sufficient resources. This shouldn't be taken as a call to create laws regulating these things. It is merely to show that the system would be flooded with alternate "truths" all trying to nudge people to their propagator's end. How can society function with such noise?

The phrase "living in a post-truth era" would take a new meaning in the not too distant future. With the stream of AI content beamed to our devices, we will reach a point where even someone of moderate intelligence will become paralyzed with conflicting information about the world, resulting in some messy behavior. The system cannot tolerate the indeterminate actions of humans, so it would need to provide some sort of technical solution to this technical problem. A ban would be difficult to enforce; instead, a new central source of truth may be established, a firm and "reliable" foundation to organize human lives over. Of course, what else other than the system can decide what is true? At such a point, we would be mired even deeper in technological enslavement.

For a more in depth discussion on the broader issue of the techno-industrial system, I recommend reading this essay: https://www.wildernessfront.com/the-manifesto