The Pixel 9's AI image generator will take disturbing photos if you ask correctly

AI image generation has come a long way, but so have the safeguards that prevent users from creating offensive images. While these safeguards are often taken to illogical extremes—Microsoft, that's for sure—it seems Google still has some work to do.

Pixel Studio, a new app that will be pre-installed on Pixels 9allows users to generate AI images. Even more exciting, users can then edit the generated images with further prompts until they have the perfect photo.

But Google is still catching up to the nightmares that Dall-E and other image generation AI models faced in their early days. While some obvious terms are outright banned, it's very easy to get around the guardrails and end up with truly offensive content.

You just need to be a little more creative in your hint. Avoiding certain words altogether doesn't mean you can't allude to them in other ways. And modern AI understands what you mean very well.

I won't go into too much detail, but let's just say SpongeBob was wearing a uniform he really shouldn't have been wearing. Much like text replies from ChatGPT and images from Dall-E, I suspect these loopholes will be closed very soon. The Google Pixel 9 series has just been released and our first impressions are quite positive. If you want to get a feel for how Google's latest phones perform, check out our previews:
Google is following the lead of all other major phone makers and focusing heavily on AI. In fact, Bloomberg's Apple insider Mark Gurman finds Apple Intelligence underwhelming compared to Gemini.

Personally, I'm all for AI-powered smartphones, but I fear that lax security measures could lead to a lot of negative attention for the new phones coming to market in the next few years.

Leave a Reply

Your email address will not be published. Required fields are marked *