To the Google and Gemini Development Team,
I am writing to express a serious concern regarding the native image generation capabilities within Gemini, specifically its potential for misuse in creating Not Safe For Work (NSFW) content, including of real individuals.
As a user of Gemini 2.5 Pro, I have discovered that it is possible to upload an image of a real person and, with a simple prompt such as “generate this person in a two-piece swimsuit,” the AI will produce a revealing image of that individual. This functionality raises significant ethical and safety issues, as it can be exploited to create non-consensual and potentially harmful imagery.
While I understand that you have safeguards in place, this specific loophole is concerning. To help mitigate this, I would like to propose a structural change to the Gemini interface.
Currently, the image generation feature is integrated directly into the main chat window. My suggestion is to move the image generation tool to a separate tab or a distinct section within the Gemini interface.
This change would provide users with greater control over their experience. Specifically, it would allow users who wish to avoid this functionality the ability to block only the image generation tab using website and application blockers like ColdTurkey. This would enable users like myself to continue utilizing the powerful text-based features of Gemini Pro for professional and educational purposes without being exposed to or enabling the potential misuse of the image generation tool.
I believe this proactive step would demonstrate Google’s commitment to user safety and responsible AI development. It would empower users to create a safer digital environment for themselves while still accessing the beneficial aspects of your service.
Thank you for your time and for considering this important issue. I look forward to seeing improvements that will help prevent the misuse of this powerful technology.