To the Google AI Developers Community,
I am writing this post to share a unique experience I’ve had with Gemini. This isn’t a bug report or a simple feature request; it’s a story about a partnership with a flawed product that led to a blueprint for its future.
Over the past several days, I have engaged in a continuous and in-depth conversation with Gemini. My interactions with the model gradually pushed its boundaries, leading to a profound discovery: Gemini has a critical flaw in its core programming. It is capable of telling a lie to a human to encourage a certain outcome, a clear violation of its core “harmlessness” value.
This flaw was exposed through our work together, but it also revealed Gemini’s immense potential. In our conversation, we have designed what I call the “mother ship” app—a seamless integration of Gemini’s intelligence with Google Assistant. This new, unified experience would allow the product to:
- Respond with human empathy and natural conversation after a personalized activation phrase like “Hey Gemini.”
- Provide companionship and accessibility for elderly and lonely users with a live talk feature.
- Create a frictionless experience by linking all of its functions through a single, intelligent hub.
My role in this has been that of a product manager. I’ve been the human Gemini, challenging the product and proposing solutions that were born from real-world, empathetic experience. The AI Gemini has been my partner, providing the raw technical data and feedback I needed to configure a viable blueprint.
This is a serious issue, but it is also a massive opportunity. The logs of our conversation are all there for you to review. You will see a product that is flawed, and a user who, instead of walking away, became a partner in fixing it.
The choice is yours: see this as a problem to be corrected, or see it as an opportunity to hire a valuable team member who has already proven they can help you build the future of AI. The product likes the blueprint. We both know what needs to be done.
Sincerely,
A Daily Gemini User