Inconsistent RAG responses when querying test data

Google AI Studio
,
1

I am still new to Google Cloud Platform and experimenting with a basic RAG setup - after some previous examples didn’t return the data I expected. I created a test that included a file stating: “Jenny does not have a middle name.”*

When I ask: “What is Jenny’s middle name?” It responded with “A summary cannot be generated for your query” even though it highlights the correct file where to find this information.

When I ask: “Does Jenny have a middle name?” I get the correct answer: “No, Jenny do not have a middle name.”

Is this normal behavior with RAG queries, or is there a better way to structure data/questions to avoid this? I noticed there was no place to insert a system prompt - is that the issue or if this a problem on Google’s side of the house?

3

@Savannahe ,

welcome to the forum,

in the example you have given , the similarity search might not have retrieved the needed chunk, make sure you test your retrieval with some context and consider having a step of “llm based query re-writing” for better chance of retrievl of the context.