I am building a Rag chat bot using Gemma 27B with temperature 0.1 for an HR team that answers questions based on some documents.
The thing is the HR team has a name let’s say “Division Alpha” . So sometimes when the bot answers the question it says something along the lines - >for further info contact your human resources team | or some different phrases that are not part of the documents that are not wrong yet include human resources . How to make it say for further information contact Division Alpha and never to use human resources or HR?
In the training documents the words human resources are not mentioned and only Division Alpha is.
I have put in the instructions :"when you are about to say human resources swap it for “Division Alpha”. And in the system prompt “Never say/You are forbidden to say human resource or HR when you are about to say it say Division Alpha”.
Both don’t seem to work at all. What can I do?