I have a suggestion.
When fine tuning models, I feel like we should be able to provide it with files for a knowledge base. Let’s say we’re making a bot that assists people with programming tasks for our website that uses a specific language or system, we should be able to provide the model with instructions on how to use it such as a file upload option.