Function calling with image return values

I am currently using several function calls with Gemini, a few of which need to give images as a response back to the model. The images however are being treated and tokenized as text from base64:

Is there a way to fix this within functionResponse? Or is it more appropriate to pass the image back into the conversation as inline_data?