I’m trying to use Gemma 4 (gemma-4-26b-a4b-it) for a translation task with the python google.genai package.
I noticed a lot of repeating tokens in my output.
Here’s an output of logging the response object from generate_content()
sdk_http_response=HttpResponse(
headers=<dict len=12>
) candidates=[Candidate(
citation_metadata=CitationMetadata(
citations=[
Citation(
end_index=3699,
license='',
start_index=235,
uri='https://fin.guru/en/politica-y-sociedad/cultura-imagen'
),
]
),
content=Content(
parts=[
Part(
text='{"language": "en", "name": "Manabi\'s [Ice-themed Wind Chime] Wind Chime Workshop-", "description": "You can make an ice-themed wind chime with a single color of your choice,<br>br>You can also top it with stickers- For more variety in variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety variety'
),
],
role='model'
),
finish_reason=<FinishReason.MAX_TOKENS: 'MAX_TOKENS'>,
index=0
)] create_time=None model_version='gemma-4-26b-a4b-it' prompt_feedback=None response_id='iLNeap6bM6eA1e8PoI-UiA8' usage_metadata=GenerateContentResponseUsageMetadata(
candidates_token_count=500,
prompt_token_count=552,
prompt_tokens_details=[
ModalityTokenCount(
modality=<MediaModality.TEXT: 'TEXT'>,
token_count=552
),
],
total_token_count=1052
) model_status=None automatic_function_calling_history=[] parsed=None
Interesting that it also cited a page that has the same repeating word, but I have other examples that don’t have citations.
sdk_http_response=HttpResponse(
headers=<dict len=12>
) candidates=[Candidate(
content=Content(
parts=[
Part(
text='{"language": "en", "name": "Learning [Plumpy-Wobblety Squeeze-toy-Pudding Summer Pudding à la Mode]", "description": "A workshop to make a new piece of art through which you can feel theسبة-wobblety-plumpy-wobbles.plumpy-wobblety-squeeze-toy-//-Pudding-Summer-Pudding-à-la-Mode-using-the-squeeze-toy-Pudding. Decorate it with fruits and ice cream. You will end up with a-a-a-a-a-a-a-a-a-a-a-a- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - '
),
],
role='model'
),
finish_reason=<FinishReason.MAX_TOKENS: 'MAX_TOKENS'>,
index=0
)] create_time=None model_version='gemma-4-26b-a4b-it' prompt_feedback=None response_id='fLNeaqymLPvN1e8P1rOJoQw' usage_metadata=GenerateContentResponseUsageMetadata(
candidates_token_count=500,
prompt_token_count=564,
prompt_tokens_details=[
ModalityTokenCount(
modality=<MediaModality.TEXT: 'TEXT'>,
token_count=564
),
],
total_token_count=1064
) model_status=None automatic_function_calling_history=[] parsed=None