Constant 500s on Gemma 4

Gemma
55 
curl -X POST "https://generativelanguage.googleapis.com/v1beta/models/gemma-4-26b-a4b-it:streamGenerateContent?alt=sse" \
     -H "x-goog-api-key: $GEMINI_API_KEY" \
     -H "Content-Type: application/json" \
     -d '{
       "model": "gemma-4-26b-a4b-it",
       "contents": [
         {
           "role": "user",
           "parts": [
             {
               "text": "Ansver 1+1 only."
             }
           ]
         }
       ]
     }'

quite often it reports 500:

{
  "error": {
    "code": 500,
    "message": "Internal error encountered.",
    "status": "INTERNAL"
  }
}

I vibe-coded a script to do some benchmarks, the quality is horrible. I can accept the 429 but not the spam of 500s

================================================================================
🚀 GEMINI BENCHMARK LIVE DASHBOARD (Total per model: 100)
================================================================================

📊 MODEL: [gemma-4-26b-a4b-it]
--------------------------------------------------------------------------------
 Progress:      [56/100] | Success Rate: 51%
 Results:       ✅ Success: 51 | ❌ Hard Failures: 5
 Live State:    ⚡ Active Workers: 34 | 🕒 Backoff/Waiting: 10
 Retries Logs:  🔄 Total Retries: 329 | ⏳ Avg Wait Time (Backoff): 74.7s
 HTTP Errors:   💥 Internal (500): 96 | 🚦 Rate-limit (429): 634 | ❓ Other: 0
 Latency:       ⏱ Avg Latency (Success): 368184ms
 Latest Logs:   #9: Waiting HTTP 500 (Next retry in 120.0s) | #19: Waiting HTTP 500 (Next retry in 120.0s)
--------------------------------------------------------------------------------

📊 MODEL: [gemma-4-31b-it]
--------------------------------------------------------------------------------
 Progress:      [98/100] | Success Rate: 92%
 Results:       ✅ Success: 92 | ❌ Hard Failures: 6
 Live State:    ⚡ Active Workers: 0 | 🕒 Backoff/Waiting: 2
 Retries Logs:  🔄 Total Retries: 555 | ⏳ Avg Wait Time (Backoff): 23.3s
 HTTP Errors:   💥 Internal (500): 14 | 🚦 Rate-limit (429): 561 | ❓ Other: 0
 Latency:       ⏱ Avg Latency (Success): 257305ms
 Latest Logs:   #44: Waiting HTTP 500 (Next retry in 120.0s) | #72: Waiting HTTP 500 (Next retry in 120.0s)
--------------------------------------------------------------------------------