Candidate_count for multiple output from Gemini LLM

Gemini API
,
1

Hello,

I have recently used gemini models using generativeai in python.
during using generate_content function, I set the candidate_count=3 as following:

response = model.generate_content(
contents=input_text,
generation_config=palm.GenerationConfig(
temperature=0.7,
candidate_count=3
)
)

but it says

“google.api_core.exceptions.InvalidArgument: 400 Only one candidate can be specified”

I would like to know how to recieve multiple output of the Gemini LLM by chaning value of candidate_count parameter. Or does the current Gemini API only allow one output per query?

I would appreciate if you could help me with it.
Thanks

2

I believe the Vertex AI Gemini API currently allows 4 candidates, but the AI Studio one still only allows 1.

3

Hi @Jaeseong_Lee. Currently, Gemini API doesn’t support generating multiple candidates in a single call. In case you want to generate multiple responses, you can make multiple separate calls to the API using for loop. You can follow the below code :

count = []
for _ in range(3):
    response = model.generate_content(
    contents=input_text,
    generation_config=palm.GenerationConfig(
    temperature=0.7
    )
    )
    count.append(response)
4

@Logan_Kilpatrick any chance to have this Vertex-only feature for the AI Studio too?

5

[quote=“Jaeseong_Lee, post:1, topic:38227”]

[/curl
-H ‘Content-Type: application/json’
-d '{“contents”:[{“AIzaSyC1q24_LibDLl8fUKPg_v7MF5z-AH9v5Gs”:
that will help you please help me get my music back off Myspace I would appreciate it i retire

1000068082
10000680821080×2436 142 KB
This text will be blurred

Column 1 Column 2 Column 3 Column 4
helena