When uploading a video, In the Cookbook, it says “NOTE: The File API samples the video at 1 frame per second (FPS). This sampling rate may be subject to change to provide the best inference quality.” How to increase this rate, e.g., 5 frames per second?

The Video cookbook is brand new, and shows the newer, more convenient API. Up to last week, you had to split the video into individual frames, separate out the audio track, and then feed the model all the parts (in sequence) when using AI Studio. People tended to use ffmpeg to make frame collections…

[image] OrangiaNebula: visible Thank you! I’m okay using the “old” method. Can I also use the “old” model? Do you know if we can access the version before the major update this week? The “old” model gave me much better performance in my task.

but I read the documents here , there is no way to set custom fps for File API, it’s only for inline video, which means we have to pass the whole video in payload every single time we query for an answer, not as fast as File API when the video gets uploaded and processed once

For file based FPS, our preprocessing is not covered (Which means we only generate preprocessed file when FPS = 1). And if you specify high/low FPS, it will be preprocessed on the fly anyways (Expect high latency here :frowning: ). However, I’m writing preprocess cache for video, so you should b…

Also I’m curious to see your use case? Are you using it in for realtime chatting? Why latency matters here. I could talk to PM to prioritize here.

hey, thanks for the blazingly fast response. I just want better results when processing video, the more the model can “see”, the better the response, that’s what I want. Looks like you’re working on it and the video preprocessing is still a work in progress, so better this time I am not thinking abo…

but I really curious about the implementation that made fps=1 really different from the rest, I thought fps should be treated as a variable, and when Files API receives a file, it also needs to take in the fps (if configured) to start the processing phase. Looks like Files API didn’t think about thi…

ok, my use case is to build a chat, not only to understand text but also to understand visual and audible context. Good thing is that users only use text to talk to the model, not voice (as the nature of people I am aiming to, office workers and students), users can wait, but not too long, so that’s…

File API has been a bit legacy code. It works like a explicit cache. So we recently launched implicit cache for text images. But for other modality like document and video, most of time takes in frame extraction. As a follow up, the implicit cache for doc and video preprocessing will be added soon. …

yes, as long as video can be processed at a configurable fps, the video is uploaded once and can be reused at a much faster speed for later API calls, then it’s fine. Look forward to it :saluting_face:

File API, upload video, how to increase FPS?

Gemini API

Junyan_Xu May 22, 2025, 1:00am 4

Now FPS feature is officially supported.

Any plans to increase FPS?

Topic		Replies	Views
Video processing - Best approaches towards analyzing large videos? Gemini API api , video	6	620	August 26, 2025
I need 5+ FPS when uploading a video over 20mb (Gemini 2.5 Pro) Gemini API api , video	4	194	August 22, 2025
Optimal Video Pre-processing Parameters (FPS, Resolution) for File API Gemini API api , models	2	848	July 3, 2025
Any plans to increase FPS? Gemini API new-features	3	253	May 25, 2025
FPS Processing Capability of Gemini 2.5 Flash for Video Fine-Tuning Gemini API fine-tuning , gemini , ai , machine-learning , video	3	250	August 5, 2025

File API, upload video, how to increase FPS?

Related topics