I’m trying to use vertex ai to do text generation from a video and have the following setup
response = self.model.generate_content(
contents=[Part.from_uri(uri, mime_type="video/mp4"), PROMPT],
generation_config=GenerationConfig(response_mime_type="application/json", response_schema=VERTEX_INFERENCE_SCHEMA)
)
Where the uri is a gcs path. Running generate_content
succeeds, but I always get the same response back regardless of the uri (video) provided which makes me feel like the video isn’t being accessed. I’m wondering if there’s any way to check if vertex ai has the required permissions to access the video in the GCS bucket or if there’s any other way to root cause what might be wrong.