Google has launched a new Batch Mode for its Gemini API. It is designed to handle large-scale, non-urgent AI tasks, but at a much cheaper cost. The new asynchronous endpoint is aimed at developers and enterprises that need to process large jobs without requiring real-time responses.
With Batch Mode, you can offload heavy jobs to the cloud and receive results within 24 hours, at 50% less cost than standard synchronous calls. The move is clearly targeting high-throughput use cases like bulk content generation, model benchmarking, and data labelling.
