Gemini: A Family of Highly Capable Multimodal Models

This report introduces a new family of multimodal models, Gemini, thatexhibit remarkable capabilities across image, audio, video, and textunderstanding. The Gemini family consists of Ultra, Pro, and Nano sizes,suitable for applications ranging from complex reasoning tasks to on-devicememory-constrained use-cases. Evaluation on a broad range of benchmarks showsthat our most-capable Gemini Ultra model advances the state of the art in 30 of32 of these benchmarks - notably being the first model to achieve human-expertperformance on the well-studied exam benchmark MMLU, and improving the state ofthe art in every one of the 20 multimodal benchmarks we examined. We believethat the new capabilities of the Gemini family in cross-modal reasoning andlanguage understanding will enable a wide variety of use cases. We discuss ourapproach toward post-training and deploying Gemini models responsibly to usersthrough services including Gemini, Gemini Advanced, Google AI Studio, and CloudVertex AI.

Further reading#

• Access Paper in arXiv.org