Google Gemini is a family of multimodal large language models developed by Google DeepMind, serving as the successor to LaMDA and PaLM 2. Gemini Pro was announced on December 13, 2023, positioned as a competitor to OpenAI's GPT-4.
vs.
It was the first release from Claude 3.5 model family. Claude 3.5 Sonnet raises the industry bar for intelligence, outperforming competitor models and Claude 3 Opus on a wide range of evaluations, with the speed and cost of Anthropic's mid-tier models.
Overview
Overview of the AI models
Gemini Pro
Claude 3.5 Sonnet
Release Date
When the model was released.
December 13th, 2023
June 21st, 2024
Input Context Window
The quantity of tokens that the input context window can accommodate.
33K
tokens
200K
tokens
License
Terms and conditions under which an AI model can be used.
Proprietary
Proprietary
Benchmark
Compare important benchmarks among the AI models
Gemini Pro
Claude 3.5 Sonnet
MMLU
Measuring Massive Multitask Language Understanding (MMLU) is a benchmark for evaluating the capabilities of language models.
72
89
Latency
Seconds taken to receive the first tokens, measured on an input size of 1000 tokens.
