It was the first release from Claude 3.5 model family. Claude 3.5 Sonnet raises the industry bar for intelligence, outperforming competitor models and Claude 3 Opus on a wide range of evaluations, with the speed and cost of Anthropic's mid-tier models.
vs.
Gemini 1.5 Pro is a multimodal AI model developed by Google DeepMind to help power generative AI services across Google's platform and third-party developers. Gemini 1.5 Pro is a follow-up release to the initial debut of Google's Gemini 1.0.
Overview
Overview of the AI models
Claude 3.5 Sonnet
Gemini 1.5 Pro
Input Context Window
The quantity of tokens that the input context window can accommodate.
200K
tokens
2M
tokens
Release Date
When the model was released.
June 21st, 2024
February 15th, 2024
License
Terms and conditions under which an AI model can be used.
Proprietary
Proprietary
Benchmark
Compare important benchmarks among the AI models
Claude 3.5 Sonnet
Gemini 1.5 Pro
MMLU
Measuring Massive Multitask Language Understanding (MMLU) is a benchmark for evaluating the capabilities of language models.
89
86
Throughput
Output tokens per second.
80
tokens/s
62
tokens/s
Latency
Seconds taken to receive the first tokens, measured on an input size of 1000 tokens.
