Compare

The Llama 3 Instruct 8B model, developed by Meta, features an 8K tokens input context window and comprises 8 billion parameters. Officially launched on April 18th, 2024, this model operates under an open license, enabling broad accessibility and utilization across diverse applications and projects.
vs.
The Llama 3 Instruct 70B model, developed by Meta, comes with an 8K tokens input context window and an impressive 70 billion parameters. Launched on April 18th, 2024, this model operates under an open license, facilitating its widespread use across various applications and projects.
Overview
Overview of the AI models
Llama 3 Instruct 8B
Llama 3 Instruct 70B
Input Context Window
The quantity of tokens that the input context window can accommodate.
8K
tokens
8K
tokens
Release Date
When the model was released.
April 18th, 2024
April 18th, 2024
License
Terms and conditions under which an AI model can be used.
Open
Open
Benchmark
Compare important benchmarks among the AI models
Llama 3 Instruct 8B
Llama 3 Instruct 70B
MMLU
Measuring Massive Multitask Language Understanding (MMLU) is a benchmark for evaluating the capabilities of language models.
68
82
Latency
Seconds taken to receive the first tokens, measured on an input size of 1000 tokens.
0.3
seconds
0.4
seconds
Throughput
Output tokens per second.
122
tokens/s
52
tokens/s