meta-llama

Meta: Llama 3.1 8B Instruct

This AI model, Meta Llama 3.1 8B Instruct, handles text input modality and can utilize external tools in its processing. It has a relatively high context length of 131072, allowing for more information to be considered in the generation process. Those with a moderate budget may want to consider this model due to its competitive price point, which is $0.05 per million input tokens and $0.08 per million output tokens. However, its benchmark performance is only middling, with a blended score of 6.3 across one independent evaluation. As such, it is best suited for those who prioritize cost over high-end performance or require the specific functionality offered by this model's tool integration capabilities.

Open weights 8.03B parameters, about 4.5 GiB at Q4_K_M: fits comfortably on 18 of 18 consumer graphics cards in the PicksByCard catalog. See which cards run it →
Quality Score
86/100
price + capability + benchmarks
Input Price
$0.05
per 1M tokens · checked 2026-10-13
Output Price
$0.08
per 1M tokens · checked 2026-10-13
Context Window
131,072
tokens

Benchmark results

Independent, published benchmarks. Blended score 5.8 across 1 benchmark, last refreshed 2026-10-13. How scoring works →

BenchmarkMeasuresScore
AI Index broad capability composite 11.4
Model ID
meta-llama/llama-3.1-8b-instruct
Vendor
meta-llama
Released
July 2024
Tokenizer
Llama3
Input Modalities
text
Output Modalities
text
Max Output
117,964 tokens
Tool Calling
✓ supported
Structured Output
✓ supported
Reasoning Mode
not supported
Vision
text only
Audio
no
Moderated
no

What it costs in practice

Computed from the current $0.05/M input and $0.08/M output rates. Run your own numbers →

JobTokensCost
Summarize a 50-page report 30k in / 1.5k out under $0.01
Classify 1,000 customer emails 500k in / 50k out $0.03
A month of a busy support chatbot 5M in / 2M out $0.41

Similar models

Quick answers

How much does Meta: Llama 3.1 8B Instruct cost?
$0.05 per million input tokens and $0.08 per million output tokens.
What is Meta: Llama 3.1 8B Instruct's context window?
131,072 tokens, roughly 196 pages of text in a single request.
Does Meta: Llama 3.1 8B Instruct support tool calling?
It supports tool calling, structured output.
Can Meta: Llama 3.1 8B Instruct process images?
No, it is text-only on the input side.

The Model Movers Report

One email every Friday, built from this site's own rankings: the current top five by benchmark score, every model released in the last seven days, and one note worked out from that week's numbers. You can unsubscribe from any issue with one click.