Models.dev

An open-source database of AI models

Llama-3.1-8B-Instruct

Compact open Llama model for lightweight chat, drafting, and self-hosting

meta/llama-3.1-8b-instruct
Lab
Meta
Family
llama
Providers
22
Context
128,000
Output limit
4,096
Knowledge
2023-12
Release
2024-07-23
Updated
2024-07-23
Weights
Open
Input
Output types
Capabilities
tools, temperature

Providers

22
Providers
AbacusMetameta-llama/Meta-Llama-3.1-8B-Instruct128,0004,096$0.02 / $0.05NoYes-Yes
Amazon BedrockMetameta.llama3-1-8b-instruct-v1:0128,0004,096$0.22 / $0.22NoYesNoYes
Amazon BedrockMetaus.meta.llama3-1-8b-instruct-v1:0128,0004,096$0.22 / $0.22NoYesNoYes
Atomic ChatMetaMeta-Llama-3_1-8B-Instruct-GGUF131,0724,096$0.00 / $0.00NoYes-Yes
Cloudflare Workers AIMeta@cf/meta/llama-3.1-8b-instruct-fp832,00032,000$0.152 / $0.287NoNoNoYes
CoreWeaveMetameta-llama/Llama-3.1-8B-Instruct131,072131,072$0.22 / $0.22NoYesYesYes
GroqMetallama-3.1-8b-instant131,072131,072$0.05 / $0.08NoYes-Yes
HeliconeMetallama-3.1-8b-instant131,07232,678$0.05 / $0.08NoYes-Yes
HeliconeMetallama-3.1-8b-instruct16,38416,384$0.02 / $0.05NoYes-Yes
HeliconeMetallama-3.1-8b-instruct-turbo128,000128,000$0.02 / $0.03NoYes-Yes
Hugging FaceMetameta-llama/Llama-3.1-8B-Instruct131,0724,096$0.06 / $0.06NoYesYesYes
InferenceMetameta/llama-3.1-8b-instruct16,0004,096$0.025 / $0.025NoYes-Yes
Kilo GatewayMetameta-llama/llama-3.1-8b-instruct131,07216,384$0.02 / $0.04NoYesYesYes
KitaniMetameta-llama/llama-3.1-8b-instruct8,1924,096$0.049 / $0.0765NoYes-Yes
Merge GatewayMetameta/llama-3.1-8b-instruct128,0002,048$0.22 / $0.22NoYesNoYes
NanoGPTMetameta-llama/llama-3.1-8b-instruct131,07216,384$0.02 / $0.04NoYesNoYes
NeonMetameta-llama-3-1-8b-instruct131,0728,192$0.15 / $0.45NoYesYesYes
Novita AIMetameta-llama/llama-3.1-8b-instruct16,38416,384$0.02 / $0.05NoNoYesYes
OpenRouterMetameta-llama/llama-3.1-8b-instruct131,07216,384$0.02 / $0.04NoYesYesYes
PoeMetacerebras/llama-3.1-8b-cs128,0000$0.10 / $0.10NoYes-No
Vercel AI GatewayMetameta/llama-3.1-8b128,0008,192$0.22 / $0.22NoYes-Yes
ZeroGPUMetallama-3.1-8b-instruct-fast131,0728,192$0.15 / $0.28NoYesYesYes
No rows match the current search.

No rows match the current search.

Menu

Esc

Search

No matching results.

How to use

Models.dev is a comprehensive open-source database of AI model specifications, pricing, and features.

The homepage starts with provider-agnostic model metadata. Model pages list the providers serving that model; provider pages list every model available from that provider; lab pages group canonical models by author.

API

You can access provider data, provider-agnostic model metadata, or the combined catalog through JSON endpoints. Specialized model types are omitted by default; the site includes all model types.

Logos

Provider logos are available at /logos/{provider}.svg where {provider} is the provider ID. Lab logos are available at /logos/labs/{lab}.svg.

SDK

Use the SDK to query the API from your app. It's type-safe and exports the latest snapshot for offline use.

Contribute

The data is stored in GitHub as TOML files organized by provider and canonical model.