Mixtral-8x7B-Instruct-v0.1: Context & Attention Heads

Publisher-sourced inventory. Specifications come from official documentation and model cards. “Not documented” means we have no verified value. This inventory is separate from our editorial reviews.

Coverage & sources ↗

The short answer

Context and architecture

Context window: 32,000 tokensDocumented context Source
Attention heads: 32num_attention_heads
Key/value heads: 8num_key_value_heads
Hidden layers: 32num_hidden_layers

Attention-head and layer counts come from the Pinned configuration. The checkpoint separately records max_position_embeddings=32,768; this is not an independent API allowance or tested usable context. The same file explicitly sets sliding_window to null; this does not establish unlimited context.

The catalog marks the publisher's API listing as retired; downloadable weights are a separate access route. Source

Catalog record checked October 23, 2026. Context details · Checkpoint and sources

Current catalog answers

What to know about Mixtral-8x7B-Instruct-v0.1

AI-compiled from linked model documentation. This is a catalog reference, not an independent performance review. Catalog checked October 23, 2026.

Which Mixtral-8x7B-Instruct-v0.1 does this page describe?

Mixtral-8x7B-Instruct-v0.1 is a model record from Mistral AI in the Mixtral family. Source

The recorded model identifier or checkpoint is 0.1. Use that exact identifier when checking documentation or a provider listing. Source

How can you access Mixtral-8x7B-Instruct-v0.1?

The catalog records the historical API and Open weights access route for Mixtral-8x7B-Instruct-v0.1. Source

As of the catalog check, this version was marked retired. Source Check the linked lifecycle information before starting a new integration.

For a new integration, use the publisher’s replacement guidance and check its current account, region and endpoint requirements. Historical API access does not mean the retired endpoint can still be called.

Open weights means the model weights are distributed for use under their stated terms. It does not establish a hosted API, an open-source license, or a hardware requirement. This record documents API access separately.

What are Mixtral-8x7B-Instruct-v0.1's context and output limits?

The documented context window is 32,000 tokens. Source

A separate maximum-output value is not established in this record. The context or input figure should not be used as an output allowance.

Context, input and output limits describe different constraints. Do not add the figures together to infer a larger window. Check the endpoint's accounting for conversation history, system instructions, tools, media and generated tokens; a documented maximum is not a guarantee of answer quality or a measured usable capacity.

What dates are documented for Mixtral-8x7B-Instruct-v0.1?

Release date: December 11, 2023. Source This is a release milestone, not a knowledge or training cutoff. The source labels this “Release date on Mistral model specification.”

Neither a knowledge cutoff nor a training-data cutoff is established here. A release date, repository upload or filename cannot supply those missing dates.

What license is recorded for Mixtral-8x7B-Instruct-v0.1?

The recorded license label is Apache 2.0. Source

Read the linked license and associated use terms for this exact version before redistribution, commercial deployment or fine-tuning. A label alone does not establish every permission, restriction or obligation, and it does not determine the terms of a separate hosted service.

What is documented about the Mixtral-8x7B-Instruct-v0.1 checkpoint?

This evidence refers to mistralai/Mixtral-8x7B-Instruct-v0.1 at recorded revision eba92302a2861cdc0098cc54bc9f17cb2c47eb61, checked October 23, 2026. Repository metadata

Safetensors metadata records 46,702,792,704 stored parameters. This is a stored-weight count, not necessarily the number activated per token, a download size or a GPU-memory requirement. Repository metadata

Recorded architecture class: MixtralForCausalLM. Repository metadata

Listed library: vllm. Check that library's version and model support before loading the weights. Repository metadata

Repository language labels: fr, it, de, es, and en. These labels are not independent evaluations of language quality. Repository metadata

Repository access gate: false. This records the repository's gate setting when checked; licensing and use terms still apply. Repository metadata

What the configuration file says

The pinned config.json contains these values. Pinned configuration Configuration verified 2026-10-26.

max_position_embeddings: 32,768
sliding_window: null
torch_dtype: bfloat16
num_attention_heads: 32
num_key_value_heads: 8
num_hidden_layers: 32
hidden_size: 4,096

Configuration values describe the checkpoint and its implementation. In particular, max_position_embeddings, sliding_window and rope_scaling do not independently establish an API context limit, tested usable length or hardware requirement. Runtime, quantization, cache, batch size and input length affect deployment behavior.

The explicit null is a recorded configuration value, not missing evidence. It does not establish unlimited context.

Read the retrieved model card for setup and qualifications. Model card

Keep the exact version in view

Other Mixtral models from Mistral AI.

These are separate records in the same publisher family. A shared family name does not establish equal capabilities or interchangeable licenses.

Mixtral-8x22B-Instruct-v0.1

API · Open weights · 64,000 context tokens

Mixtral-8x22B-v0.1

Open weights

Mixtral-8x7B-v0.1

Open weights

The documented record

Specifications, with their sources.

A missing value remains unknown. Input limits, output limits and the total context window are separate measurements.

Publisher: Mistral AISource ↗
Family: MixtralSource ↗
Version: 0.1Source ↗
Availability: RetiredSource ↗
Access: API · Open weightsSource ↗
Inputs: Not documented
Outputs: Not documented
Context window: 32,000 tokensSource ↗
Maximum input: Not documented
Maximum output: Not documented
Knowledge cutoff: Not documented
Training-data cutoff: Not documented
Training completed: Not documented
Release date: Dec 11, 2023Release date on Mistral model specification · day precisionSource ↗
License: Apache 2.0Source ↗
Input price / 1M tokens: Not documented
Output price / 1M tokens: Not documented

Read this with the numbers.

Official publisher model repository; listed status confirms a catalog entry, not a verified hosted API service. Lifecycle status refers to the Mistral API; publicly listed weights may remain usable under their license. Mistral context shorthand 32k is represented in nominal decimal tokens. Publisher repository evidence (2026-10-23): Published architecture metadata: MixtralForCausalLM. Repository library label: vllm. Model-card language labels: fr, it, de, es, en; these labels are not evaluated proficiency scores. Published safetensors metadata counts 46,702,792,704 stored parameters; this is not an active-parameter count for mixture-of-experts models. Published configuration: max_position_embeddings=32768; dtype=bfloat16; 32 hidden layers. Checkpoint configuration is not a verified hosted serving limit; context and output limits remain separate documented fields.

Model identifiers and aliases 1

mistralai/Mixtral-8x7B-Instruct-v0.1

Follow the evidence

Official sources.

Mixtral 8x7B specifications ↗docs.mistral.ai
Mixtral-8x7B-Instruct-v0.1 — official model card ↗huggingface.co
Mixtral-8x7B-Instruct-v0.1: official publisher repository metadata ↗huggingface.co
Mixtral-8x7B-Instruct-v0.1: publisher model card at revision eba92302a286 ↗huggingface.co
Mixtral-8x7B-Instruct-v0.1: published checkpoint configuration at revision eba92302a286 ↗huggingface.co

From the Headless Thrones newsroom

Editorial about Mixtral-8x7B-Instruct-v0.1

No published articles are linked to this exact model yet. New coverage will appear here as it is published.

Your starting point

Mixtral-8x7B-Instruct-v0.1

Mistral AI · API / Open weights

Browse all models ↗

Inputs: Not documented
Outputs: Not documented
Context window: 32,000 tokensSource ↗
Knowledge cutoff: Not documented

A place to begin comparing

0 models to consider.

Matches must share an access route, support every documented input type of your starting model, and return text. When both publish a context limit in the same field, the candidate must fall between half and twice that limit. Unknown or differently defined limits remain as broader matches, after verified near-context matches. Within each group, recent documented releases appear first. These criteria do not establish equal quality. The full current inventory is considered.

No candidate meets the documented access, input/output and context criteria. You can still choose models manually in the comparison tool.

A record you can follow

The source belongs beside the fact.

Official sources

Model records cite the developer’s documentation, release notes and model cards. A listing alone is not a tested service or a recommendation.

Dates mean different things

Knowledge cutoff, training-data cutoff, training completion and release date are separate fields. A model’s name or repository upload date does not establish any of them.

Limits need context

Some publishers use rounded K/M token figures. Deployment, reasoning settings and regional access can change usable limits. Read the source before choosing.

Coverage and last check

Independent editorial model library assembled from primary vendor documentation and official publisher model cards. This is a dated, auditable inventory of the sources reviewed, not a claim to every model worldwide. First-party language-model inventory for OpenAI, Anthropic, Google Gemini/Gemma, xAI, Meta and Reflection. Includes vendor-listed legacy/retired identities with explicit statuses; official pretrained and instruction-tuned checkpoints remain distinct. Excludes embeddings, moderation/guard models, image/audio/video-only generation, community fine-tunes, speculative draft helpers, format/runtime/quantization duplicates, and PaliGemma dataset-specific benchmark fine-tunes. Availability means documented vendor API or downloadable official weights, not guaranteed account eligibility. Unknown specifications and dates remain null. Rounded K/M limits preserve vendor granularity; exact integers are used only where documented. No OpenRouter facts are used. Primary-source inventory of language-capable models from Alibaba/Qwen, DeepSeek, Moonshot, MiniMax, Z.ai, ByteDance Seed, Tencent, Baidu, Xiaomi, StepFun, 01.AI, Shanghai AI Laboratory, Baichuan and OpenBMB. Includes full reachable official public weight inventories plus documented hosted API models and explicit retirements. Embeddings, reward/classifier/router/tokenizer/draft-head components, standalone OCR/document converters and image/video/audio-only generators are excluded; multimodal language models retained. Official packaging variants are folded into aliases where a canonical listing was identifiable; remaining research/base/SFT variants retain exact identities. Not a guarantee every historical/private/regional model is available. Unknown specifications remain null; K/M API display quantities use decimal normalization where explicitly noted, rather than implying verified exact serving ceilings. Model-name dates and repository creation timestamps are never used as release/training dates. Open weights does not mean unrestricted or OSI-open-source licensing. Some model-card bodies were unreachable; their public inventory metadata is retained and disclosed. Official Mistral, Cohere, AI21, NVIDIA Nemotron, Microsoft Phi/MAI, Amazon Nova, IBM Granite, AllenAI OLMo/Molmo, TII Falcon, Nous Research, Arcee and Essential AI model inventory checked 2026-10-23. Includes base, instruction, reasoning, coding and text-producing multimodal models, including legacy API versions. Excludes embeddings/rerankers/reward and safety classifiers, image/audio/video-only generation, robotics-only models, duplicate quantization/runtime packages, adapters, intermediate checkpoint experiments, and third-party mirrors. Arcee coverage focuses on its named product families rather than exploratory merge repositories. Repository listing means listed, not independently verified API availability. K/M figures are nominal decimal normalizations when the source supplies shorthand; deployment-specific exact token limits may differ. Unverified values remain null. This is a source-backed inventory, not a complete claim-level independent editorial review. Supplemental official Liquid AI, Reka and Inception generative language catalog. Excludes media-only generators and decision/classification-only models. No assumed training dates.

Catalog edition updated Oct 23, 2026. Source links are provided on each model record.

View the full coverage report and discovery sources ↗