# Mixtral-8x7B-v0.1

[Canonical model page](https://headlessthrones.com/models/mistral-ai-mixtral-8x7b-v0-1) · [Model library](https://headlessthrones.com/models)

Public catalog reference from Headless Thrones. Exact catalog ID: `mistral-ai-mixtral-8x7b-v0-1`. Catalog source-check date: 2026-10-23.

This brief contains the public catalog answers and any catalog guide, not private drafts, historical editorial revisions or independently measured rankings. The canonical HTML page may also display separately published editorial.

The short answer

## Context and architecture

Context window: 32k tokens
Publisher notation  [Source](https://mistral.ai/news/mixtral-of-experts/)

Attention heads: 32
num\_attention\_heads

Key/value heads: 8
num\_key\_value\_heads

Hidden layers: 32
num\_hidden\_layers

Attention-head and layer counts come from the [Pinned configuration](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1/resolve/fc7ac94680e38d7348cfa806e51218e6273104b0/config.json). The checkpoint separately records `max_position_embeddings=32,768`; this is not an independent API allowance or tested usable context. The same file explicitly sets `sliding_window` to `null`; this does not establish unlimited context.

Catalog record checked October 23, 2026. [Context details](https://headlessthrones.com/models/mistral-ai-mixtral-8x7b-v0-1#model-answer-context) · [Checkpoint and sources](https://headlessthrones.com/models/mistral-ai-mixtral-8x7b-v0-1#model-answer-repository)

Current catalog answers

## What to know about Mixtral-8x7B-v0.1

AI-compiled from linked model documentation. This is a catalog reference, not an independent performance review. Catalog checked October 23, 2026.

[Exact model](https://headlessthrones.com/models/mistral-ai-mixtral-8x7b-v0-1#model-answer-identity) · [Access](https://headlessthrones.com/models/mistral-ai-mixtral-8x7b-v0-1#model-answer-access) · [Token limits](https://headlessthrones.com/models/mistral-ai-mixtral-8x7b-v0-1#model-answer-context) · [Inputs &amp; outputs](https://headlessthrones.com/models/mistral-ai-mixtral-8x7b-v0-1#model-answer-modalities) · [License](https://headlessthrones.com/models/mistral-ai-mixtral-8x7b-v0-1#model-answer-license) · [Model details](https://headlessthrones.com/models/mistral-ai-mixtral-8x7b-v0-1#model-answer-research) · [Weight details](https://headlessthrones.com/models/mistral-ai-mixtral-8x7b-v0-1#model-answer-repository)

### Which Mixtral-8x7B-v0.1 does this page describe?

Mixtral-8x7B-v0.1 is a model record from **Mistral AI** in the Mixtral family. [Source](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1)

A separate version identifier is not documented in this record; the model name alone does not establish which snapshot a service runs.

### How can you access Mixtral-8x7B-v0.1?

The catalog documents **Open weights** access  for Mixtral-8x7B-v0.1. [Source](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1)

As of the catalog check, this version was listed without confirmed general availability. [Source](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1)

Open weights means the model weights are distributed for use under their stated terms. It does not establish a hosted API, an open-source license, or a hardware requirement.

### What are Mixtral-8x7B-v0.1's context and output limits?

The publisher reports the context window as **32k tokens**. [Source](https://mistral.ai/news/mixtral-of-experts/) We retain the publisher's notation and qualifiers; no exact token count or hosted serving allowance is inferred from it.

A separate maximum-output value is not established in this record. The context or input figure should not be used as an output allowance.

Context, input and output limits describe different constraints. Do not add the figures together to infer a larger window. Check the endpoint's accounting for conversation history, system instructions, tools, media and generated tokens; a documented maximum is not a guarantee of answer quality or a measured usable capacity.

### What can Mixtral-8x7B-v0.1 receive and generate?

Documented inputs: **Text**. [Source](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1/resolve/fc7ac94680e38d7348cfa806e51218e6273104b0/README.md)

Documented outputs: **Text**. [Source](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1/resolve/fc7ac94680e38d7348cfa806e51218e6273104b0/README.md)

Input support and output generation are separate capabilities. Reading an image does not establish image generation; a text output listing does not establish speech output. File sizes, formats and media limits depend on the documented implementation.

### What license is recorded for Mixtral-8x7B-v0.1?

The recorded license label is **apache-2.0**. [Source](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1)

Read the linked license and associated use terms for this exact version before redistribution, commercial deployment or fine-tuning. A label alone does not establish every permission, restriction or obligation, and it does not determine the terms of a separate hosted service.

### What distinguishes Mixtral-8x7B-v0.1?

These details come from the linked publisher material for this model. Reported capabilities and training descriptions are publisher statements, not independent test results.

**Training stage and architecture**: Pretrained generative sparse mixture-of-experts checkpoint. [Source](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1/resolve/fc7ac94680e38d7348cfa806e51218e6273104b0/README.md)

**Checkpoint packaging**: Repository repackages the original released weights for compatible inference libraries; packaging and parameter names differ from the torrent format. [Source](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1/resolve/fc7ac94680e38d7348cfa806e51218e6273104b0/README.md)

**Nominal active and total parameters**: Sparse mixture-of-experts model with 12.9 billion active and 46.7 billion total parameters. [Source](https://mistral.ai/news/mixtral-of-experts/)

### What is documented about the Mixtral-8x7B-v0.1 checkpoint?

This evidence refers to `mistralai/Mixtral-8x7B-v0.1` at recorded revision `fc7ac94680e38d7348cfa806e51218e6273104b0`, checked October 23, 2026. [Repository metadata](https://huggingface.co/api/models/mistralai/Mixtral-8x7B-v0.1)

Safetensors metadata records **46,702,792,704 stored parameters**. This is a stored-weight count, not necessarily the number activated per token, a download size or a GPU-memory requirement. [Repository metadata](https://huggingface.co/api/models/mistralai/Mixtral-8x7B-v0.1)

Recorded architecture class: `MixtralForCausalLM`. [Repository metadata](https://huggingface.co/api/models/mistralai/Mixtral-8x7B-v0.1)

Listed library: `vllm`. Check that library's version and model support before loading the weights. [Repository metadata](https://huggingface.co/api/models/mistralai/Mixtral-8x7B-v0.1)

Repository language labels: fr, it, de, es, and en. These labels are not independent evaluations of language quality. [Repository metadata](https://huggingface.co/api/models/mistralai/Mixtral-8x7B-v0.1)

Repository access gate: `false`. This records the repository's gate setting when checked; licensing and use terms still apply. [Repository metadata](https://huggingface.co/api/models/mistralai/Mixtral-8x7B-v0.1)

#### What the configuration file says

The pinned `config.json` contains these values. [Pinned configuration](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1/resolve/fc7ac94680e38d7348cfa806e51218e6273104b0/config.json) Configuration verified 2026-10-26.

`max_position_embeddings`: 32,768

`sliding_window`: null

`torch_dtype`: bfloat16

`num_attention_heads`: 32

`num_key_value_heads`: 8

`num_hidden_layers`: 32

`hidden_size`: 4,096

Configuration values describe the checkpoint and its implementation. In particular, max\_position\_embeddings, sliding\_window and rope\_scaling do not independently establish an API context limit, tested usable length or hardware requirement. Runtime, quantization, cache, batch size and input length affect deployment behavior.

The explicit null is a recorded configuration value, not missing evidence. It does not establish unlimited context.

Read the retrieved model card for setup and qualifications. [Model card](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1/resolve/fc7ac94680e38d7348cfa806e51218e6273104b0/README.md)

**Catalog qualifications:** Official publisher model repository; listed status confirms a catalog entry, not a verified hosted API service. [Source 1](https://huggingface.co/api/models/mistralai/Mixtral-8x7B-v0.1) · [Source 2](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1/resolve/fc7ac94680e38d7348cfa806e51218e6273104b0/README.md) · [Source 3](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1/resolve/fc7ac94680e38d7348cfa806e51218e6273104b0/config.json)

**Evidence still missing here:** knowledge and training-data cutoffs and tested hardware requirements. Missing documentation is not evidence that a feature is unavailable.

Headless Thrones has not independently benchmarked this model for this reference. Evaluate it on representative work before choosing it; these facts do not rank its accuracy, reliability, speed or suitability against another model.

Keep the exact version in view

## Other Mixtral models from Mistral AI.

These are separate records in the same publisher family. A shared family name does not establish equal capabilities or interchangeable licenses.

### [Mixtral-8x22B-Instruct-v0.1](https://headlessthrones.com/models/mistral-ai-mixtral-8x22b-instruct-v0-1)

API · Open weights · 64,000 context tokens

### [Mixtral-8x7B-Instruct-v0.1](https://headlessthrones.com/models/mistral-ai-mixtral-8x7b-instruct-v0-1)

API · Open weights · 32,000 context tokens

### [Mixtral-8x22B-v0.1](https://headlessthrones.com/models/mistral-ai-mixtral-8x22b-v0-1)

Open weights
