OLMo-7B-0424

Which OLMo-7B-0424 does this page describe?

OLMo-7B-0424 is a model record from Allen Institute for AI in the OLMo family. Source

A separate version identifier is not documented in this record; the model name alone does not establish which snapshot a service runs.

How can you access OLMo-7B-0424?

The catalog documents Open weights access for OLMo-7B-0424. Source

As of the catalog check, this version was listed without confirmed general availability. Source

Open weights means the model weights are distributed for use under their stated terms. It does not establish a hosted API, an open-source license, or a hardware requirement.

What are OLMo-7B-0424's context and output limits?

The documented context window is 4,096 tokens. Source

A separate maximum-output value is not established in this record. The context or input figure should not be used as an output allowance.

Context, input and output limits describe different constraints. Do not add the figures together to infer a larger window. Check the endpoint's accounting for conversation history, system instructions, tools, media and generated tokens; a documented maximum is not a guarantee of answer quality or a measured usable capacity.

What dates are documented for OLMo-7B-0424?

Training-data cutoff: October 2023. Source This describes the reported data boundary, not the day training finished. The source labels this “- Date cutoff: Oct. 2023, with most data from Feb./March 2023 based on Dolma dataset version..”

Retrieval or web tools can supply newer information at run time. That does not change the model's recorded training or knowledge dates, and this record does not establish that a particular endpoint includes those tools.

What can OLMo-7B-0424 receive and generate?

Documented inputs: text. Source

Documented outputs: text. Source

Input support and output generation are separate capabilities. Reading an image does not establish image generation; a text output listing does not establish speech output. File sizes, formats and media limits depend on the documented implementation.

What license is recorded for OLMo-7B-0424?

The recorded license label is apache-2.0. Source

Read the linked license and associated use terms for this exact version before redistribution, commercial deployment or fine-tuning. A label alone does not establish every permission, restriction or obligation, and it does not determine the terms of a separate hosted service.

What distinguishes OLMo-7B-0424?

These details come from the linked publisher material for this model. Reported capabilities and training descriptions are publisher statements, not independent test results.

Exact checkpoint training

Training: 2.05 Trillion tokens. Architecture: 32 layers, 4096 hidden size and 32 attention heads; 4096-token context. Source

Data improvements

Uses the April 2024 Dolma mixture with more sources, improved deduplication and quality filtering; annealing uses a higher-quality subset. Source

What is documented about the OLMo-7B-0424 checkpoint?

This evidence refers to allenai/OLMo-7B-0424 at recorded revision e355fc27a90971676462d358c22619cfd68f9504, checked October 23, 2026. Repository metadata

Recorded architecture class: OLMoForCausalLM. Repository metadata

Repository task tag: text-generation. A task tag identifies a distribution category; it does not measure performance on that task. Repository metadata

Listed library: transformers. Check that library's version and model support before loading the weights. Repository metadata

Repository language labels: en. These labels are not independent evaluations of language quality. Repository metadata

Repository access gate: false. This records the repository's gate setting when checked; licensing and use terms still apply. Repository metadata

Read the retrieved model card for setup and qualifications. Model card