# OmniLMM-12B

[Canonical model page](https://headlessthrones.com/models/openbmb-omnilmm-12b) · [Model library](https://headlessthrones.com/models)

Public catalog reference from Headless Thrones. Exact catalog ID: `openbmb-omnilmm-12b`. Catalog source-check date: 2026-10-23.

This brief contains the public catalog answers and any catalog guide, not private drafts, historical editorial revisions or independently measured rankings. The canonical HTML page may also display separately published editorial.

Current catalog answers

## What to know about OmniLMM-12B

AI-compiled from linked model documentation. This is a catalog reference, not an independent performance review. Catalog checked October 23, 2026.

[Exact model](https://headlessthrones.com/models/openbmb-omnilmm-12b#model-answer-identity) · [Access](https://headlessthrones.com/models/openbmb-omnilmm-12b#model-answer-access) · [Inputs &amp; outputs](https://headlessthrones.com/models/openbmb-omnilmm-12b#model-answer-modalities) · [License](https://headlessthrones.com/models/openbmb-omnilmm-12b#model-answer-license) · [Model details](https://headlessthrones.com/models/openbmb-omnilmm-12b#model-answer-research) · [Weight details](https://headlessthrones.com/models/openbmb-omnilmm-12b#model-answer-repository)

### Which OmniLMM-12B does this page describe?

OmniLMM-12B is a model record from **OpenBMB** in the OmniLMM family. [Source](https://huggingface.co/openbmb/OmniLMM-12B)

The recorded model identifier or checkpoint is `OmniLMM-12B`. Use that exact identifier when checking documentation or a provider listing. [Source](https://huggingface.co/openbmb/OmniLMM-12B)

### How can you access OmniLMM-12B?

The catalog documents **Open weights** access  for OmniLMM-12B. [Source](https://huggingface.co/openbmb/OmniLMM-12B)

As of the catalog check, this version was listed as available. [Source](https://huggingface.co/openbmb/OmniLMM-12B)

Open weights means the model weights are distributed for use under their stated terms. It does not establish a hosted API, an open-source license, or a hardware requirement.

### What can OmniLMM-12B receive and generate?

Documented inputs: **text and image**. [Source](https://huggingface.co/openbmb/OmniLMM-12B)

Documented outputs: **text**. [Source](https://huggingface.co/openbmb/OmniLMM-12B)

Input support and output generation are separate capabilities. Reading an image does not establish image generation; a text output listing does not establish speech output. File sizes, formats and media limits depend on the documented implementation.

### What license is recorded for OmniLMM-12B?

The recorded license label is **General Model License Agreement (model weights); Apache 2.0 (code)**. [Source](https://huggingface.co/openbmb/OmniLMM-12B/resolve/d2e9c9d619a0b34f06f0b65d2eae9ed1af1124a9/README.md)

Read the linked license and associated use terms for this exact version before redistribution, commercial deployment or fine-tuning. A label alone does not establish every permission, restriction or obligation, and it does not determine the terms of a separate hosted service.

### What distinguishes OmniLMM-12B?

These details come from the linked publisher material for this model. Reported capabilities and training descriptions are publisher statements, not independent test results.

**Alignment method**: Multimodal RLHF using the RLHF-V technique. [Source](https://huggingface.co/openbmb/OmniLMM-12B/resolve/d2e9c9d619a0b34f06f0b65d2eae9ed1af1124a9/README.md)

**Model composition**: EVA02-5B and Zephyr-7B-β connected by a perceiver resampler, with curriculum multimodal training. [Source](https://huggingface.co/openbmb/OmniLMM-12B/resolve/d2e9c9d619a0b34f06f0b65d2eae9ed1af1124a9/README.md)

### What is documented about the OmniLMM-12B checkpoint?

This evidence refers to `openbmb/OmniLMM-12B` at recorded revision `d2e9c9d619a0b34f06f0b65d2eae9ed1af1124a9`, checked October 23, 2026. [Repository metadata](https://huggingface.co/api/models/openbmb/OmniLMM-12B)

Recorded architecture class: `OmniLMMForCausalLM`. [Repository metadata](https://huggingface.co/api/models/openbmb/OmniLMM-12B)

Repository task tag: `visual-question-answering`. A task tag identifies a distribution category; it does not measure performance on that task. [Repository metadata](https://huggingface.co/api/models/openbmb/OmniLMM-12B)

Listed library: `transformers`. Check that library's version and model support before loading the weights. [Repository metadata](https://huggingface.co/api/models/openbmb/OmniLMM-12B)

Repository access gate: `false`. This records the repository's gate setting when checked; licensing and use terms still apply. [Repository metadata](https://huggingface.co/api/models/openbmb/OmniLMM-12B)

#### What the configuration file says

The pinned `config.json` contains these values. [Pinned configuration](https://huggingface.co/openbmb/OmniLMM-12B/resolve/d2e9c9d619a0b34f06f0b65d2eae9ed1af1124a9/config.json)

`max_position_embeddings`: 32,768

`sliding_window`: 4,096

`torch_dtype`: bfloat16

`num_attention_heads`: 32

`num_key_value_heads`: 8

`num_hidden_layers`: 32

`hidden_size`: 4,096

Configuration values describe the checkpoint and its implementation. In particular, max\_position\_embeddings, sliding\_window and rope\_scaling do not independently establish an API context limit, tested usable length or hardware requirement. Runtime, quantization, cache, batch size and input length affect deployment behavior.

Read the retrieved model card for setup and qualifications. [Model card](https://huggingface.co/openbmb/OmniLMM-12B/resolve/d2e9c9d619a0b34f06f0b65d2eae9ed1af1124a9/README.md)

**Catalog qualifications:** Official publisher weight listing; availability refers to this distribution, not a guaranteed hosted API. Base, SFT and research variants are identified by their exact published names. [Source 1](https://huggingface.co/openbmb/OmniLMM-12B) · [Source 2](https://huggingface.co/api/models/openbmb/OmniLMM-12B) · [Source 3](https://huggingface.co/openbmb/OmniLMM-12B/resolve/d2e9c9d619a0b34f06f0b65d2eae9ed1af1124a9/README.md) · [Source 4](https://huggingface.co/openbmb/OmniLMM-12B/resolve/d2e9c9d619a0b34f06f0b65d2eae9ed1af1124a9/config.json)

**Evidence still missing here:** context or input capacity, knowledge and training-data cutoffs, and tested hardware requirements. Missing documentation is not evidence that a feature is unavailable.

Headless Thrones has not independently benchmarked this model for this reference. Evaluate it on representative work before choosing it; these facts do not rank its accuracy, reliability, speed or suitability against another model.
