Aiqre

Model library / Gryphe

Pantheon-Reasoning-26B-A4B-1.1-V2

Pantheon-Reasoning-26B-A4B-1.1-V2 is a 26.5 billion-parameter Gemma-4 mixture-of-experts finetune aimed at role-play scenarios, incorporating full reasoning traces to improve character planning and narrative coherence.

26.5B

Mixture of experts, count not published

262,144

Context length in tokens, as published

49 GiB

Weights at the released precision

apache-2.0

Licence declared on the repository

Overview

What this model is.

Pantheon-Reasoning-26B-A4B-1.1-V2 is a 26.5 billion-parameter Gemma-4 mixture-of-experts model released by Gryphe. It is fine-tuned for role-play applications, using full reasoning traces to help the model plan character responses and narrative direction.

Deployers receive a 26.5 billion-parameter model stored in bfloat16, licensed under Apache-2.0, with a 262 k token context window. It uses a Gemma-4 MoE architecture, though the exact expert count is not disclosed. Training mixes roughly 26 % Pantheon role-play, 36 % general role-play and 38 % text-adventure data, all augmented with back-generated reasoning traces.

Specification

The published shape.

RepositoryGryphe/Pantheon-Reasoning-26B-A4B-1.1-V2
PublisherGryphe
Published8 September 2026
ArchitectureGemma4ForConditionalGeneration
Model typegemma4
Parameters26,544,131,376
Layers30
Hidden size2,816
Attention heads16, 8 key/value heads
Context length262,144 tokens
Vocabulary262,144 tokens
Weight formatbfloat16
Licenceapache-2.0
Base modelGryphe/Gemma-4-26B-A4B-StyleTune-V2

Memory

How much VRAM the weights need.

Parameter count multiplied by the bytes each format uses. The key-value cache comes on top.

PrecisionWeightsNotes
bf1649.4 GiBFull precision as released
fp824.7 GiB8-bit, near-lossless on most models
int412.4 GiB4-bit, smallest footprint

The cache costs 240 KiB per token at 16-bit, so the full 262,144-token context of one request needs about 60.0 GiB. Concurrency multiplies that number, not the weights.

That figure is an upper bound: this model uses sliding-window attention with a 1,024-token window on some layers, so long requests cache less than this.

Hardware

Which card runs it.

At the released precision, with 90% of the card given to the server and 2.5 GiB kept for the runtime. The context column is what is left for the cache on that setup.

GPUCards neededFree for cacheContext it holds
RTX 4090 24GB 4 27.0 GiB about 117,779 tokens
RTX 5090 32GB 2 3.2 GiB about 13,796 tokens
L40S 48GB 2 32.0 GiB about 139,625 tokens
A100 80GB 1 20.1 GiB about 87,633 tokens
H100 80GB 1 20.1 GiB about 87,633 tokens
RTX PRO 6000 96GB 1 34.5 GiB about 150,547 tokens
H200 141GB 1 75.0 GiB the full 262,144 tokens

Serving

Running it yourself.

A vLLM launch line for the shape above. Check the model card for a runtime the publisher recommends.

vllm serve Gryphe/Pantheon-Reasoning-26B-A4B-1.1-V2 \
  --max-model-len 114688 \
  --gpu-memory-utilization 0.90

Questions

The things people ask about this model.

How much GPU memory does Pantheon-Reasoning-26B-A4B-1.1-V2 need?

The weights take about 49 GiB at the released precision. That fits on one A100 80GB, which leaves roughly 20 GiB for the key-value cache.

What licence does Pantheon-Reasoning-26B-A4B-1.1-V2 use?

The repository declares apache-2.0. Read the licence text before commercial use: the name alone does not tell you what is allowed.

How long a context does it support?

The configuration allows 262,144 tokens. Whether the whole window is usable depends on the memory left for the cache, which the hardware table works out per card.

Can I use it through an API instead of hosting it?

This page is a reference, and Aiqre does not serve this model today. We deploy open-weight models on dedicated EU hardware on request, so if you want an OpenAI-compatible endpoint for it, email [email protected] with the model name and roughly what volume you expect.

Also in the library

Related models.

nex-agi/Nex-N2.5-mini

Nex-N2.5-mini is a 35.1 billion-parameter mixture-of-experts language model released under Apache-2.0.

inclusionAI/LLaDA2.2-mini

LLaDA2.2-mini is a 16.3 billion-parameter MoE diffusion language model with 128 k token context, supporting Levenshtein editing.

IFM/K2-Horizon-32B

K2-Horizon-32B-Stage1 is a 32-billion-parameter dense decoder-only model released by IFM for benchmarking agentic, coding and rea…

IFM/K2-Horizon-MoVA-36B-A4B

K2-Horizon-MoVA-36B-A4B is a sparse Mixture-of-Experts language model with MoVA attention, released by IFM.

Hosting

Want this model on a dedicated EU GPU?

Tell us the model and roughly what volume you expect. We reply with a price and an OpenAI-compatible endpoint, with your prompts never stored.