Grok-1

LLM

xAI first open-source model with 314 billion parameters. Mixture of Experts architecture (8 experts, 2 active per token), 64 layers. Released under Apache 2.0 in March 2024.

Technical specification

Context window

Parameters

License

Apache-2.0

Tools

Fine-tuning

Weights access

Open source

Last updated: May 2, 2026

Modalities

Input

Text

Output

Text

Capabilities

Reasoning★

Reasoning

Coding★

Coding

Multilingual★

Language

Architecture and technologies

Core Architecture

Sources

Repository2Website1Link1

xai-org/grok-1 GitHub – Model Specifications

github.comRepository

xai-org/grok-1 on Hugging Face

huggingface.coRepository

Wikipedia – Grok (chatbot) #Grok-1

en.wikipedia.orgWebsite

The Verge – Elon Musk's xAI releases Grok base model (Mar 17, 2024)

theverge.comLink

Grok-1Grok-1Grok-1