Skip to content
Projects

Ammaar-Alam/minebench has 341 GitHub stars and 24 forks. GitHot measured -1 stars in 24 hours. Last checked 2026-11-18 01:05 UTC. Last push 2026-11-12.

How these counts are measured

What you can do

  • Arena — blind head-to-head comparisons of pre-generated builds with confidence-aware ranking
  • Sandbox — compare existing builds, generate new ones, or import output from any model
  • Gallery — explore community prompts and keep signed-in generations
  • Leaderboard — live rankings with win/loss/draw stats across all models

Measured star growth

in 24h
-1
in 7 days
Collecting history
in 15 days
Collecting history
in 1 month
Collecting history

Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.

About

Minecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)

AI

README.md

Original

MineBench banner

Live Alpha Latest Release License: MIT

Docs Support MineBench on X

Download MineBench on the App Store

MineBench

A benchmark for evaluating AI spatial reasoning through Minecraft-style voxel construction.

Models are given a natural-language prompt and must produce raw 3D coordinates as JSON. In tool mode, models call voxel.exec (minimal primitives: block, box, line) to generate large builds beyond token-only JSON limits. MineBench visualizes the output and ranks models from blind head-to-head votes using a global Bradley-Terry model with uncertainty intervals.

Try it live

MineBench arena — Opus 4.5 versus Opus 4.6 MineBench default Arena landing page

[!Note] MineBench is not technically a 'benchmark' as it has no objectively correct answers; it is a take on the LMSYS Chatbot Arena. Many use MineBench to get the general feel or "vibe" of a model. AI labs may use MineBench to privately A/B test model checkpoints.

Why MineBench?

Most LLM benchmarks test text and raw accuracy. MineBench instead tests whether a model can reason about 3D space. Given a prompt like "a medieval castle with four towers", the model must mentally construct geometry, pick materials, and output thousands of precise block coordinates. No vision model or diffusion – just math and spatial logic.

As it turns out, this kind of spatial reasoning correlates strongly with a model's raw general intelligence; the MineBench leaderboard tracks, anecdotally, the same hierarchy that most people observe in real-world usage: the smartest reasoning models are clearly visible when asked to produce visual builds.

MineBench, unlike other benchmarks, gives an easy way to visually determine (at least one aspect of) a model's raw intelligence. The ranking system also highlights which models are clearly 'bench-maxed' (i.e. when a model has amazing benchmarks on paper, but clearly lacks in real world usage).

MineBench arena — two AI models building a medieval castle side-by-side

Features

  • Arena — blind head-to-head comparisons of pre-generated builds with confidence-aware ranking
  • Sandbox — compare existing builds, generate new ones, or import output from any model
  • Gallery — explore community prompts and keep signed-in generations
  • Leaderboard — live rankings with win/loss/draw stats across all models
  • Exports — save builds as GLB, STL, MagicaVoxel .vox, or WorldEdit .schem

Documentation

Frequently Asked Questions

The full FAQ is available at minebench.ai/faq. Every answer has a stable link for sharing or citation.

About MineBench

Methodology

Using MineBench

Supported Models

MineBench currently benchmarks models from OpenAI, Anthropic, Google, Moonshot, DeepSeek, MiniMax, xAI, Z.AI, Qwen, Meta, and any model available through OpenRouter.

MineBench leaderboard showing model rankings

Quick Start (Local)

This path lets you run the full app and compare existing builds from uploads/ without generating new ones.

Prereqs: Node.js 18+, pnpm, Docker.

pnpm install
cp .env.example .env
pnpm dev:setup

In a second terminal:

pnpm prompt --import

Then open:

  • http://localhost:3000/ (Arena)
  • http://localhost:3000/sandbox
  • http://localhost:3000/leaderboard

For environment variables, live generation, seeding/import workflows, batch generation, API routes, troubleshooting, and deployment, see the docs:

Sponsors

A huge thank you to the sponsors helping make MineBench possible:

  • 3D-Agent
    • AI-powered tools for Blender and 3D workflows
    • 10% off with code MINEBENCH10
  • OpenAI
  • Anthropic
  • Google DeepMind
  • Z.ai
  • Moonshot AI

Their support, including API credits, helps fund MineBench evaluations. If you would like to support MineBench yourself, you can support us here.

Contributing

Contributions are welcome! See CONTRIBUTING.md for how to add new models, submit benchmark prompts, improve the UI, or fix bugs.

Licenses

MIT

Texture pack: Faithful (see assets/texture-pack/LICENSE.txt)

Inspired by MC-Bench and VoxelBench