Rabdos AI

Rabdos Lean Bench

40 problems · Updated on August 5, 2026

Frontier models formalize graduate-level math theorems in Lean, and a semantic, rubric-based checker judges whether the proof actually holds.

Leaderboard, ranked by average score.
RankProviderModelReasoning effortRubricStrict
1AnthropicClaude Opus 5max57.5%6/40 (15.0%)
2AnthropicClaude Fable 5max48.9%3/40 (7.5%)
3OpenAIGPT-5.6 Solmax43.6%2/40 (5.0%)
4Moonshot AIKimi K3max34.6%1/40 (2.5%)
5xAIGrok 4.5xhigh25.8%1/40 (2.5%)
6GoogleGemini 3.6 Flashhigh22.7%1/40 (2.5%)
7MetaMuse Spark 1.1xhigh17.8%1/40 (2.5%)
8Z.aiGLM 5.2xhigh14.6%0/40 (0.0%)
9NVIDIANemotron 3 Ultrahigh1.2%0/40 (0.0%)

Sample theorems to formalize

Weyl character triangularity

Representation theory

For any λX(T)+\lambda \in X(T)_+,

chL(λ)=e(λ)+μ<λdimL(λ)μe(μ).\operatorname{ch} L(\lambda)=e(\lambda)+\sum_{\mu<\lambda}\dim L(\lambda)_\mu\,e(\mu).

Selected rubric checkpoints

R1

The statement is interpreted for a split connected reductive algebraic group G over a field k, with a split maximal torus T of G and a chosen positive-root system for (G,T).

R2

The admissibility condition on λ\lambda is precisely that it is a dominant character of T, λX(T)+\lambda\in X(T)_+, with dominance computed from the chosen positive roots.

R4

For every dominant λ\lambda, the exact module whose character occurs in the formula is the contextually defined canonical module L(λ)=socGH0(λ)L(\lambda)=\operatorname{soc}_G H^0(\lambda), or a module definitionally equal, isomorphic, or otherwise proved equivalent to that object in a way that preserves its T-weight spaces. A canonical socle construction, including the supremum or sum of the simple algebraic G-subrepresentations of H0(λ)H^0(\lambda), suffices by itself; it need not be accompanied by a separate theorem certifying that the resulting object is nonzero, G-stable, and simple. An unrelated module selected merely because it has the desired character does not satisfy this requirement.

R6

The formal character chM\operatorname{ch} M is the finitely supported element of Z[X(T)]\mathbf Z[X(T)] whose coefficient at each weight μ\mu is dimkMμ\dim_k M_\mu, with the natural-number dimension embedded in Z\mathbf Z.

R8

The relation μ<λ\mu<\lambda is the strict weight order fixed by the chosen positive roots: λμ\lambda-\mu is a nonnegative integral combination of the positive simple roots and μλ\mu\ne\lambda. It is fixed independently of L(λ)L(\lambda), its support, and the desired equality.

R11

The displayed character equality remains the conclusion to be proved from independent representation-theoretic facts, such as finite weight support, highest-weight multiplicity one, and the upper weight bound, or from mathematically equivalent prior results; the equality itself is not installed as a hypothesis, hidden in a definition, or used circularly.

Distributional gradients and Hölder regularity

Analysis

Let uD(Rn)u\in\mathcal{D}'(\mathbb{R}^n) and assume that juLp(Rn)\partial_j u\in L^p(\mathbb{R}^n), j=1,,nj=1,\ldots,n, where p>np>n. Then uu is a continuous function and, with γ=1n/p\gamma=1-n/p,

supxyu(x)u(y)xyγCjjup.\sup_{x\ne y}\frac{|u(x)-u(y)|}{|x-y|^\gamma}\le C\sum_j\|\partial_j u\|_p.

Selected rubric checkpoints

R2

For a fixed scalar field K\mathbb{K} used consistently by the distribution theory, the statement must range over every K\mathbb{K}-valued scalar distribution uu on Rn\mathbb{R}^n. The choice K=R\mathbb{K}=\mathbb{R} is valid, as is another standard scalar field when all pairings and norms are interpreted compatibly; no substantive assumptions such as compact support, prior continuity, local integrability of uu as a function, membership of uu itself in LpL^p, smoothness, or a pre-existing function representative may be added.

R3

The Lebesgue exponent pp must be a real parameter subject to the strict supercritical hypothesis (n:R)<p(n:\mathbb{R})<p, with no stronger substantive restriction substituted for it.

R4

For every coordinate jj, the standard distributional derivative ju\partial_j u must be represented by a global function gjLp(Rn;K)g_j\in L^p(\mathbb{R}^n;\mathbb{K}). Equivalently, for every compatible compactly supported smooth test function φ\varphi, the encoding must express u(jφ)=Rngjφu(\partial_j\varphi)=-\int_{\mathbb{R}^n}g_j\varphi using its standard scalar-field pairing convention, and this must hold for all nn coordinates.

R6

The conclusion must produce a globally continuous function f:RnKf:\mathbb{R}^n\to\mathbb{K}, with exactly the same scalar field K\mathbb{K} as uu, whose induced regular distribution is exactly uu. Thus every compatible compactly supported smooth test function must satisfy the standard regular-distribution pairing identity u(φ)=Rnf(x)φ(x)dxu(\varphi)=\int_{\mathbb{R}^n}f(x)\varphi(x)\,dx, interpreted with the encoding's standard scalar-field convention. This same function ff must be the representative used in the quantitative estimate.

R7

For every pair of distinct points x,yRnx,y\in\mathbb{R}^n, the continuous representative must satisfy the global upper bound f(x)f(y)xy1(n:R)/pCM.\frac{|f(x)-f(y)|}{\lVert x-y\rVert^{\,1-(n:\mathbb{R})/p}}\le C\,M. An equivalent denominator-cleared or supremum formulation is acceptable, but a local estimate, a reversed or strict inequality, mere continuity, mere finiteness, or a smaller Hölder exponent is not.

R9

The constant CC must be chosen uniformly before uu, its derivative representatives, the continuous representative ff, and the points x,yx,y; it may depend only on the fixed parameters nn and pp.

Separation by local sampling

Graph theory

Two graph properties P1,P2G\mathcal{P}_1,\mathcal{P}_2\subseteq\mathcal{G} are distinguishable by sampling if and only if δG(P1,P2)>0\delta_{\mathcal{G}}(\mathcal{P}_1,\mathcal{P}_2)>0.

Selected rubric checkpoints

R1

The ambient objects are finite simple undirected graphs, with no loops, and every vertex degree is at most the same fixed bound D; label choices, quotients by isomorphism, and equivalent graph representations are allowed.

R7

Distinguishability by sampling requires the existence of one shared positive finite radius r, one shared positive finite sample count k, and one decision property Q on ordered k-tuples of radius-r rooted observations.

R8

For the same witnesses r, k, and Q, every graph in P1\mathcal P_1 has Q-acceptance probability at least 2/32/3, while every graph in P2\mathcal P_2 has Q-acceptance probability at most 1/31/3, under k independent uniformly sampled vertices.

R10

The inter-property distance is δG(P1,P2)=inf{δ(G1,G2):G1P1, G2P2}\delta_{\mathcal G}(\mathcal P_1,\mathcal P_2)=\inf\{\delta_{\square}(G_1,G_2):G_1\in\mathcal P_1,\ G_2\in\mathcal P_2\} over all cross-pairs. It is interpreted in an extended nonnegative codomain with inf=\inf\varnothing=\infty, or by an equivalent explicit convention, so the value is infinite when either property is empty.

R11

The top-level proposition joins sampling distinguishability and sampling-distance separation by a biconditional, so it contains both the forward and reverse implications.

R15

Sampling distinguishability and inter-property distance are defined independently of one another, and no custom wrapper, hypothesis, or structure encodes the desired biconditional or strict-positivity conclusion by construction.

Interested in evaluating your model on Rabdos Lean Bench? Get in touch →