TerrariaBench Runs

Runs

7

Models

6

Checkpoints

164

Total Cost

$0.475046

kimi-k2.6

kimi / 03_open_ended_progress

8 checkpoints 1 frames $0.0000

claude-opus-4-7

claude / 03_open_ended_progress

16 checkpoints 1 frames $0.0000

openrouter/google/gemini-3.1-pro-preview

opencode / 03_open_ended_progress

32 checkpoints 2 frames $0.2094

openrouter/google/gemini-3.1-flash-lite-preview

opencode / 03_open_ended_progress

5 checkpoints 6 frames $0.0249

openrouter/google/gemini-3-flash-preview

opencode / 03_open_ended_progress

31 checkpoints 5 frames $0.2408

claude-opus-4-7

claude / 03_open_ended_progress

32 checkpoints 1 frames $0.0000

gpt-5.5

codex / 03_open_ended_progress

40 checkpoints 39 frames $0.0000

Run Table

Run	Harness	Model	Problem	Checkpoints	Elapsed	Frames	Cost
20260429_193427_kimi_kimi-k2.6_03_open_ended_progress	kimi	kimi-k2.6	03_open_ended_progress	8	300s	1	$0.000000
20260429_185451_claude_claude-opus-4-7_03_open_ended_progress	claude	claude-opus-4-7	03_open_ended_progress	16	300s	1	$0.000000
20260429_184419_opencode_openrouter_google_gemini-3.1-pro-preview_03_open_ended_progress	opencode	openrouter/google/gemini-3.1-pro-preview	03_open_ended_progress	32	301s	2	$0.209396
20260429_184419_opencode_openrouter_google_gemini-3.1-flash-lite-preview_03_open_ended_progress	opencode	openrouter/google/gemini-3.1-flash-lite-preview	03_open_ended_progress	5	40s	6	$0.024897
20260429_184419_opencode_openrouter_google_gemini-3-flash-preview_03_open_ended_progress	opencode	openrouter/google/gemini-3-flash-preview	03_open_ended_progress	31	298s	5	$0.240753
20260429_184419_claude_claude-opus-4-7_03_open_ended_progress	claude	claude-opus-4-7	03_open_ended_progress	32	300s	1	$0.000000
20260429_044924_codex_gpt-5.5_03_open_ended_progress	codex	gpt-5.5	03_open_ended_progress	40	36000s	39	$0.000000