agent-runtime-framework/benchmarks/estimates.csv at main

Files

Paul O'Reilly 418d634afa benchmarks: add Artificial Analysis snapshot and placeholder M3.1-Flash estimate

- artificial-analysis/2026-10-13.csv: Anthropic, Qwen, MiniMax-M3 rows with
  cost per task and derived cost per intelligence point
- minimax-m3-1-flash-unverified.md: operator-supplied KingBench figures, unverified
- estimates.csv: TODO placeholder for M3.1 Flash (0.9x M3 cost, index scaled by
  KingBench ratio) -- replace with measured/published values

2026-10-13 14:33:53 +13:00

348 B

Raw Permalink Blame History

1	model	creator	context	intelligence_index	cost_per_task_usd	cost_per_intelligence_point_usd	status	basis
2	MiniMax-M3.1-Flash-Preview (effort unspecified)	MiniMax	1M	61.5	0.46	0.0075	ESTIMATE-TODO	cost = 0.9 x MiniMax-M3 AA cost per task ($0.51); index = M3 AA index (29) x KingBench-3 ratio (66.25/31.25 = 2.12); both inputs unverified/placeholder

348 B Raw Permalink Blame History

348 B

Raw Permalink Blame History