skynet/agent-runtime-framework
3
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

benchmarks: add Artificial Analysis snapshot and placeholder M3.1-Flash estimate

Browse Source 
- artificial-analysis/2026-10-13.csv: Anthropic, Qwen, MiniMax-M3 rows with
  cost per task and derived cost per intelligence point
- minimax-m3-1-flash-unverified.md: operator-supplied KingBench figures, unverified
- estimates.csv: TODO placeholder for M3.1 Flash (0.9x M3 cost, index scaled by
  KingBench ratio) -- replace with measured/published values
This commit is contained in:
Paul O'Reilly
2026-10-13 14:33:53 +13:00
parent d7decc1dec
commit 418d634afa
4 changed files with 88 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
benchmarks/estimates.csv Normal file
View File

@@ -0,0 +1,2 @@
model,creator,context,intelligence_index,cost_per_task_usd,cost_per_intelligence_point_usd,status,basis
MiniMax-M3.1-Flash-Preview (effort unspecified),MiniMax,1M,61.5,0.46,0.0075,ESTIMATE-TODO,"cost = 0.9 x MiniMax-M3 AA cost per task ($0.51); index = M3 AA index (29) x KingBench-3 ratio (66.25/31.25 = 2.12); both inputs unverified/placeholder"
1 model creator context intelligence_index cost_per_task_usd cost_per_intelligence_point_usd status basis
2 MiniMax-M3.1-Flash-Preview (effort unspecified) MiniMax 1M 61.5 0.46 0.0075 ESTIMATE-TODO cost = 0.9 x MiniMax-M3 AA cost per task ($0.51); index = M3 AA index (29) x KingBench-3 ratio (66.25/31.25 = 2.12); both inputs unverified/placeholder