Skip to content

Commit 53daaff

Browse files
committed
1 parent 7f48281 commit 53daaff

1 file changed

Lines changed: 113 additions & 115 deletions

File tree

src/data/leaderboard.csv

Lines changed: 113 additions & 115 deletions
Original file line numberDiff line numberDiff line change
@@ -1,115 +1,113 @@
1-
agent,model,domain,skillMethod,without,withSkills,cost
2-
OpenClaw,Qwen3.5-397B,BrowseCompPlus,EverOS,40.0,33.8,↓ 20.4% turns
3-
OpenClaw,Qwen3.5-27B,BrowseCompPlus,EverOS,10.8,9.2,↓ 8.4% turns
4-
OpenClaw,Qwen3.5-397B,BrowseCompPlus,Memento,40.0,60.0,↓ 13.1% turns
5-
OpenClaw,Qwen3.5-27B,BrowseCompPlus,Memento,10.8,7.7,↑ 53.4% turns
6-
OpenClaw,Qwen3.5-397B,BrowseCompPlus,ReasoningBank,40.0,49.2,↓ 12.9% turns
7-
OpenClaw,Qwen3.5-397B,BrowseCompPlus,Human Design,40.0,64.6,↓ 38.7% turns
8-
OpenClaw,Qwen3.5-27B,BrowseCompPlus,Human Design,10.8,13.8,↓ 30.6% turns
9-
OpenClaw,Qwen3.5-397B,BrowseCompPlus,EvoSkill,40.0,43.1,↓ 19.6% turns
10-
OpenClaw,Qwen3.5-27B,BrowseCompPlus,EvoSkill,10.8,7.7,— 0% turns
11-
OpenClaw,Qwen3.5-397B,BrowseCompPlus,OpenSpace,40.0,49.2,↑ 57.9% turns
12-
OpenClaw,Qwen3.5-27B,BrowseCompPlus,OpenSpace,10.8,27.7,↑ 54.0% turns
13-
OpenClaw,Qwen3.5-397B,SWE-Bench,EverOS,34.6,50.0,↓ 21.4% turns
14-
OpenClaw,Qwen3.5-27B,SWE-Bench,EverOS,42.3,50.0,↓ 1.5% turns
15-
OpenClaw,Qwen3.5-397B,SWE-Bench,Memento,34.6,37.5,↓ 0.2% turns
16-
OpenClaw,Qwen3.5-27B,SWE-Bench,Memento,42.3,45.8,↑ 11.7% turns
17-
OpenClaw,Qwen3.5-397B,SWE-Bench,ReasoningBank,34.6,26.9,↑ 21.3% turns
18-
OpenClaw,Qwen3.5-397B,SWE-Bench,Human Design,34.6,38.5,↑ 0.3% turns
19-
OpenClaw,Qwen3.5-27B,SWE-Bench,Human Design,42.3,42.3,↑ 1.6% turns
20-
OpenClaw,Qwen3.5-397B,SWE-Bench,EvoSkill,34.6,46.2,↑ 25.8% turns
21-
OpenClaw,Qwen3.5-27B,SWE-Bench,EvoSkill,42.3,38.5,↑ 94.9% turns
22-
OpenClaw,Qwen3.5-397B,SWE-Bench,OpenSpace,34.6,51.7,↑ 22.1% turns
23-
OpenClaw,Qwen3.5-27B,SWE-Bench,OpenSpace,42.3,37.9,↑ 60.8% turns
24-
OpenClaw,Qwen3.5-397B,OmniMath,EverOS,48.0,50.0,↓ 18.0% chars
25-
OpenClaw,Qwen3.5-27B,OmniMath,EverOS,44.0,39.0,↓ 31.8% chars
26-
OpenClaw,Qwen3.5-397B,OmniMath,Memento,48.0,38.0,↑ 68.5% chars
27-
OpenClaw,Qwen3.5-27B,OmniMath,Memento,44.0,32.0,↑ 21.1% chars
28-
OpenClaw,Qwen3.5-397B,OmniMath,ReasoningBank,48.0,43.0,↓ 13.8% chars
29-
OpenClaw,Qwen3.5-397B,OmniMath,Human Design,48.0,60.0,↑ 2.7% chars
30-
OpenClaw,Qwen3.5-27B,OmniMath,Human Design,44.0,29.0,↓ 13.0% chars
31-
OpenClaw,Qwen3.5-397B,OmniMath,EvoSkill,48.0,56.0,↓ 28.7% chars
32-
OpenClaw,Qwen3.5-27B,OmniMath,EvoSkill,44.0,34.0,↓ 6.3% chars
33-
OpenClaw,Qwen3.5-397B,OmniMath,OpenSpace,48.0,49.0,↑ 5.2% chars
34-
OpenClaw,Qwen3.5-27B,OmniMath,OpenSpace,44.0,39.0,↓ 13.2% chars
35-
OpenClaw,Qwen3.5-397B,GDPVal,EverOS,51.7,53.4,↑ 4.4% turns
36-
OpenClaw,Qwen3.5-27B,GDPVal,EverOS,46.6,50.0,↑ 5.5% turns
37-
OpenClaw,Qwen3.5-397B,GDPVal,Memento,51.7,62.1,↑ 7.5% turns
38-
OpenClaw,Qwen3.5-27B,GDPVal,Memento,46.6,58.6,↓ 8.4% turns
39-
OpenClaw,Qwen3.5-397B,GDPVal,ReasoningBank,51.7,43.1,↑ 4.7% turns
40-
OpenClaw,Qwen3.5-397B,GDPVal,Human Design,51.7,56.9,↑ 5.1% turns
41-
OpenClaw,Qwen3.5-27B,GDPVal,Human Design,46.6,48.3,↓ 13.6% turns
42-
OpenClaw,Qwen3.5-397B,GDPVal,EvoSkill,51.7,67.2,↑ 64.9% turns
43-
OpenClaw,Qwen3.5-27B,GDPVal,EvoSkill,46.6,51.7,↑ 23.8% turns
44-
OpenClaw,Qwen3.5-397B,GDPVal,OpenSpace,51.7,67.2,↑ 51.5% turns
45-
OpenClaw,Qwen3.5-27B,GDPVal,OpenSpace,46.6,56.9,↑ 43.8% turns
46-
OpenClaw,Qwen3.5-397B,LiveCodeBench,EverOS,43.6,48.7,↓ 10.2% turns
47-
OpenClaw,Qwen3.5-27B,LiveCodeBench,EverOS,25.6,48.7,↓ 16.5% turns
48-
OpenClaw,Qwen3.5-397B,LiveCodeBench,Memento,43.6,60.5,↑ 21.4% turns
49-
OpenClaw,Qwen3.5-27B,LiveCodeBench,Memento,25.6,52.6,↑ 19.8% turns
50-
OpenClaw,Qwen3.5-397B,LiveCodeBench,ReasoningBank,43.6,59.0,↑ 35.0% turns
51-
OpenClaw,Qwen3.5-397B,LiveCodeBench,Human Design,43.6,61.5,↑ 6.1% turns
52-
OpenClaw,Qwen3.5-27B,LiveCodeBench,Human Design,25.6,51.3,↓ 29.4% turns
53-
OpenClaw,Qwen3.5-27B,BrowseCompPlus,ReasoningBank,10.8,15.4,↓ 7.1% turns
54-
OpenClaw,Qwen3.5-27B,BrowseCompPlus,GEPA,10.8,10.8,↓ 1.3% turns
55-
OpenClaw,Qwen3.5-27B,SWE-Bench,ReasoningBank,42.3,57.7,↑ 8.4% turns
56-
OpenClaw,Qwen3.5-27B,SWE-Bench,GEPA,42.3,32.0,↑ 9.2% turns
57-
OpenClaw,Qwen3.5-27B,OmniMath,ReasoningBank,44.0,21.0,↓ 28.7% chars
58-
OpenClaw,Qwen3.5-27B,OmniMath,GEPA,44.0,32.0,↓ 37.9% chars
59-
OpenClaw,Qwen3.5-27B,GDPVal,ReasoningBank,46.6,53.4,↑ 11.5% turns
60-
OpenClaw,Qwen3.5-27B,GDPVal,GEPA,46.6,43.1,↓ 9.7% turns
61-
OpenClaw,Qwen3.5-27B,LiveCodeBench,ReasoningBank,25.6,53.8,↓ 2.7% turns
62-
OpenClaw,Qwen3.5-27B,LiveCodeBench,GEPA,25.6,33.3,↓ 37.0% turns
63-
OpenClaw,Qwen3.5-397B,BrowseCompPlus,GEPA,40.0,41.5,↓ 17.4% turns
64-
OpenClaw,Qwen3.5-397B,SWE-Bench,GEPA,34.6,53.8,↓ 13.0% turns
65-
OpenClaw,Qwen3.5-397B,OmniMath,GEPA,48.0,42.0,↓ 18.3% chars
66-
OpenClaw,Qwen3.5-397B,GDPVal,GEPA,51.7,53.4,↑ 2.7% turns
67-
OpenClaw,Qwen3.5-397B,LiveCodeBench,GEPA,43.6,51.3,↓ 33.1% turns
68-
Nanobot,Qwen3.5-27B,BrowseCompPlus,EverOS,7.7,10.8,↑ 6.8% turns
69-
Nanobot,Qwen3.5-27B,BrowseCompPlus,Memento,7.7,13.8,↑ 3.2% turns
70-
Nanobot,Qwen3.5-27B,BrowseCompPlus,ReasoningBank,7.7,9.2,↑ 4.7% turns
71-
Nanobot,Qwen3.5-27B,BrowseCompPlus,Human Design,7.7,15.4,↑ 20.1% turns
72-
Nanobot,Qwen3.5-27B,BrowseCompPlus,GEPA,7.7,10.8,↓ 6.5% turns
73-
Nanobot,Qwen3.5-27B,SWE-Bench,EverOS,19.2,23.1,↓ 2.9% turns
74-
Nanobot,Qwen3.5-27B,SWE-Bench,Memento,19.2,25.0,↑ 0.2% turns
75-
Nanobot,Qwen3.5-27B,SWE-Bench,ReasoningBank,19.2,19.2,↑ 7.8% turns
76-
Nanobot,Qwen3.5-27B,SWE-Bench,Human Design,19.2,30.8,↑ 9.4% turns
77-
Nanobot,Qwen3.5-27B,SWE-Bench,GEPA,19.2,23.1,↑ 8.5% turns
78-
Nanobot,Qwen3.5-27B,OmniMath,EverOS,47.0,43.0,↑ 2.8% chars
79-
Nanobot,Qwen3.5-27B,OmniMath,Memento,47.0,42.0,↑ 1843.1% chars
80-
Nanobot,Qwen3.5-27B,OmniMath,ReasoningBank,47.0,42.0,↑ 42.4% chars
81-
Nanobot,Qwen3.5-27B,OmniMath,GEPA,47.0,44.0,↓ 0.2% chars
82-
Nanobot,Qwen3.5-27B,GDPVal,EverOS,48.3,60.3,↑ 10.9% turns
83-
Nanobot,Qwen3.5-27B,GDPVal,Memento,48.3,51.7,↑ 15.1% turns
84-
Nanobot,Qwen3.5-27B,GDPVal,ReasoningBank,48.3,43.1,↑ 20.5% turns
85-
Nanobot,Qwen3.5-27B,GDPVal,Human Design,48.3,55.2,↑ 16.9% turns
86-
Nanobot,Qwen3.5-27B,GDPVal,GEPA,48.3,48.3,↑ 23.2% turns
87-
Nanobot,Qwen3.5-27B,LiveCodeBench,EverOS,20.5,15.4,↓ 1.4% turns
88-
Nanobot,Qwen3.5-27B,LiveCodeBench,Memento,20.5,36.8,↑ 18.8% turns
89-
Nanobot,Qwen3.5-27B,LiveCodeBench,ReasoningBank,20.5,33.3,↑ 15.9% turns
90-
Nanobot,Qwen3.5-27B,LiveCodeBench,Human Design,20.5,43.6,↑ 16.7% turns
91-
Nanobot,Qwen3.5-27B,LiveCodeBench,GEPA,20.5,33.3,↑ 24.1% turns
92-
Nanobot,Qwen3.5-397B,BrowseCompPlus,EverOS,13.8,20.0,↑ 1.1% turns
93-
Nanobot,Qwen3.5-397B,BrowseCompPlus,Memento,13.8,20.0,↓ 8.4% turns
94-
Nanobot,Qwen3.5-397B,BrowseCompPlus,ReasoningBank,13.8,20.0,↑ 19.6% turns
95-
Nanobot,Qwen3.5-397B,BrowseCompPlus,Human Design,13.8,21.5,↑ 18.3% turns
96-
Nanobot,Qwen3.5-397B,BrowseCompPlus,GEPA,13.8,13.8,↑ 11.4% turns
97-
Nanobot,Qwen3.5-397B,SWE-Bench,EverOS,26.9,30.8,↑ 0.2% turns
98-
Nanobot,Qwen3.5-397B,SWE-Bench,Memento,26.9,16.7,↓ 2.0% turns
99-
Nanobot,Qwen3.5-397B,SWE-Bench,ReasoningBank,26.9,26.9,↑ 1.9% turns
100-
Nanobot,Qwen3.5-397B,SWE-Bench,Human Design,26.9,38.5,↑ 1.9% turns
101-
Nanobot,Qwen3.5-397B,SWE-Bench,GEPA,26.9,26.9,↑ 1.9% turns
102-
Nanobot,Qwen3.5-397B,OmniMath,EverOS,53.0,51.0,↓ 2.8% chars
103-
Nanobot,Qwen3.5-397B,OmniMath,Memento,53.0,55.0,↑ 1484.9% chars
104-
Nanobot,Qwen3.5-397B,OmniMath,ReasoningBank,53.0,49.0,↑ 30.0% chars
105-
Nanobot,Qwen3.5-397B,OmniMath,GEPA,53.0,55.0,↑ 1.9% chars
106-
Nanobot,Qwen3.5-397B,GDPVal,EverOS,55.2,63.8,↑ 1.2% turns
107-
Nanobot,Qwen3.5-397B,GDPVal,Memento,55.2,58.6,↓ 2.6% turns
108-
Nanobot,Qwen3.5-397B,GDPVal,ReasoningBank,55.2,51.7,↓ 0.4% turns
109-
Nanobot,Qwen3.5-397B,GDPVal,Human Design,55.2,55.2,↓ 4.3% turns
110-
Nanobot,Qwen3.5-397B,GDPVal,GEPA,55.2,46.6,↑ 14.7% turns
111-
Nanobot,Qwen3.5-397B,LiveCodeBench,EverOS,43.6,25.6,↑ 4.1% turns
112-
Nanobot,Qwen3.5-397B,LiveCodeBench,Memento,43.6,50.0,↓ 0.8% turns
113-
Nanobot,Qwen3.5-397B,LiveCodeBench,ReasoningBank,43.6,53.8,↑ 9.8% turns
114-
Nanobot,Qwen3.5-397B,LiveCodeBench,Human Design,43.6,38.5,↑ 20.4% turns
115-
Nanobot,Qwen3.5-397B,LiveCodeBench,GEPA,43.6,48.7,↓ 22.9% turns
1+
agent,model,domain,skillMethod,without,withSkills,cost
2+
OpenClaw,Qwen3.5-27B,BrowseCompPlus,EverOS,10.8,15.4,↑ 76.5% turns
3+
OpenClaw,Qwen3.5-27B,BrowseCompPlus,EvoSkill,10.8,7.7,— 0% turns
4+
OpenClaw,Qwen3.5-27B,BrowseCompPlus,OpenSpace,10.8,27.7,↑ 54.0% turns
5+
OpenClaw,Qwen3.5-27B,BrowseCompPlus,Memento,10.8,16.9,↓ 19.2% turns
6+
OpenClaw,Qwen3.5-27B,BrowseCompPlus,ReasoningBank,10.8,12.3,↑ 17.8% turns
7+
OpenClaw,Qwen3.5-27B,BrowseCompPlus,GEPA,10.8,24.6,↓ 0.6% turns
8+
OpenClaw,Qwen3.5-27B,BrowseCompPlus,Human Design,10.8,13.8,↓ 30.6% turns
9+
OpenClaw,Qwen3.5-27B,GDPVal,EverOS,37.3,50.0,↑ 5.5% turns
10+
OpenClaw,Qwen3.5-27B,GDPVal,EvoSkill,37.3,51.7,↑ 23.8% turns
11+
OpenClaw,Qwen3.5-27B,GDPVal,OpenSpace,37.3,56.9,↑ 43.8% turns
12+
OpenClaw,Qwen3.5-27B,GDPVal,Memento,37.3,35.3,↑ 100.0% turns
13+
OpenClaw,Qwen3.5-27B,GDPVal,ReasoningBank,37.3,34.5,↑ 29.1% turns
14+
OpenClaw,Qwen3.5-27B,GDPVal,GEPA,37.3,41.2,↑ 41.9% turns
15+
OpenClaw,Qwen3.5-27B,GDPVal,Human Design,37.3,39.3,↓ 13.6% turns
16+
OpenClaw,Qwen3.5-27B,OmniMath,EverOS,44.0,39.0,↓ 31.8% chars
17+
OpenClaw,Qwen3.5-27B,OmniMath,EvoSkill,44.0,34.0,↓ 6.3% chars
18+
OpenClaw,Qwen3.5-27B,OmniMath,OpenSpace,44.0,39.0,↓ 13.2% chars
19+
OpenClaw,Qwen3.5-27B,OmniMath,Memento,44.0,32.0,↑ 21.1% chars
20+
OpenClaw,Qwen3.5-27B,OmniMath,ReasoningBank,44.0,21.0,↓ 28.7% chars
21+
OpenClaw,Qwen3.5-27B,OmniMath,GEPA,44.0,32.0,↓ 37.9% chars
22+
OpenClaw,Qwen3.5-27B,LiveCodeBench,EverOS,46.2,43.6,↑ 32.7% turns
23+
OpenClaw,Qwen3.5-27B,LiveCodeBench,Memento,46.2,33.3,↓ 6.1% turns
24+
OpenClaw,Qwen3.5-27B,LiveCodeBench,ReasoningBank,46.2,28.2,↓ 8.2% turns
25+
OpenClaw,Qwen3.5-27B,LiveCodeBench,GEPA,46.2,51.3,↑ 20.4% turns
26+
OpenClaw,Qwen3.5-27B,LiveCodeBench,Human Design,46.2,64.8,↓ 29.4% turns
27+
OpenClaw,Qwen3.5-27B,SWE-Bench,EverOS,38.5,46.2,↑ 0.5% turns
28+
OpenClaw,Qwen3.5-27B,SWE-Bench,EvoSkill,38.5,38.5,↑ 94.9% turns
29+
OpenClaw,Qwen3.5-27B,SWE-Bench,OpenSpace,38.5,37.9,↑ 60.8% turns
30+
OpenClaw,Qwen3.5-27B,SWE-Bench,Memento,38.5,30.8,↓ 41.7% turns
31+
OpenClaw,Qwen3.5-27B,SWE-Bench,ReasoningBank,38.5,50.0,↑ 5.1% turns
32+
OpenClaw,Qwen3.5-27B,SWE-Bench,GEPA,38.5,15.4,↓ 39.9% turns
33+
OpenClaw,Qwen3.5-27B,SWE-Bench,Human Design,38.5,38.5,↑ 1.6% turns
34+
OpenClaw,Qwen3.5-397B,BrowseCompPlus,EverOS,30.8,50.8,↓ 1.5% turns
35+
OpenClaw,Qwen3.5-397B,BrowseCompPlus,EvoSkill,30.8,43.1,↓ 19.6% turns
36+
OpenClaw,Qwen3.5-397B,BrowseCompPlus,OpenSpace,30.8,49.2,↑ 57.9% turns
37+
OpenClaw,Qwen3.5-397B,BrowseCompPlus,Memento,30.8,29.2,↓ 8.6% turns
38+
OpenClaw,Qwen3.5-397B,BrowseCompPlus,ReasoningBank,30.8,41.5,↓ 10.3% turns
39+
OpenClaw,Qwen3.5-397B,BrowseCompPlus,GEPA,30.8,26.2,↑ 14.1% turns
40+
OpenClaw,Qwen3.5-397B,BrowseCompPlus,Human Design,30.8,59.2,↓ 38.7% turns
41+
OpenClaw,Qwen3.5-397B,GDPVal,EverOS,45.1,53.4,↑ 4.4% turns
42+
OpenClaw,Qwen3.5-397B,GDPVal,EvoSkill,45.1,67.2,↑ 64.9% turns
43+
OpenClaw,Qwen3.5-397B,GDPVal,OpenSpace,45.1,67.2,↑ 51.5% turns
44+
OpenClaw,Qwen3.5-397B,GDPVal,Memento,45.1,43.1,↓ 8.1% turns
45+
OpenClaw,Qwen3.5-397B,GDPVal,ReasoningBank,45.1,43.1,↓ 5.9% turns
46+
OpenClaw,Qwen3.5-397B,GDPVal,GEPA,45.1,49.0,↑ 5.9% turns
47+
OpenClaw,Qwen3.5-397B,GDPVal,Human Design,45.1,51.0,↑ 5.1% turns
48+
OpenClaw,Qwen3.5-397B,OmniMath,EverOS,48.0,50.0,↓ 18.0% chars
49+
OpenClaw,Qwen3.5-397B,OmniMath,EvoSkill,48.0,56.0,↓ 28.7% chars
50+
OpenClaw,Qwen3.5-397B,OmniMath,OpenSpace,48.0,49.0,↑ 5.2% chars
51+
OpenClaw,Qwen3.5-397B,OmniMath,Memento,48.0,38.0,↑ 68.5% chars
52+
OpenClaw,Qwen3.5-397B,OmniMath,ReasoningBank,48.0,43.0,↓ 13.8% chars
53+
OpenClaw,Qwen3.5-397B,OmniMath,GEPA,48.0,42.0,↓ 18.3% chars
54+
OpenClaw,Qwen3.5-397B,LiveCodeBench,EverOS,46.2,38.5,↑ 42.0% turns
55+
OpenClaw,Qwen3.5-397B,LiveCodeBench,Memento,46.2,51.3,↑ 8.0% turns
56+
OpenClaw,Qwen3.5-397B,LiveCodeBench,ReasoningBank,46.2,38.5,↑ 2.0% turns
57+
OpenClaw,Qwen3.5-397B,LiveCodeBench,GEPA,46.2,64.1,↑ 90.0% turns
58+
OpenClaw,Qwen3.5-397B,LiveCodeBench,Human Design,46.2,63.3,↑ 6.1% turns
59+
OpenClaw,Qwen3.5-397B,SWE-Bench,EverOS,25.0,46.2,↑ 32.0% turns
60+
OpenClaw,Qwen3.5-397B,SWE-Bench,EvoSkill,25.0,46.2,↑ 25.8% turns
61+
OpenClaw,Qwen3.5-397B,SWE-Bench,OpenSpace,25.0,51.7,↑ 22.1% turns
62+
OpenClaw,Qwen3.5-397B,SWE-Bench,Memento,25.0,42.3,↑ 28.9% turns
63+
OpenClaw,Qwen3.5-397B,SWE-Bench,ReasoningBank,25.0,65.4,↑ 89.0% turns
64+
OpenClaw,Qwen3.5-397B,SWE-Bench,GEPA,25.0,50.0,↑ 59.8% turns
65+
OpenClaw,Qwen3.5-397B,SWE-Bench,Human Design,25.0,29.5,↑ 0.3% turns
66+
Nanobot,Qwen3.5-27B,BrowseCompPlus,EverOS,6.2,13.8,↓ 34.2% turns
67+
Nanobot,Qwen3.5-27B,BrowseCompPlus,Memento,6.2,3.1,↑ 18.9% turns
68+
Nanobot,Qwen3.5-27B,BrowseCompPlus,ReasoningBank,6.2,9.2,↑ 40.6% turns
69+
Nanobot,Qwen3.5-27B,BrowseCompPlus,GEPA,6.2,4.6,↓ 47.4% turns
70+
Nanobot,Qwen3.5-27B,BrowseCompPlus,Human Design,6.2,14.0,↑ 20.1% turns
71+
Nanobot,Qwen3.5-27B,GDPVal,EverOS,43.1,60.3,↑ 10.9% turns
72+
Nanobot,Qwen3.5-27B,GDPVal,Memento,43.1,39.2,↑ 66.5% turns
73+
Nanobot,Qwen3.5-27B,GDPVal,ReasoningBank,43.1,43.1,↑ 64.4% turns
74+
Nanobot,Qwen3.5-27B,GDPVal,GEPA,43.1,35.3,↑ 72.3% turns
75+
Nanobot,Qwen3.5-27B,GDPVal,Human Design,43.1,50.7,↑ 16.9% turns
76+
Nanobot,Qwen3.5-27B,OmniMath,EverOS,47.0,43.0,↑ 2.8% chars
77+
Nanobot,Qwen3.5-27B,OmniMath,Memento,47.0,42.0,↑ 1843.1% chars
78+
Nanobot,Qwen3.5-27B,OmniMath,ReasoningBank,47.0,42.0,↑ 42.4% chars
79+
Nanobot,Qwen3.5-27B,OmniMath,GEPA,47.0,44.0,↓ 0.2% chars
80+
Nanobot,Qwen3.5-27B,LiveCodeBench,EverOS,25.6,17.9,↑ 131.8% turns
81+
Nanobot,Qwen3.5-27B,LiveCodeBench,Memento,25.6,30.8,↑ 27.3% turns
82+
Nanobot,Qwen3.5-27B,LiveCodeBench,ReasoningBank,25.6,35.9,↑ 95.5% turns
83+
Nanobot,Qwen3.5-27B,LiveCodeBench,GEPA,25.6,35.9,↑ 68.2% turns
84+
Nanobot,Qwen3.5-27B,LiveCodeBench,Human Design,25.6,47.2,↑ 16.7% turns
85+
Nanobot,Qwen3.5-27B,SWE-Bench,EverOS,38.5,57.7,↓ 4.2% turns
86+
Nanobot,Qwen3.5-27B,SWE-Bench,Memento,38.5,50.0,↑ 24.9% turns
87+
Nanobot,Qwen3.5-27B,SWE-Bench,ReasoningBank,38.5,38.5,↓ 6.5% turns
88+
Nanobot,Qwen3.5-27B,SWE-Bench,GEPA,38.5,50.0,↑ 29.2% turns
89+
Nanobot,Qwen3.5-27B,SWE-Bench,Human Design,38.5,47.3,↑ 9.4% turns
90+
Nanobot,Qwen3.5-397B,BrowseCompPlus,EverOS,10.8,20.0,↓ 44.0% turns
91+
Nanobot,Qwen3.5-397B,BrowseCompPlus,Memento,10.8,26.2,↓ 33.6% turns
92+
Nanobot,Qwen3.5-397B,BrowseCompPlus,ReasoningBank,10.8,13.8,↓ 3.6% turns
93+
Nanobot,Qwen3.5-397B,BrowseCompPlus,GEPA,10.8,12.3,↓ 47.6% turns
94+
Nanobot,Qwen3.5-397B,BrowseCompPlus,Human Design,10.8,18.8,↑ 18.3% turns
95+
Nanobot,Qwen3.5-397B,GDPVal,EverOS,54.9,63.8,↑ 1.2% turns
96+
Nanobot,Qwen3.5-397B,GDPVal,Memento,54.9,62.7,↑ 14.5% turns
97+
Nanobot,Qwen3.5-397B,GDPVal,ReasoningBank,54.9,65.5,↑ 17.6% turns
98+
Nanobot,Qwen3.5-397B,GDPVal,GEPA,54.9,60.8,↑ 39.6% turns
99+
Nanobot,Qwen3.5-397B,GDPVal,Human Design,54.9,54.9,↓ 4.3% turns
100+
Nanobot,Qwen3.5-397B,OmniMath,EverOS,53.0,51.0,↓ 2.8% chars
101+
Nanobot,Qwen3.5-397B,OmniMath,Memento,53.0,55.0,↑ 1484.9% chars
102+
Nanobot,Qwen3.5-397B,OmniMath,ReasoningBank,53.0,49.0,↑ 30.0% chars
103+
Nanobot,Qwen3.5-397B,OmniMath,GEPA,53.0,55.0,↑ 1.9% chars
104+
Nanobot,Qwen3.5-397B,LiveCodeBench,EverOS,51.3,35.9,↑ 17.4% turns
105+
Nanobot,Qwen3.5-397B,LiveCodeBench,Memento,51.3,43.6,↓ 17.4% turns
106+
Nanobot,Qwen3.5-397B,LiveCodeBench,ReasoningBank,51.3,51.3,↑ 4.3% turns
107+
Nanobot,Qwen3.5-397B,LiveCodeBench,GEPA,51.3,61.5,↑ 65.2% turns
108+
Nanobot,Qwen3.5-397B,LiveCodeBench,Human Design,51.3,46.9,↑ 20.4% turns
109+
Nanobot,Qwen3.5-397B,SWE-Bench,EverOS,46.2,42.3,↓ 15.9% turns
110+
Nanobot,Qwen3.5-397B,SWE-Bench,Memento,46.2,50.0,↑ 16.2% turns
111+
Nanobot,Qwen3.5-397B,SWE-Bench,ReasoningBank,46.2,57.7,↑ 12.0% turns
112+
Nanobot,Qwen3.5-397B,SWE-Bench,GEPA,46.2,42.3,↑ 8.3% turns
113+
Nanobot,Qwen3.5-397B,SWE-Bench,Human Design,46.2,54.7,↑ 1.9% turns

0 commit comments

Comments
 (0)