@@ -11,8 +11,7 @@ as an [_edit format_](https://aider.chat/docs/benchmarks.html#edit-formats).
11
11
12
12
## Table of Contents
13
13
- [ What is CEDARScript?] ( #what-is-cedarscript )
14
- - [ Installation] ( #how-to-use-it )
15
- - [ Usage] ( #usage )
14
+ - [ Installation] ( #installation )
16
15
- [ Why Use CEDARScript?] ( #why-use-cedarscript )
17
16
- [ Performance Comparison] ( #performance-comparison )
18
17
- [ Individual Test Analysis] ( #individual-test-analysis )
@@ -27,17 +26,23 @@ is a domain-specific language designed to improve how AI coding assistants inter
27
26
It provides a standardized way to express complex code modification and analysis operations, making it easier for
28
27
AI-assisted development tools to understand and execute these tasks.
29
28
30
- ## How to use it
29
+ ## Installation
31
30
32
- 1 . [ Install Aider] ( https://aider.chat/docs/install.html ) , if you haven't.
31
+ 1 . Install _ ** Aider with CEDARScript** _ via this command below:
32
+ ``` shell
33
+ python -m ensurepip --upgrade
34
+ pip install --upgrade --force-reinstall \
35
+ git+https://github.com/elifarley/aider@cedarscript \
36
+ aider-chat
37
+ ```
33
38
2 . Now, simply use the [ ` --edit-format ` switch] ( https://aider.chat/docs/more/edit-formats.html ) and select ` cedarscript ` :
34
39
``` shell
35
- aider --model gemini/gemini-1.5-flash-latest -- edit-format cedarscript
40
+ aider --edit-format cedarscript
36
41
```
37
42
38
43
## Why use CEDARScript?
39
44
40
- ` TL;DR ` : You can get higher success rates when compared to other edit formats.
45
+ ` TL;DR ` : You can get higher success rates when refactoring large files, comparing to other edit formats.
41
46
42
47
1 . ** Higher Success Rates** : Significantly improves the performance of AI models in code refactoring tasks.
43
48
2 . ** Cost-Effective Performance** : Enables more affordable models to compete with top-tier options.
@@ -63,17 +68,27 @@ CEDARScript has shown remarkable improvements in AI model performance for code r
63
68
This suggests that ** CEDARScript** can level the playing field, enabling more accessible AI models
64
69
to compete with and even _ exceed_ the capabilities of more expensive options in certain coding tasks.
65
70
71
+ ### The Gemini 1.5 Flash benchmark highlights
66
72
67
- ### Individual Test Analysis
73
+ - 48% of tests (43 total) showed improvements
74
+ - 103% increase in Pass 1 success rate (75 tests)
75
+ - Test duration reduced by 93% (from 5:17:26 to 0:25:17)
76
+ - Token efficiency greatly improved:
77
+ - Sent tokens: -37% (7.59M)
78
+ - Received tokens: -96% (180K)
79
+ - Error reduction:
80
+ - Error outputs: -94% (35 total)
81
+ - Malformed outputs: -94% (6 cases)
82
+ - Syntax errors: -85% (3 cases)
83
+ - Indent errors eliminated (100% reduction)
68
84
69
- ** Overall Performance**
85
+ <details >
86
+ <summary >Delta...</summary >
87
+
88
+ ![ image] ( https://github.com/user-attachments/assets/86683a1b-2b64-49c9-89ff-eb18d3511ae7 )
89
+ </details >
70
90
71
- | | Count | % |
72
- | -------------| -------| -------|
73
- | Improved | 39 | 43.8% |
74
- | Worsened | 7 | 7.9% |
75
- | Stable | 43 | 48.3% |
76
- | Total tests | 89 | 100% |
91
+ ### Individual Test Analysis
77
92
78
93
<details >
79
94
<summary >Individual Test Diff</summary >
0 commit comments