Skip to content

Commit 6d758ff

Browse files
committed
added benchmark info for CEDARScript 1.1.3 + 1.1.6
1 parent 224caf0 commit 6d758ff

File tree

1 file changed

+25
-20
lines changed
  • tests/corpus/.refactoring-benchmark

1 file changed

+25
-20
lines changed

tests/corpus/.refactoring-benchmark/chat.xml

Lines changed: 25 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -8,38 +8,43 @@
88
# percent_cases_well_formed: 89.9
99
# total_cost: 1.2366
1010

11+
# CEDARScript 1.1.3 + 1.1.6
12+
# gemini-1.5-flash-latest
13+
# pass_rate_1: 74.2
14+
# pass_rate_2: 75.3
15+
# pass_rate_3: 75.3
16+
# percent_cases_well_formed: 94.4
17+
# total_cost: 1.2109
1118

1219
@@ Worsened, now FAILED (5) @@
1320
The class identifier named `FxGraphDrawer`: 4 matches
14-
-- [0 -> -4] (--------------------) (++++++++++++++++++++) graph_drawer_FxGraphDrawer__stringify_tensor_meta
15-
21+
-- [0 -> -3] ( ------------) (++++++++++++++++++++) graph_drawer_FxGraphDrawer__stringify_tensor_meta
1622
Moved method now at 2-char indent:
17-
-- [0 -> -4] ( -) (++++++++++++++++++++) gradient_checker_GradientChecker__assertInferTensorChecks
18-
-- [0 -> -4] ( -------) (++++++++++++++++++++) i18n_JavaScriptCatalog_get_paths
19-
POSTPONED =- [-4 -> -4] ( ------------------) (++++++++++++++++++++) codeeditor_CodeEditor___get_brackets
23+
-- [0 -> -3] ( ----) (++++++++++++++++++++) gradient_checker_GradientChecker__assertInferTensorChecks
24+
-- [0 -> -3] ( ------------) (++++++++++++++++++++) i18n_JavaScriptCatalog_get_paths
2025

21-
> makemessages.py:208:20: E999 SyntaxError: unexpected character after line continuation character
22-
-- [0 -> -3] ( ---------------) (++++++++++++++++++++) makemessages_Command_add_arguments
23-
24-
-- [0 -> -3] ( --------) (++++++++++++++++++++) weather_NWSWeather__forecast
26+
-- [0 -> -3] ( -----------) (++++++++++++++++++++) base_BaseHandler_check_response
27+
-- [0 -> -3] ( ------------------) (++++++++++++++++++++) group_batch_fusion_GroupLinearFusion_fuse
2528

2629
@@ Stable: FAILED (17) @@
27-
=- [-4 -> -3] ( -------------------) (+++++++ ) builtin_BuiltinVariable_call_setattr
28-
=- [-4 -> -3] ( ----------------) (++++++++++++++++++++) common_methods_invocations_foreach_inputs_sample_func__sample_rightmost_arg
29-
=- [-4 -> -3] ( -------------------) (++++++++++++++++++++) common_utils_TestCase_genSparseTensor
30-
=- [-4 -> -3] ( -------------------) (++++++++++++++++ ) dataframeeditor_DataFrameView_next_index_name
30+
=- [-4 -> -3] ( ---------------) (++++++++++++++++++ ) builtin_BuiltinVariable_call_setattr
31+
POSTPONED =- [-4 -> -3] ( -------------------) (++++++++++++++++++++) codeeditor_CodeEditor___get_brackets
32+
=- [-4 -> -3] ( ------------) (++++++++++++++++++++) common_methods_invocations_foreach_inputs_sample_func__sample_rightmost_arg
33+
=- [-4 -> -3] ( ------------------) (++++++++++++++++++++) common_utils_TestCase_genSparseTensor
34+
=- [-4 -> -3] ( -----------------) (++++++++++++++ ) dataframeeditor_DataFrameView_next_index_name
3135
=- [-4 -> -3] ( -------------------) (++++++++++++++++++++) doc_DocCLI_display_plugin_list
32-
=- [-4 -> -3] ( -------------------) (+++++++ ) doc_DocCLI_get_role_man_text
36+
=- [-4 -> -3] ( -------------------) (+++++++++ ) doc_DocCLI_get_role_man_text
3337
=- [-4 -> -3] ( -------------------) (++++++++++++++++++++) figure_FigureBase_colorbar
34-
=- [-4 -> -3] ( -------------------) (++++++++++++ ) galaxy_GalaxyCLI_execute_list_collection
35-
=- [-4 -> -3] ( ------------------) (++++++++++++++++++++) generator_GenOpTestCase_out_variant_op_test_case_generator
38+
=- [-4 -> -3] ( -------------------) (+++++++++++++++ ) galaxy_GalaxyCLI_execute_list_collection
39+
=- [-4 -> -3] ( -----------------) (++++++++++++++++++++) generator_GenOpTestCase_out_variant_op_test_case_generator
3640
=- [-4 -> -3] ( -------------------) (+++++++++++ ) kernel_SpyderKernel_get_fault_text
3741
=- [-4 -> -3] ( -------------------) (++++ ) main_widget_PylintWidget_parse_output
38-
=- [-4 -> -3] ( -------------------) (+ ) patches__Curve__get_arrow_wedge
39-
=- [-4 -> -3] ( -------------------) (++++++ ) polar_RadialTick__determine_anchor
40-
=- [-4 -> -3] (--------------------) (++++++++++++++++++++) sharding_policies_MaxShardSizePolicy__add_partition
42+
=- [-4 -> -3] ( -------------------) (+++ ) patches__Curve__get_arrow_wedge
43+
=- [-4 -> -3] ( ----------------) (+++++++ ) polar_RadialTick__determine_anchor
44+
=- [-4 -> -3] ( ------------------) (++++++++++++++++++++) sharding_policies_MaxShardSizePolicy__add_partition
4145
=- [-4 -> -3] ( -------------------) (++++++++++++++++++++) symbolic_shapes_ShapeEnv_bind_symbols
42-
=- [-4 -> -3] ( -------------------) (++++++++++++ ) text_CountVectorizer__limit_features
46+
=- [-4 -> -3] ( -----------------) (+++++++++++++ ) text_CountVectorizer__limit_features
47+
4348
</report>
4449

4550
<no-train>

0 commit comments

Comments
 (0)