Skip to content

Commit bcd6c8f

Browse files
Structure documentation fixes
1 parent f808507 commit bcd6c8f

File tree

1 file changed

+9
-4
lines changed

1 file changed

+9
-4
lines changed

tools/submission/submission_structure.md

Lines changed: 9 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -3,8 +3,9 @@
33
The following diagram describes the submission structure
44

55
```
6-
├── ...
7-
│ ├── closed
6+
...
7+
├── closed
8+
│ ├── <submitter_name>
89
│ │ ├── code
910
│ │ │ └── <benchmark_name>
1011
│ │ ├── results
@@ -42,16 +43,20 @@ The following diagram describes the submission structure
4243
│ │ │ ├── ...
4344
│ │ │ └── <system_desc_id_n>.json
4445
│ │
45-
│ ├── open
46+
├── open
47+
│ ├── <submitter_name>
4648
│ │ ├── code
4749
│ │ ├── results
48-
│ │ └── systems
50+
│ │ ├── systems
51+
│ │ └── model_mapping.json (optional)
4952
...
5053
```
5154

5255
## Description of placeholders
5356

57+
**<submitter_name>:** Name of the submitter
5458
**<system_desc_id_X>:** Descriptive name of the system.
5559
**<benchmark_name>:** Name of the inference benchmark. E.g llama3.1-405b, rgat.
5660
**<scenario>:** Name of the benchmarking scenario. One of `["SingleStream", "MultiStream", "Offline", "Server", "Interactive"]`
5761
**<TEST0X>:** Compliance test number. E.g TEST01
62+
**model_mapping.json (optional):** Optional file for the open submission that contains a map from the submitters custom names to the official benchmark names.

0 commit comments

Comments
 (0)