Skip to content

Commit

Permalink
Merge pull request #4 from rdnfn/dev/zwei
Browse files Browse the repository at this point in the history
Improve docs and fix vote cache issues
  • Loading branch information
rdnfn authored Feb 7, 2025
2 parents a35c370 + f9f4462 commit bca18b7
Show file tree
Hide file tree
Showing 4 changed files with 658 additions and 22 deletions.
11 changes: 11 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -93,6 +93,17 @@ icai-exp -cd ./exp/configs/001_synthetic_orthogonal
> **To re-run paper experiments**:
> Look at the README file inside the `exp/configs`. This file gives detailed instructions on which configurations to run, and how to generate the corresponding plots.
### Using cache to continue aborted experiment

**[Experimental feature]** Sometimes long-running (expensive) ICAI experiments get interrupted. Instead of requiring a full re-run, the ICAI package supports continuing certain experiments after they were interupted. This feature is only available for the voting stage of experiments: only for experiments that do not generate principles but use a pre-existing principle list to test.

To re-start an experiment with log dir `exp/outputs/prior-experiment` and config dir `exp/configs/exp-config`, use the following command:
```
icai-exp -cd exp/configs/prior-experiment prior_cache_path='exp/outputs/prior-experiment'
```
>[!WARNING]
> Note that there is no strict config consistency check between cache and new experiment - thus use with caution, only using caches from prior experiments with identical configs.
## Development

### Dev installation
Expand Down
Loading

0 comments on commit bca18b7

Please sign in to comment.