Add benchmark results processing and deployment#1
Conversation
c0cabbf to
1ef4975
Compare
| - name: Checkout processing script | ||
| uses: actions/checkout@v3 | ||
| with: | ||
| repository: cz4rs/benchmark_monitor |
There was a problem hiding this comment.
| repository: cz4rs/benchmark_monitor | |
| repository: kokkos/benchmark_monitor |
There was a problem hiding this comment.
Original script: https://github.com/bensanmorris/benchmark_monitor
I have modified / customized it for our use case here: https://github.com/cz4rs/benchmark_monitor
I propose that we fork the original thing and I will deliver my changes with a pull request.
There was a problem hiding this comment.
I agree on forking this inside kokkos is the best option
There was a problem hiding this comment.
Looking back at this, I think this whole step should be removed and benchmark_monitor.py script (plus the templates and requirements.txt) should be added to a subdirectory in this repo.
95d36dc to
8e42a88
Compare
f7a5d2e to
886bbe5
Compare
18ccb52 to
ded96e0
Compare
9808512 to
82ad433
Compare
82ad433 to
788b20d
Compare
788b20d to
713c54b
Compare
713c54b to
20181d8
Compare
|
Did ever get back to this? |
I haven't tested it since the last push (Apr 2023), but functionally this was ready to go at the time. The only change I would make is to simply add Main drawback is that the results from GitHub runners are no that great (not an isolated environment for reliable performance measurement). IIRC there were talks about having something similar run on Jenkins (with proper isolation and CUDA enabled). |
fixes kokkos/kokkos#5464
Process benchmark results and deploy generated pages.
Deployment targets
deploy-benchmarksbranch of this repository and should make the webpage appear at https://kokkos.github.io/kokkos-benchmark-results/.