Improve the github actions

---

Migrated from https://github.com/mlcommons/mlperf-automations_archived/issues/3
Originally created by @arjunsuresh on *Mon, 18 Nov 2024 18:10:40 GMT*

---
We need to use the below PR as reference to improve the security of our github actions.
https://github.com/mlcommons/inference/pull/1936