Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix failing scala unit tests by providing unique app IDs in test #53

Merged
merged 2 commits into from
Sep 3, 2024

Conversation

parthosa
Copy link
Owner

@parthosa parthosa commented Sep 2, 2024

This PR fixes the failing Scala Unit tests. This was mainly because we were processing multiple event logs with same App IDs.

Changes

  • Updated unit tests to ensure unique App IDs are provided.
  • Add a check and a unit test to ensure that if a user provides two event logs with the same App ID, only one is processed.

@parthosa parthosa force-pushed the spark-rapids-tools-1319-fix-UTs branch from 4d86a2f to 2fc2b3f Compare September 2, 2024 15:35
Signed-off-by: Partho Sarthi <[email protected]>
@parthosa parthosa changed the base branch from spark-rapids-tools-1319 to spark-rapids-tools-1319-b September 3, 2024 13:46
@parthosa parthosa force-pushed the spark-rapids-tools-1319-fix-UTs branch from 2fc2b3f to 81b9594 Compare September 3, 2024 13:46
@parthosa parthosa merged commit ad85630 into spark-rapids-tools-1319-b Sep 3, 2024
13 of 14 checks passed
@parthosa parthosa deleted the spark-rapids-tools-1319-fix-UTs branch September 3, 2024 15:39
parthosa added a commit that referenced this pull request Sep 3, 2024
* Adding synchronization on the reporting and autotuner level

Signed-off-by: Ahmed Hussein (amahussein) <[email protected]>

* Fix failing scala unit tests by providing unique app IDs in test (#53)

* Fix UTs

Signed-off-by: Partho Sarthi <[email protected]>

* Ignore test for event logs with same app Id and attempt Id

Signed-off-by: Partho Sarthi <[email protected]>

---------

Signed-off-by: Partho Sarthi <[email protected]>

---------

Signed-off-by: Ahmed Hussein (amahussein) <[email protected]>
Signed-off-by: Partho Sarthi <[email protected]>
Co-authored-by: Ahmed Hussein (amahussein) <[email protected]>
parthosa added a commit that referenced this pull request Sep 10, 2024
…ut in Scala Tool (NVIDIA#1324)

* Add safeguards to prevent older attempts from generating qual summary output
* Adding synchronization on the reporting and autotuner level (#54)
* Fix failing scala unit tests by providing unique app IDs in test (#53)
* Ignore test for event logs with same app Id and attempt Id

---------

Signed-off-by: Partho Sarthi <[email protected]>
Signed-off-by: Ahmed Hussein (amahussein) <[email protected]>
Co-authored-by: Ahmed Hussein (amahussein) <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant