Completed TEST012 category harmonisation testing#90
Open
susan-shuhan-yan wants to merge 1 commit into
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR validates the category harmonisation outputs generated from the Food Remedy cleaning pipeline. The testing focused on verifying category consistency, aligned category fields, and standardised search tags used for filtering and recommendation queries.
What was tested
Executed the cleanProductData pipeline successfully
Validated standardCategory values across cleaned products
Compared standardCategory and category fields for consistency
Verified searchTags generation and formatting
Checked cleaned dataset outputs for category mismatches
Validation Results
Categories remained consistent across the cleaned dataset
No mismatches detected between standardCategory and category
searchTags were normalised correctly for filtering and recommendation support
Cleaned dataset generated successfully with valid outputs
Files Reviewed
database/clean_data/cleanProductData.py
database/clean_data/cleanSample.json
Evidence / Screenshots
Shows aligned standardCategory and category values within the cleaned dataset.
Shows standardised searchTags generated consistently for recommendation and filtering queries.