-
Couldn't load subscription status.
- Fork 1
Description
Overview
Currently new and existing entities validation with endpoint source and lookup csv files are getting handled in the check_url Celery task. Based on the discussion seperate celery tasks for add data and check url should be better approach
Tech Approach
separate tasks would be better, given distinct processing needs.
“check URL” → verification stage (Existing Task)
“assign entities” (new proposed task) → entity generation stage
“add data” → eventual data persistence
Acceptance Criteria/Tests
New Celery worker task should be able to handle all the functionality of new entities assignment and existing entity validation along with lookup endpoint and source file functionalities.
It should be able to store the data in to response table.
It should be able to provide the proper response to the endpoint in structured format so that ui can render it for copy pasting the data for collecting and managing data team
Metadata
Metadata
Assignees
Labels
Type
Projects
Status