Skip to content

Create a new Celery Worker Tasks for Add Data Processes #77

@sagar-code-git

Description

@sagar-code-git

Overview
Currently new and existing entities validation with endpoint source and lookup csv files are getting handled in the check_url Celery task. Based on the discussion seperate celery tasks for add data and check url should be better approach

Tech Approach
separate tasks would be better, given distinct processing needs.
“check URL” → verification stage (Existing Task)
“assign entities” (new proposed task) → entity generation stage
“add data” → eventual data persistence

Acceptance Criteria/Tests
New Celery worker task should be able to handle all the functionality of new entities assignment and existing entity validation along with lookup endpoint and source file functionalities.
It should be able to store the data in to response table.
It should be able to provide the proper response to the endpoint in structured format so that ui can render it for copy pasting the data for collecting and managing data team

Metadata

Metadata

Labels

enhancementNew feature or request

Type

No type

Projects

Status

In Review / QA 🔎

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions