Refactor _run_node_async to use asyncio

[ravi-kumar-pilla]

Description

Resolves #4289

Development notes

• Use asyncio.run to call _run_node_async when Task.execute is called with is_async=True.
• Refactor _run_node_async method to use asyncio
• Create async tasks to load and save datasets concurrently.
• Created helper methods _async_dataset_load and _async_dataset_save to load and save datasets.
• Used asyncio.to_thread for IO blocking operations (catalog.load and catalog.save)
• Updated tests

QA notes

• All tests should pass
• For manual testing -

1. Create a pipeline which takes multiple inputs and produces multiple outputs as suggested here

# async_test_pipeline/pipeline.py
def create_pipeline(**kwargs) -> Pipeline:
    return Pipeline([
        node(
            func=process_ds,
            inputs=["companies", "shuttles"],
            outputs=["preprocessed_companies", "preprocessed_shuttles"],
            name="preprocess_node"
        )
    ])


# async_test_pipeline/nodes.py
def process_ds(companies: pd.DataFrame, shuttles: pd.DataFrame):
    return preprocess_companies(companies), preprocess_shuttles(shuttles)

2. Try executing the pipeline with kedro run --pipeline=async_test_pipeline and kedro run --pipeline=async_test_pipeline --async. Both should yield similar results
3. To check for performance, you can also run time kedro run --pipeline=async_test_pipeline and time kedro run --pipeline=async_test_pipeline --async. (NOTE: I haven't seen much difference with the datasets available)

Developer Certificate of Origin

We need all contributions to comply with the Developer Certificate of Origin (DCO). All commits must be signed off by including a Signed-off-by line in the commit message. See our wiki for guidance.

If your PR is blocked due to unsigned commits, then you must follow the instructions under "Rebase the branch" on the GitHub Checks page for your PR. This will retroactively add the sign-off to all unsigned commits and allow the DCO check to pass.

Checklist

• Read the contributing guidelines
• Signed off each commit with a Developer Certificate of Origin (DCO)
• Opened this PR as a 'Draft Pull Request' if it is work-in-progress
• Updated the documentation to reflect the code changes
• Added a description of this change in the RELEASE.md file
• Added tests to cover my changes
• Checked if this change will affect Kedro-Viz, and if so, communicated that with the Viz team

[merelcht]

This looks great @ravi-kumar-pilla ! Much cleaner than before. I left some minor comments, but otherwise all good 👍

[merelcht]

LGTM 👍

[ankatiyar]

Thanks @ravi-kumar-pilla, add it to the release notes :) (Also appreciate the QA notes)

[ravi-kumar-pilla]

Thanks @ravi-kumar-pilla, add it to the release notes :) (Also appreciate the QA notes)

Thank you @ankatiyar ....since this is not a user facing change, I removed it from release notes as suggested here