Skip to content

Commit

Permalink
Merge pull request #20 from kevinsunny1996/task/correct_dag_dependencies
Browse files Browse the repository at this point in the history
fixed taskgroup dependency
  • Loading branch information
kevinsunny1996 authored May 13, 2024
2 parents db2438c + 96172cc commit a9d59ee
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions dags/rawg_api_extractor_dag.py
Original file line number Diff line number Diff line change
Expand Up @@ -541,8 +541,8 @@ def update_page_number(rawg_page_number: int) -> int:
remove_extracted_api_parquet_files(rawg_landing_gcs_bucket)
update_page_number(rawg_page_number)

# DAG Flow
initialize_vars_and_check_hibernation() >> extract_rawg_api_data() >> load_extracted_data_to_bq() >> post_load_cleanup()
# DAG Flow
initialize_vars_and_check_hibernation() >> extract_rawg_api_data() >> load_extracted_data_to_bq() >> post_load_cleanup()

rawg_api_extractor_dag()

0 comments on commit a9d59ee

Please sign in to comment.