Skip to content

Commit

Permalink
fixing abstract
Browse files Browse the repository at this point in the history
  • Loading branch information
valentina-s committed May 31, 2024
1 parent db57645 commit 7af57ce
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions papers/valentina_staneva/main.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,7 @@
# Ensure that this title is the same as the one in `myst.yml`
title: "echodataflow: Configurable, Reproducible, and Scalable Fisheries Acoustics Workflows with Prefect"
abstract: |
With the influx of large data from multiple instruments and experiments, scientists are wrangling complex data pipelines that are context-dependent and non-reproducible. We demonstrate how we leverage Prefect, a modern orchestration framework, to facilitate fisheries acoustics data processing. We built a Python package `echodataflow` which 1) wraps common echosounder data processing steps in a few lines of code; 2) allows users to specify workflows and their parameters through editing text “recipes” which provide transparency and reproducibility of the pipelines; 3) supports scaling of the workflows while abstracting the computational infrastructure; 4) provides monitoring and logging of the workflow progress. Under the hood, echodataflow uses Prefect to execute the workflows while providing a domain-friendly interface to facilitate diverse fisheries acoustics use cases. We demonstrate the features through a typical ship survey data processing pipeline.

With the influx of large data from multiple instruments and experiments, scientists are wrangling complex data pipelines that are context-dependent and non-reproducible. We demonstrate how we leverage Prefect, a modern orchestration framework, to facilitate fisheries acoustics data processing. We built a Python package `echodataflow` which 1) wraps common echosounder data processing steps in a few lines of code; 2) allows users to specify workflows and their parameters through editing text “recipes” which provide transparency and reproducibility of the pipelines; 3) supports scaling of the workflows while abstracting the computational infrastructure; 4) provides monitoring and logging of the workflow progress. Under the hood, echodataflow uses Prefect to execute the workflows while providing a domain-friendly interface to facilitate diverse fisheries acoustics use cases. We demonstrate the features through a typical ship survey data processing pipeline.
---

## Fisheries Acoustics Workflows
Expand Down

0 comments on commit 7af57ce

Please sign in to comment.