Skip to content

Replace staged input file with original URL#45

Merged
bentsherman merged 1 commit intomainfrom
fix-staged-input
Oct 23, 2025
Merged

Replace staged input file with original URL#45
bentsherman merged 1 commit intomainfrom
fix-staged-input

Conversation

@bentsherman
Copy link
Member

@bentsherman bentsherman commented Mar 21, 2025

This PR uses nextflow-io/nextflow#5911 to trace staged input files to their original URL.

Test:

# initial run
rm -rf ~/.nextflow/plugins/nf-prov-1.4.0
nextflow run nf-prov-test/

# build nf-prov
(cd ../nextflow ; ./gradlew :nextflow:publishToMavenLocal)
make install

# resumed run (should fully resume)
../nextflow/build/releases/nextflow-25.03.1-edge-dist run nf-prov-test/ -plugins nf-prov@1.4.0 -resume

Before:

{
    "name": "de11525869ad90b98a2d376c4c30a545",
    "description": "WC_SAMPLE (1)",
    "input_list": [
        {
            "uri": "work/stage-5170692d-7ce4-44da-877a-8ed0fc6a9f29/b9/75a58cde91580a079c4fca5d42d70e/read2.fq.gz"
        },
        {
            "uri": "work/stage-5170692d-7ce4-44da-877a-8ed0fc6a9f29/4d/58a16d7add20fdcddcff6bdeea01d5/read1.fq.gz"
        }
    ],
}

After:

{
    "name": "de11525869ad90b98a2d376c4c30a545",
    "description": "WC_SAMPLE (1)",
    "input_list": [
        {
            "uri": "https://openstack.cebitec.uni-bielefeld.de:8080/swift/v1/denbi-mg-course/read2.fq.gz"
        },
        {
            "uri": "https://openstack.cebitec.uni-bielefeld.de:8080/swift/v1/denbi-mg-course/read1.fq.gz"
        }
    ],
}

@simleo
Copy link

simleo commented Mar 25, 2025

Does this mean that the plugin will require a minimum Nextflow version to work, and what would that be?

@bentsherman
Copy link
Member Author

If this gets merged, I would release a new plugin version that requires Nextflow 25.04 or newer. So if you use an older version of Nextflow, it will automatically use the current version of nf-prov

Signed-off-by: Ben Sherman <bentshermann@gmail.com>
@bentsherman bentsherman marked this pull request as ready for review October 23, 2025 16:59
@bentsherman bentsherman merged commit 27caf63 into main Oct 23, 2025
2 checks passed
@bentsherman bentsherman deleted the fix-staged-input branch October 23, 2025 17:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants