Skip to content

Conversation

@jlon
Copy link
Contributor

@jlon jlon commented Oct 30, 2025

This PR implements bidirectional data transfer for LoadJob, enabling both Import (UFS → Curvine) and Export (Curvine → UFS) operations. Previously, LoadJob only supported single-direction Import from UFS to Curvine.
Supported Operations

Operation Source Target Status
Import UFS (s3://) Curvine (/) ✅ Existing + Enhanced
Export Curvine (/) UFS (s3://) New

Usage Examples

Import (UFS → Curvine)

# Explicit target path
cv load s3://bucket/file.txt --target /data/file.txt

# Auto-detect (uses mount table)
cv load s3://bucket/file.txt

Export (Curvine → UFS) - NEW

# Explicit target path
cv load /mnt/s3/file.txt --target s3://bucket/file.txt --overwrite true

# Auto-detect (uses mount table)
cv load /mnt/s3/file.txt --overwrite false

@jlon jlon force-pushed the feature/load-job-bidirectional branch from 5861f75 to 82e450a Compare October 31, 2025 00:52
@jlon jlon force-pushed the feature/load-job-bidirectional branch from 82e450a to 0843f60 Compare October 31, 2025 00:54
@jlon jlon force-pushed the feature/load-job-bidirectional branch from 2ce71d2 to baa9e4c Compare November 3, 2025 02:48
@jlon jlon closed this Nov 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant