-
Notifications
You must be signed in to change notification settings - Fork 1.5k
Minor: split datafusion-cli testing into its own CI job #15075
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -166,7 +166,7 @@ jobs: | |
- name: Check datafusion-functions (string_expressions) | ||
run: cargo check --profile ci --all-targets --no-default-features --features=string_expressions -p datafusion-functions | ||
|
||
# Run tests | ||
# Library and integration tests | ||
linux-test: | ||
name: cargo test (amd64) | ||
needs: linux-build-lib | ||
|
@@ -180,6 +180,36 @@ jobs: | |
run: rustup toolchain install stable | ||
- name: Install Protobuf Compiler | ||
run: sudo apt-get install -y protobuf-compiler | ||
- name: Run tests (excluding doctests and datafusion-cli) | ||
env: | ||
RUST_BACKTRACE: 1 | ||
run: | | ||
cargo test \ | ||
--profile ci \ | ||
--exclude datafusion-examples \ | ||
--exclude ffi_example_table_provider \ | ||
--exclude datafusion-benchmarks \ | ||
--exclude datafusion-cli \ | ||
--workspace \ | ||
--lib \ | ||
--tests \ | ||
--bins \ | ||
--features serde,avro,json,backtrace,integration-tests | ||
- name: Verify Working Directory Clean | ||
run: git diff --exit-code | ||
|
||
# datafusion-cli tests | ||
linux-test-datafusion-cli: | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. the point is to split the run into its own job into its own test There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. was it intentional to keep cli tests for mac? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Update: I actually think it is good to have the mac tests still run (even if not integration tests) to provide basic coverage There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. fair There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I am thinking especially newlne / formatting nonsense that is subtly different on mac |
||
name: cargo test datafusion-cli (amd64) | ||
needs: linux-build-lib | ||
runs-on: ubuntu-latest | ||
steps: | ||
- uses: actions/checkout@v4 | ||
with: | ||
submodules: true | ||
fetch-depth: 1 | ||
- name: Setup Rust toolchain | ||
run: rustup toolchain install stable | ||
- name: Setup Minio - S3-compatible storage | ||
run: | | ||
docker run -d --name minio-container \ | ||
|
@@ -200,13 +230,14 @@ jobs: | |
AWS_SECRET_ACCESS_KEY: TEST-DataFusionPassword | ||
TEST_STORAGE_INTEGRATION: 1 | ||
AWS_ALLOW_HTTP: true | ||
run: cargo test --profile ci --exclude datafusion-examples --exclude ffi_example_table_provider --exclude datafusion-benchmarks --workspace --lib --tests --bins --features avro,json,backtrace,integration-tests | ||
run: cargo test --profile ci -p datafusion-cli --lib --tests --bins | ||
- name: Verify Working Directory Clean | ||
run: git diff --exit-code | ||
- name: Minio Output | ||
if: ${{ !cancelled() }} | ||
run: docker logs minio-container | ||
|
||
|
||
linux-test-example: | ||
name: cargo examples (amd64) | ||
needs: linux-build-lib | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
datafusion-cli is excluded here now
I also expanded out this list of tests to make it easier to read