Update dependencies for df-ray #67
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixes #63
Update dependencies of the project, notably:
datafusion.protoanddatafusion_common.protofrom DataFusion 45Small changes included:
stage_id()method left over inStageHandlerInnerno longer necessary after preallocatingRayStagesAll tpch queries validate using the cmd line:
DATAFUSION_RAY_LOG_LEVEL=info RAY_COLOR_PREFIX=1 RAY_DEDUP_LOGS=0 python tpcbench.py --data='file:///Users/rob.tandy/tmp/tpch_single/' --concurrency 3 --partitions-per-worker 2 --batch-size=8192 --worker-pool-min=10 --validate