v0.8.109-nightly

What's Changed

Exciting New Features ✨

• feat: change PrecommitBlock serde from serde_json to bincode by @BohuTANG in #8764

Code Refactor 🎉

• refactor(input_foramt): change to UserStageInfo for get_splits trait by @BohuTANG in #8757
• refactor(aggregator): unified hashtable interface by @zhang2014 in #8681

Documentation 📔

• docs:Update 10-ddl-create-table.md by @wubx in #8758

Full Changelog: v0.8.108-nightly...v0.8.109-nightly

v0.8.108-nightly

What's Changed

Thoughtful Bug Fix 🔧

• fix(mysql): fix databend float64 to mysql double by @sandflee in #8745
• fix(query): the hashmap will cause oom by @TCeason in #8737
• fix: make explain pipeline go to correct path in cluster by @xudong963 in #8753

Code Refactor 🎉

• refactor(catalog): unify the catalog name defination to catalog_kind by @BohuTANG in #8742
• refactor(out format): move output_format_xxx.rs to a sub-folder. by @youngsofun in #8740
• refactor(expr): refine domain by @andylokandy in #8755

Full Changelog: v0.8.107-nightly...v0.8.108-nightly

v0.8.107-nightly

What's Changed

Exciting New Features ✨

• feat(query): optimize count(no_null_col) by @TCeason in #8728
• feat: adjust max io requests when read block data to avoid oom by @BohuTANG in #8726

Code Refactor 🎉

• refactor: replace NestedCheckpointReader with Cursor. by @youngsofun in #8716
• refactor: rich error info for Schema not matched by @xudong963 in #8723
• refactor(handler): use FieldEncoder to encode data. by @youngsofun in #8733
• refactor: remove V2 postfix in cluster by @xudong963 in #8736

Build/Testing/CI Infra Changes 🔌

• ci: Instal cccache v0.5 instead by @Xuanwo in #8729
• ci: Try to use sccache by @Xuanwo in #8709
• ci: Disable incremental for dev profile by @Xuanwo in #8738

Documentation 📔

• docs: load data overview by @soyeric128 in #8691

Full Changelog: v0.8.106-nightly...v0.8.107-nightly

v0.8.106-nightly

What's Changed

Code Refactor 🎉

• refactor: Use range_read instead of read_exact by @Xuanwo in #8725

Build/Testing/CI Infra Changes 🔌

• ci: Install sccache in dev-setup to avoid large docker images by @Xuanwo in #8712

Full Changelog: v0.8.105-nightly...v0.8.106-nightly

v0.8.105-nightly

What's Changed

Exciting New Features ✨

• feat(query): add a simple improve and fix bug for sort. by @RinChanNOWWW in #8715
• feat(query): optimize stringsearch like by @TCeason in #8720

Thoughtful Bug Fix 🔧

• fix(expr): fix PartialEq for ScalarRef and add benchmark for array() by @andylokandy in #8713
• fix(query): max_threads can not determined automatically by @TCeason in #8707

Code Refactor 🎉

• refactor: refactor output format with FieldEncoders by @youngsofun in #8700
• refactor: remove useless code in cluster by @xudong963 in #8717

Build/Testing/CI Infra Changes 🔌

• ci: Install sccache for future use by @Xuanwo in #8705
• ci: Add set -e for all our ci scripts by @Xuanwo in #8704
• ci: Install sccache in build-tool:base by @Xuanwo in #8711

Full Changelog: v0.8.104-nightly...v0.8.105-nightly

v0.8.104-nightly

What's Changed

Exciting New Features ✨

• feat: add inlist expr in new expression by @sundy-li in #8676
• feat(csv): allow no new line at the file end by @youngsofun in #8698
• feat: multiple catalog create (planner and catalog manager) by @ClSlaid in #8620

Thoughtful Bug Fix 🔧

• fix(query): Problem when using Trino Mysql connector by @TCeason in #8668

Code Refactor 🎉

• refactor: replace rwlock settings and planner by @ClSlaid in #8694
• refactor(optimizer): fix error info by @xudong963 in #8697
• refactor(copy): try move list files to read_partitions by @BohuTANG in #8673

Build/Testing/CI Infra Changes 🔌

• ci: Upload entire directory instead by @Xuanwo in #8686
• ci: Disable 13_0005_q5 to avoid breaking CI by @Xuanwo in #8699

Full Changelog: v0.8.103-nightly...v0.8.104-nightly

v0.8.103-nightly

What's Changed

Exciting New Features ✨

• feat(query): use new sort pipeline for recluster. by @RinChanNOWWW in #8658
• feat(query): improve sort and introduce short paths. by @RinChanNOWWW in #8677
• feat(download): download support CsvWithNames. by @youngsofun in #8687

Thoughtful Bug Fix 🔧

• fix(meta): emit kv change events after committing a transaction by @drmingdrmer in #8674
• fix(compact): fix typo in compactor. by @youngsofun in #8680
• fix(copy): fix wrong asserts. by @youngsofun in #8684

Code Refactor 🎉

• refactor(storage): replace RwLocks with DashMap by @ClSlaid in #8639
• refactor: compact segments by @dantengsky in #8590
• refactor(query): remove sqlparser-rs by @b41sh in #8670

Build/Testing/CI Infra Changes 🔌

• ci: Bump to nightly-2022-11-07 to address rust-lang/cargo#11183 by @Xuanwo in #8665
• ci: Bump rust-toolchain to nightly-2022-11-07 instead by @Xuanwo in #8667
• ci: Enable backtrace to debug cluster related issue by @Xuanwo in #8672

Full Changelog: v0.8.102-nightly...v0.8.103-nightly

v0.8.102-nightly

What's Changed

Thoughtful Bug Fix 🔧

• fix: The download page is replaced with our own interface by @Chasen-Zhang in #8659

Code Refactor 🎉

• refactor(planner): move plan from query/planner to sql/planner by @BohuTANG in #8660
• refactor(query): modify the index of the Array<T> type starting from 1 by @b41sh in #8652
• refactor(catalog): remove delete by @BohuTANG in #8662

Full Changelog: v0.8.101-nightly...v0.8.102-nightly

v0.8.101-nightly

What's Changed

Exciting New Features ✨

• feat: Upgrade to 1.67 nightly by @Xuanwo in #8631
• feat: copy files order by last modified time asc by @BohuTANG in #8628
• feat(query): improve sort. by @RinChanNOWWW in #8452
• feat(compact): optimize compact for data load. by @youngsofun in #8644

Thoughtful Bug Fix 🔧

• fix(union): union's pairs are handled incorrectly by @xudong963 in #8638

Code Refactor 🎉

• refactor(query): migrate deserializations to expression by @b41sh in #8637
• refactor(storages): merge storages/constants to storages/table-meta by @BohuTANG in #8648
• refactor(expr): redo cast by @andylokandy in #8641

Build/Testing/CI Infra Changes 🔌

• ci: Upgrade rust toolchain to 1.67-nightly by @Xuanwo in #8630

Documentation 📔

• docs: deploy local by @soyeric128 in #8632

Full Changelog: v0.8.100-nightly...v0.8.101-nightly

v0.8.100-nightly

What's Changed

Exciting New Features ✨

• feat(function): add to_xxx() cast function by @andylokandy in #8599
• feat: support copy from xml. by @eliasyaoyc in #8404
• feat(query): add collation by @sundy-li in #8610
• feat(query): fix ut by @sundy-li in #8617
• feat(planner): optimize left/single join by @xudong963 in #8583
• feat: Add cache operator in global services by @Xuanwo in #8616
• feat: add meta_type config by @lichuang in #8571

Code Refactor 🎉

• refactor: Remove not needed re-export by @Xuanwo in #8612
• refactor(storages): move prelude table engines from preludes to storages by @BohuTANG in #8613
• refactor(test): one dir for format. by @youngsofun in #8618
• refactor(storages): move fuse&hive to single folder by @BohuTANG in #8621
• refactor(storages): fuse/fuse-meta --> storages/table-meta by @BohuTANG in #8627
• refactor(planner): use const MAX_BLOCK_SIZE in join probe by @xudong963 in #8626

New Contributors

• @eliasyaoyc made their first contribution in #8404

Full Changelog: v0.8.99-nightly...v0.8.100-nightly