Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Collect agg merge engine return duplicate list even we set filed distinct #4999

Open
2 tasks done
neuyilan opened this issue Jan 26, 2025 · 0 comments · May be fixed by #5000
Open
2 tasks done

[Bug] Collect agg merge engine return duplicate list even we set filed distinct #4999

neuyilan opened this issue Jan 26, 2025 · 0 comments · May be fixed by #5000
Labels
bug Something isn't working

Comments

@neuyilan
Copy link
Member

neuyilan commented Jan 26, 2025

Search before asking

  • I searched in the issues and found nothing similar.

Paimon version

master
1.0
0.9
0.8

Compute Engine

none

Minimal reproduce step

  1. create table with collect agg and distinct field
CREATE TABLE test_collect( 
  id INT PRIMARY KEY NOT ENFORCED,
  f0 ARRAY<STRING>
) WITH (
  'merge-engine' = 'aggregation',
  'fields.f0.aggregate-function' = 'collect',
  'fields.f0.distinct' = 'true'
)
  1. insert values

INSERT INTO test_collect VALUES (1, ARRAY['A', 'B', 'A', 'A']);

  1. query the results.

SELECT * FROM test_collect

the result is as follows, it does not meet expectations
1, [A, B, A, A]

What doesn't meet your expectations?

Return deduplicate list value.
for above example, the result shoud be:

1, [A, B]

Anything else?

no

Are you willing to submit a PR?

  • I'm willing to submit a PR!
@neuyilan neuyilan added the bug Something isn't working label Jan 26, 2025
@neuyilan neuyilan linked a pull request Jan 26, 2025 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant