Repository navigation

Implement `CardinalityAwareRowConverter` while doing streaming merge - #7401

Merged

alamb merged 61 commits into

apache:mainfrom

JayjeetAtGithub:sort-fix

Sep 18, 2023

Merged

Implement `CardinalityAwareRowConverter` while doing streaming merge#7401
alamb merged 61 commits into
apache:mainfrom
JayjeetAtGithub:sort-fix

Commits on Sep 8, 2023
- Use CardinalityAwareRow converter
  JayjeetAtGithub
  committed
  b80e702
- Move CardinalityAwareRowConverter in df
  JayjeetAtGithub
  committed
  d83fae2
- Move CardinalityAwareRowConverter in df
  JayjeetAtGithub
  committed
  546ccff
- Remove unnecessary clone and make wrapper mod private
  JayjeetAtGithub
  committed
  e9fb8af
- Use as_any_dictionary_opt
  JayjeetAtGithub
  committed
  c5c707a
- Remove unnecessary comments
  JayjeetAtGithub
  committed
  22fb159
- Remove done
  JayjeetAtGithub
  committed
  65a0209
- Add test for cardinality aware row converter on high card dict
  JayjeetAtGithub
  committed
  bd5faf7
- Add test for cardinality aware row converter on low card dict
  JayjeetAtGithub
  committed
  80d3bf2
- Ignore the test_dict_merge_infinite test
  JayjeetAtGithub
  committed
  5eff541
- Remove phantom Arc import
  JayjeetAtGithub
  committed
  2651532
- Remove the infinite stream test
  JayjeetAtGithub
  committed
  7da3681
- Update datafusion/core/src/physical_plan/wrapper.rs
  
  JayjeetAtGithub
  and
  alamb
  committed
  6cc6468
- Update convert_rows signature and add empty_rows
  JayjeetAtGithub
  committed
  74aaa59
- Add comments to the test
  JayjeetAtGithub
  committed
  0d305ee
- Use Some and take() semantics
  JayjeetAtGithub
  committed
  2391f43
- Init with a row converter instance instead of none
  JayjeetAtGithub
  committed
  05685a1
- Remove unused variable
  JayjeetAtGithub
  committed
  f107f27
- Remove unused imports
  JayjeetAtGithub
  committed
  e44e600
- Remove unused imports
  JayjeetAtGithub
  committed
  068695e
- Change GroupValues
  JayjeetAtGithub
  committed
  c7fa020
- Add comments, run fmt
  alamb
  committed
  4c054f6
- Init with a empty row converter
  JayjeetAtGithub
  committed
  c58539b
- Use the cardinality aware row converter
  JayjeetAtGithub
  committed
  74533c6
Commits on Sep 9, 2023
- Reconvert the group values
  JayjeetAtGithub
  committed
  b90f40d
- Rename wrapper to row_converter
  JayjeetAtGithub
  committed
  4cf0218
- Recovert the group values
  JayjeetAtGithub
  committed
  eb81191
Commits on Sep 10, 2023
- Convert back to dictionary
  JayjeetAtGithub
  committed
  d22b645
Commits on Sep 11, 2023
- fmt
  alamb
  committed
  aa24717
- A fmt pass
  JayjeetAtGithub
  committed
  dbd66f2
- fix: fmt
  alamb
  committed
  8a42957
- Move the reconversion to dict to just consider group by columns
  JayjeetAtGithub
  committed
  1a9a58d
- Reconvert only the correct cols
  JayjeetAtGithub
  committed
  acf1cd4
- Use assert eq
  JayjeetAtGithub
  committed
  6543b9d
- clippy
  alamb
  committed
  c6bf41a
- clippy
  alamb
  committed
  08c6f7d
- Merge branch 'sort-fix' of github.com:JayjeetAtGithub/arrow-datafusion into sort-fix
  alamb
  committed
  befc9b5
- Merge remote-tracking branch 'apache/main' into sort-fix
  alamb
  committed
  db800c4
- Add comment about the reconversion to dict
  JayjeetAtGithub
  committed
  c965bbe
- Fix the merge issues
  JayjeetAtGithub
  committed
  8244c83
Commits on Sep 12, 2023
- move data type conversion
  alamb
  committed
  235f3bc
- fix
  alamb
  committed
  f3eb44c
- fix docs
  alamb
  committed
  664e6a0
- Merge remote-tracking branch 'apache/main' into sort-fix
  alamb
  committed
  9a965ca
- fix bug
  alamb
  committed
  bbc5982
- Improve tests
  alamb
  committed
  a1f69a7
- simplify
  alamb
  committed
  76feb4f
- Use cardinality aware row converter in gby order
  alamb
  committed
  137d78e
- clippy
  alamb
  committed
  65d31cc
- Adjust memory test
  alamb
  committed
  9b5681d
Commits on Sep 13, 2023
- Merge remote-tracking branch 'apache/main' into sort-fix
  alamb
  committed
  b2fedac
- Add doc comments about row converter
  alamb
  committed
  b673c09
- remove outdated comment
  alamb
  committed
  25861a7
- Rework partition size calculation to make test clearer
  alamb
  committed
  355ef73
Commits on Sep 15, 2023
- Increase threshold to 512
  JayjeetAtGithub
  committed
  f48325a
- Update row converter tests according to new threshold
  JayjeetAtGithub
  committed
  22a90e7
Commits on Sep 18, 2023
- Merge remote-tracking branch 'apache/main' into sort-fix
  alamb
  committed
  819bd09
- fix clippy
  alamb
  committed
  fdb4835
- Merge remote-tracking branch 'apache/main' into sort-fix
  alamb
  committed
  b49a5bd
- fix panic
  alamb
  committed
  efca2b2
- Adjust constant for test
  alamb
  committed
  8498d04

Commits

Commits on Sep 8, 2023

Commits on Sep 9, 2023

Commits on Sep 10, 2023

Commits on Sep 11, 2023

Commits on Sep 12, 2023

Commits on Sep 13, 2023

Commits on Sep 15, 2023

Commits on Sep 18, 2023