You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A ParquetExec is created from a FileScanConfig and an optional filter predicate1. These two are different, independent parameters -- at least the documentation is not implying that the predicate should be considered when constructing the FileScanConfig. Now the statistics for the ParquetExec are calculated by FileScanConfig::project:
This forwards is_exact from the input which might have been set to true. However there is a predicate, is_exact should likely be false because some data may be removed which will mess up the exact statistic. So either the forwarding is wrong (at least when a predicate is given) or the docs are imprecise.
Note that this is unrelated to #5613 because this issue here is about the is_exact=true case.
Footnotes
And a metadata size hint, but this is irrelevant here. ↩
I checked this again and I think this is not the current behavior anymore. Current DataFusion treats these as pre-filter stats and marks them inexact when a filter is part of the scan. There is also a test covering this now. So this looks already fixed and can be closed.
Activity
kumarUjjawal commentedon Apr 10, 2026
I checked this again and I think this is not the current behavior anymore. Current DataFusion treats these as pre-filter stats and marks them inexact when a filter is part of the scan. There is also a test covering this now. So this looks already fixed and can be closed.
crepererum commentedon Apr 15, 2026
Trusting your judgement on this one 👍