-
Notifications
You must be signed in to change notification settings - Fork 1.1k
parquet: rle skip decode loop on batch contains all max levels #9258
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
24968e2 to
58bfbcc
Compare
58bfbcc to
f5a1966
Compare
|
run benchmark arrow_reader |
|
🤖 |
|
🤖: Benchmark completed Details
|
Which issue does this PR close?
Rationale for this change
parquet reading perf - if rle value is true and rle left have enough room for the current batch. lets skip the decode loop the overhead of count_set_bits for null bitmap.
What changes are included in this PR?
Are these changes tested?
Are there any user-facing changes?