DRAFT Bench 25044 by kosiew · Pull Request #25410 · apache/datafusion

kosiew · 2026-09-17T14:07:29Z

benchmark runs for #25044

… cap

kosiew · 2026-09-17T14:09:06Z

run benchmark string_in_list_pruning

baseline:
  ref: "d170cbc279"
changed:
  ref: "de602a59e0"

adriangbot · 2026-09-17T14:12:29Z

🤖 Benchmark running (GKE) | trigger
Instance: c4a-highmem-16 (12 vCPU / 65 GiB) | Linux bench-c5715755739-2403-z5x77 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux

CPU Details (lscpu)

Architecture:                            aarch64
CPU op-mode(s):                          64-bit
Byte Order:                              Little Endian
CPU(s):                                  16
On-line CPU(s) list:                     0-15
Vendor ID:                               ARM
Model name:                              Neoverse-V2
Model:                                   1
Thread(s) per core:                      1
Core(s) per cluster:                     16
Socket(s):                               -
Cluster(s):                              1
Stepping:                                r0p1
BogoMIPS:                                2000.00
Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache:                               1 MiB (16 instances)
L1i cache:                               1 MiB (16 instances)
L2 cache:                                32 MiB (16 instances)
L3 cache:                                80 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0-15
Vulnerability Gather data sampling:      Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit:             Not affected
Vulnerability L1tf:                      Not affected
Vulnerability Mds:                       Not affected
Vulnerability Meltdown:                  Not affected
Vulnerability Mmio stale data:           Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Not affected
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; CSV2, BHB
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected

Comparing de602a5 (de602a5) to d170cbc diff

Run configuration

run benchmark string_in_list_pruning
baseline:
  ref: "d170cbc279"
changed:
  ref: "de602a59e0"

Results will be posted here when complete

File an issue against this benchmark runner

codecov-commenter · 2026-09-17T14:34:36Z

Codecov Report

❌ Patch coverage is 96.15385% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 82.32%. Comparing base (c2cf289) to head (de602a5).
⚠️ Report is 68 commits behind head on main.

Files with missing lines	Patch %	Lines
datafusion/pruning/src/pruning_predicate.rs	96.15%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main   #25410      +/-   ##
==========================================
+ Coverage   81.90%   82.32%   +0.41%     
==========================================
  Files        1134     1137       +3     
  Lines      425261   431848    +6587     
  Branches   425261   431848    +6587     
==========================================
+ Hits       348325   355510    +7185     
+ Misses      56295    54846    -1449     
- Partials    20641    21492     +851

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

adriangbot · 2026-09-17T15:59:43Z

🤖 Benchmark completed (GKE) | trigger

Instance: c4a-highmem-16 (12 vCPU / 65 GiB)

Comparing de602a5 (de602a5) to d170cbc diff

Run configuration

run benchmark string_in_list_pruning
baseline:
  ref: "d170cbc279"
changed:
  ref: "de602a59e0"

CPU Details (lscpu)

Architecture:                            aarch64
CPU op-mode(s):                          64-bit
Byte Order:                              Little Endian
CPU(s):                                  16
On-line CPU(s) list:                     0-15
Vendor ID:                               ARM
Model name:                              Neoverse-V2
Model:                                   1
Thread(s) per core:                      1
Core(s) per cluster:                     16
Socket(s):                               -
Cluster(s):                              1
Stepping:                                r0p1
BogoMIPS:                                2000.00
Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache:                               1 MiB (16 instances)
L1i cache:                               1 MiB (16 instances)
L2 cache:                                32 MiB (16 instances)
L3 cache:                                80 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0-15
Vulnerability Gather data sampling:      Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit:             Not affected
Vulnerability L1tf:                      Not affected
Vulnerability Mds:                       Not affected
Vulnerability Meltdown:                  Not affected
Vulnerability Mmio stale data:           Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Not affected
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; CSV2, BHB
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected

Details

group                                                                                       HEAD                                     bench-25044
-----                                                                                       ----                                     -----------
string_in_list_pruning/construct/expanded_and/1                                             1.01      3.1±0.01µs 312.7 KElem/sec     1.00      3.1±0.01µs 315.8 KElem/sec
string_in_list_pruning/construct/expanded_and/1024                                          1.00      2.5±0.00ms 397.3 KElem/sec     1.01      2.5±0.01ms 395.0 KElem/sec
string_in_list_pruning/construct/expanded_and/16                                            1.00     39.5±0.16µs 395.6 KElem/sec     1.00     39.5±0.12µs 395.5 KElem/sec
string_in_list_pruning/construct/expanded_and/2                                             1.00      5.8±0.02µs 338.7 KElem/sec     1.00      5.8±0.01µs 337.5 KElem/sec
string_in_list_pruning/construct/expanded_and/20                                            1.00     48.7±0.08µs 401.0 KElem/sec     1.02     49.4±0.07µs 395.1 KElem/sec
string_in_list_pruning/construct/expanded_and/21                                            1.00     51.1±0.09µs 401.3 KElem/sec     1.01     51.6±0.06µs 397.5 KElem/sec
string_in_list_pruning/construct/expanded_and/256                                           1.00    626.4±0.98µs 399.1 KElem/sec     1.01    629.6±0.85µs 397.1 KElem/sec
string_in_list_pruning/construct/expanded_and/4                                             1.00     10.6±0.07µs 368.7 KElem/sec     1.00     10.6±0.02µs 367.1 KElem/sec
string_in_list_pruning/construct/expanded_and/8                                             1.00     20.5±0.11µs 381.7 KElem/sec     1.01     20.7±0.06µs 378.2 KElem/sec
string_in_list_pruning/construct/expanded_or/1                                              1.00      3.2±0.01µs 308.8 KElem/sec     1.00      3.2±0.01µs 309.1 KElem/sec
string_in_list_pruning/construct/expanded_or/1024                                           1.00      2.4±0.00ms 414.3 KElem/sec     1.01      2.4±0.01ms 411.5 KElem/sec
string_in_list_pruning/construct/expanded_or/16                                             1.00     38.0±0.14µs 411.7 KElem/sec     1.00     38.1±0.10µs 410.1 KElem/sec
string_in_list_pruning/construct/expanded_or/2                                              1.00      5.7±0.03µs 341.9 KElem/sec     1.00      5.7±0.01µs 341.5 KElem/sec
string_in_list_pruning/construct/expanded_or/20                                             1.00     47.2±0.08µs 414.1 KElem/sec     1.06     50.0±0.10µs 390.2 KElem/sec
string_in_list_pruning/construct/expanded_or/21                                             1.00     49.2±0.10µs 417.0 KElem/sec     1.02     49.9±0.06µs 410.7 KElem/sec
string_in_list_pruning/construct/expanded_or/256                                            1.00    601.0±2.07µs 416.0 KElem/sec     1.00    601.8±0.91µs 415.5 KElem/sec
string_in_list_pruning/construct/expanded_or/4                                              1.00     10.3±0.06µs 378.8 KElem/sec     1.01     10.4±0.02µs 374.2 KElem/sec
string_in_list_pruning/construct/expanded_or/8                                              1.00     19.6±0.10µs 399.5 KElem/sec     1.01     19.7±0.06µs 395.9 KElem/sec
string_in_list_pruning/construct/in_list/1                                                  1.00      2.9±0.01µs 334.2 KElem/sec     1.01      2.9±0.01µs 332.3 KElem/sec
string_in_list_pruning/construct/in_list/1024                                               1.01    191.0±0.53µs  5.1 MElem/sec      1.00    189.3±0.24µs  5.2 MElem/sec
string_in_list_pruning/construct/in_list/16                                                 1.00     37.8±0.08µs 413.3 KElem/sec     1.01     38.0±0.11µs 410.9 KElem/sec
string_in_list_pruning/construct/in_list/2                                                  1.00      5.7±0.02µs 341.8 KElem/sec     1.00      5.7±0.02µs 340.2 KElem/sec
string_in_list_pruning/construct/in_list/20                                                 1.00     47.0±0.09µs 415.6 KElem/sec     1.00     47.1±0.22µs 414.7 KElem/sec
string_in_list_pruning/construct/in_list/21                                                 1.00      6.3±0.02µs  3.2 MElem/sec      1.00      6.3±0.01µs  3.2 MElem/sec
string_in_list_pruning/construct/in_list/256                                                1.00     50.0±0.11µs  4.9 MElem/sec      1.00     50.0±0.05µs  4.9 MElem/sec
string_in_list_pruning/construct/in_list/4                                                  1.00     10.4±0.07µs 374.3 KElem/sec     1.00     10.4±0.04µs 374.9 KElem/sec
string_in_list_pruning/construct/in_list/8                                                  1.00     19.5±0.09µs 400.8 KElem/sec     1.01     19.7±0.03µs 396.1 KElem/sec
string_in_list_pruning/construct/in_list_with_null/1025                                     1.01    191.1±0.51µs  5.1 MElem/sec      1.00    189.6±0.25µs  5.2 MElem/sec
string_in_list_pruning/construct/in_list_with_null/17                                       1.00     40.2±0.08µs 413.4 KElem/sec     1.00     40.3±0.12µs 411.5 KElem/sec
string_in_list_pruning/construct/in_list_with_null/2                                        1.00      5.7±0.02µs 344.7 KElem/sec     1.00      5.7±0.01µs 343.1 KElem/sec
string_in_list_pruning/construct/in_list_with_null/21                                       1.00      6.3±0.02µs  3.2 MElem/sec      1.00      6.3±0.01µs  3.2 MElem/sec
string_in_list_pruning/construct/in_list_with_null/22                                       1.01      6.5±0.02µs  3.2 MElem/sec      1.00      6.4±0.01µs  3.3 MElem/sec
string_in_list_pruning/construct/in_list_with_null/257                                      1.00     50.2±0.10µs  4.9 MElem/sec      1.00     50.3±0.06µs  4.9 MElem/sec
string_in_list_pruning/construct/in_list_with_null/3                                        1.00      8.0±0.05µs 367.0 KElem/sec     1.00      8.0±0.02µs 365.4 KElem/sec
string_in_list_pruning/construct/in_list_with_null/5                                        1.00     12.6±0.07µs 386.3 KElem/sec     1.00     12.7±0.02µs 385.0 KElem/sec
string_in_list_pruning/construct/in_list_with_null/9                                        1.00     22.0±0.11µs 400.3 KElem/sec     1.02     22.3±0.04µs 394.2 KElem/sec
string_in_list_pruning/construct/not_in_list/1                                              1.00      3.3±0.02µs 295.2 KElem/sec     1.00      3.3±0.01µs 296.3 KElem/sec
string_in_list_pruning/construct/not_in_list/1024                                           1.01    190.6±0.47µs  5.1 MElem/sec      1.00    188.8±0.23µs  5.2 MElem/sec
string_in_list_pruning/construct/not_in_list/16                                             1.00     37.9±0.08µs 412.0 KElem/sec     1.00     38.0±0.10µs 410.9 KElem/sec
string_in_list_pruning/construct/not_in_list/2                                              1.01      5.7±0.03µs 343.9 KElem/sec     1.00      5.6±0.02µs 348.6 KElem/sec
string_in_list_pruning/construct/not_in_list/20                                             1.00     47.0±0.09µs 415.6 KElem/sec     1.01     47.6±0.11µs 410.2 KElem/sec
string_in_list_pruning/construct/not_in_list/21                                             1.01      6.4±0.02µs  3.1 MElem/sec      1.00      6.3±0.01µs  3.2 MElem/sec
string_in_list_pruning/construct/not_in_list/256                                            1.00     50.1±0.07µs  4.9 MElem/sec      1.00     50.2±0.05µs  4.9 MElem/sec
string_in_list_pruning/construct/not_in_list/4                                              1.00     10.4±0.06µs 376.4 KElem/sec     1.01     10.4±0.04µs 374.4 KElem/sec
string_in_list_pruning/construct/not_in_list/8                                              1.00     19.6±0.07µs 399.3 KElem/sec     1.00     19.6±0.04µs 397.8 KElem/sec
string_in_list_pruning/construct/not_in_list_with_null_constant_false/1025                  1.01    185.3±0.48µs  5.3 MElem/sec      1.00    183.9±0.22µs  5.3 MElem/sec
string_in_list_pruning/construct/not_in_list_with_null_constant_false/17                    1.00     40.1±0.10µs 413.8 KElem/sec     1.00     40.3±0.11µs 412.0 KElem/sec
string_in_list_pruning/construct/not_in_list_with_null_constant_false/2                     1.00      5.7±0.03µs 345.0 KElem/sec     1.01      5.7±0.01µs 341.3 KElem/sec
string_in_list_pruning/construct/not_in_list_with_null_constant_false/21                    1.00      4.3±0.01µs  4.7 MElem/sec      1.00      4.3±0.01µs  4.7 MElem/sec
string_in_list_pruning/construct/not_in_list_with_null_constant_false/22                    1.00      4.4±0.01µs  4.8 MElem/sec      1.00      4.4±0.01µs  4.8 MElem/sec
string_in_list_pruning/construct/not_in_list_with_null_constant_false/257                   1.00     47.4±0.06µs  5.2 MElem/sec      1.00     47.2±0.07µs  5.2 MElem/sec
string_in_list_pruning/construct/not_in_list_with_null_constant_false/3                     1.00      8.0±0.04µs 365.8 KElem/sec     1.00      8.0±0.02µs 365.3 KElem/sec
string_in_list_pruning/construct/not_in_list_with_null_constant_false/5                     1.00     12.6±0.07µs 387.0 KElem/sec     1.01     12.7±0.03µs 384.6 KElem/sec
string_in_list_pruning/construct/not_in_list_with_null_constant_false/9                     1.00     22.0±0.07µs 399.3 KElem/sec     1.00     22.1±0.04µs 397.3 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_and/1                                1.00      3.0±0.01µs  5.0 MElem/sec      1.00      3.1±0.01µs  5.0 MElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_and/1024                             1.01      2.5±0.02ms  6.3 KElem/sec      1.00      2.5±0.03ms  6.3 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_and/16                               1.00     50.7±0.34µs 308.0 KElem/sec     1.00     50.6±0.41µs 308.6 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_and/2                                1.00      5.5±0.01µs  2.8 MElem/sec      1.00      5.5±0.03µs  2.8 MElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_and/20                               1.00     58.1±0.40µs 268.9 KElem/sec     1.00     58.2±0.54µs 268.7 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_and/21                               1.00     58.6±0.38µs 266.6 KElem/sec     1.01     59.0±0.53µs 264.7 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_and/256                              1.01    626.5±4.44µs 24.9 KElem/sec      1.00    620.9±7.85µs 25.2 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_and/4                                1.00     13.8±0.04µs 1135.0 KElem/sec    1.00     13.7±0.06µs 1136.7 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_and/8                                1.00     29.2±0.14µs 535.2 KElem/sec     1.00     29.3±0.14µs 533.8 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_or/1                                 1.01      3.1±0.01µs  5.0 MElem/sec      1.00      3.1±0.01µs  5.0 MElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_or/1024                              1.00      3.5±0.02ms  4.5 KElem/sec      1.00      3.5±0.04ms  4.5 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_or/16                                1.00     55.7±0.38µs 280.4 KElem/sec     1.00     55.7±0.50µs 280.5 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_or/2                                 1.02      5.6±0.02µs  2.7 MElem/sec      1.00      5.5±0.02µs  2.8 MElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_or/20                                1.00     66.8±0.47µs 233.9 KElem/sec     1.00     66.6±0.58µs 234.6 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_or/21                                1.00     67.8±0.50µs 230.5 KElem/sec     1.00     67.8±0.57µs 230.5 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_or/256                               1.01    866.8±5.39µs 18.0 KElem/sec      1.00    857.8±8.88µs 18.2 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_or/4                                 1.00     12.1±0.04µs 1287.6 KElem/sec    1.00     12.1±0.05µs 1291.9 KElem/sec
string_in_list_pruning/evaluate/16_containers/expanded_or/8                                 1.01     26.4±0.17µs 591.5 KElem/sec     1.00     26.2±0.20µs 595.7 KElem/sec
string_in_list_pruning/evaluate/16_containers/in_list/1                                     1.00      3.1±0.01µs  5.0 MElem/sec      1.00      3.1±0.01µs  5.0 MElem/sec
string_in_list_pruning/evaluate/16_containers/in_list/1024                                  1.01      3.4±0.06µs  4.5 MElem/sec      1.00      3.4±0.06µs  4.5 MElem/sec
string_in_list_pruning/evaluate/16_containers/in_list/16                                    1.01     82.4±0.81µs 189.6 KElem/sec     1.00     81.8±0.85µs 190.9 KElem/sec
string_in_list_pruning/evaluate/16_containers/in_list/2                                     1.01      5.6±0.02µs  2.7 MElem/sec      1.00      5.5±0.02µs  2.8 MElem/sec
string_in_list_pruning/evaluate/16_containers/in_list/20                                    1.01    117.1±1.20µs 133.5 KElem/sec     1.00    116.0±1.45µs 134.7 KElem/sec
string_in_list_pruning/evaluate/16_containers/in_list/21                                    1.01      3.2±0.05µs  4.8 MElem/sec      1.00      3.2±0.05µs  4.8 MElem/sec
string_in_list_pruning/evaluate/16_containers/in_list/256                                   1.01      3.3±0.05µs  4.6 MElem/sec      1.00      3.3±0.06µs  4.7 MElem/sec
string_in_list_pruning/evaluate/16_containers/in_list/4                                     1.01     12.4±0.05µs 1255.1 KElem/sec    1.00     12.4±0.06µs 1261.8 KElem/sec
string_in_list_pruning/evaluate/16_containers/in_list/8                                     1.00     30.2±0.22µs 516.9 KElem/sec     1.00     30.2±0.27µs 518.1 KElem/sec
string_in_list_pruning/evaluate/16_containers/in_list_with_null/1025                        1.02      3.4±0.05µs  4.5 MElem/sec      1.00      3.3±0.07µs  4.6 MElem/sec
string_in_list_pruning/evaluate/16_containers/in_list_with_null/17                          1.00     91.5±1.03µs 170.7 KElem/sec     1.00     91.1±1.21µs 171.6 KElem/sec
string_in_list_pruning/evaluate/16_containers/in_list_with_null/2                           1.00      6.5±0.07µs  2.4 MElem/sec      1.00      6.5±0.09µs  2.4 MElem/sec
string_in_list_pruning/evaluate/16_containers/in_list_with_null/21                          1.00      3.1±0.05µs  4.9 MElem/sec      1.00      3.1±0.05µs  4.9 MElem/sec
string_in_list_pruning/evaluate/16_containers/in_list_with_null/22                          1.00      3.2±0.05µs  4.8 MElem/sec      1.00      3.2±0.09µs  4.8 MElem/sec
string_in_list_pruning/evaluate/16_containers/in_list_with_null/257                         1.00      3.3±0.06µs  4.7 MElem/sec      1.01      3.3±0.33µs  4.6 MElem/sec
string_in_list_pruning/evaluate/16_containers/in_list_with_null/3                           1.00      9.4±0.11µs 1662.6 KElem/sec    1.00      9.4±0.12µs 1669.3 KElem/sec
string_in_list_pruning/evaluate/16_containers/in_list_with_null/5                           1.00     17.1±0.16µs 914.6 KElem/sec     1.00     17.1±0.18µs 914.9 KElem/sec
string_in_list_pruning/evaluate/16_containers/in_list_with_null/9                           1.00     36.2±0.36µs 431.5 KElem/sec     1.00     36.1±0.39µs 433.1 KElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list/1                                 1.00      3.0±0.01µs  5.1 MElem/sec      1.01      3.0±0.01µs  5.0 MElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list/1024                              1.03      3.3±0.06µs  4.6 MElem/sec      1.00      3.2±0.06µs  4.7 MElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list/16                                1.00     77.8±0.76µs 200.9 KElem/sec     1.00     77.9±0.80µs 200.5 KElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list/2                                 1.02      5.5±0.02µs  2.8 MElem/sec      1.00      5.5±0.02µs  2.8 MElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list/20                                1.00    109.6±1.21µs 142.6 KElem/sec     1.00    109.2±1.25µs 143.1 KElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list/21                                1.02      3.1±0.05µs  4.9 MElem/sec      1.00      3.1±0.05µs  5.0 MElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list/256                               1.02      3.2±0.05µs  4.7 MElem/sec      1.00      3.2±0.05µs  4.8 MElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list/4                                 1.01     14.3±0.05µs 1091.3 KElem/sec    1.00     14.2±0.05µs 1099.4 KElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list/8                                 1.00     33.5±0.20µs 467.0 KElem/sec     1.00     33.5±0.21µs 466.3 KElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list_with_null_constant_false/1025     1.00    179.5±1.56ns 85.0 MElem/sec      1.00    179.0±1.65ns 85.2 MElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list_with_null_constant_false/17       1.01     88.2±1.00µs 177.2 KElem/sec     1.00     87.4±1.09µs 178.8 KElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list_with_null_constant_false/2        1.00      6.4±0.08µs  2.4 MElem/sec      1.00      6.5±0.08µs  2.4 MElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list_with_null_constant_false/21       1.01    179.4±1.44ns 85.1 MElem/sec      1.00    177.7±1.24ns 85.9 MElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list_with_null_constant_false/22       1.01    180.6±1.46ns 84.5 MElem/sec      1.00    178.5±1.20ns 85.5 MElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list_with_null_constant_false/257      1.00    179.8±1.63ns 84.9 MElem/sec      1.00    179.3±1.07ns 85.1 MElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list_with_null_constant_false/3        1.00      9.3±0.14µs 1680.6 KElem/sec    1.00      9.3±0.11µs 1687.7 KElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list_with_null_constant_false/5        1.00     19.1±0.18µs 817.4 KElem/sec     1.01     19.3±0.19µs 810.3 KElem/sec
string_in_list_pruning/evaluate/16_containers/not_in_list_with_null_constant_false/9        1.00     40.0±0.35µs 390.4 KElem/sec     1.00     40.0±0.40µs 390.8 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_and/1                                 1.01      2.7±0.01µs 364.2 KElem/sec     1.00      2.6±0.01µs 368.8 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_and/1024                              1.00      3.0±0.01µs 327.8 KElem/sec     1.00      3.0±0.01µs 327.1 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_and/16                                1.00      2.8±0.01µs 347.6 KElem/sec     1.00      2.8±0.01µs 346.6 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_and/2                                 1.01      2.7±0.01µs 361.6 KElem/sec     1.00      2.7±0.01µs 365.2 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_and/20                                1.00      2.8±0.01µs 348.7 KElem/sec     1.00      2.8±0.02µs 348.6 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_and/21                                1.00      2.8±0.01µs 350.2 KElem/sec     1.00      2.8±0.02µs 350.8 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_and/256                               1.01      2.9±0.01µs 334.2 KElem/sec     1.00      2.9±0.01µs 336.2 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_and/4                                 1.01      2.7±0.01µs 357.3 KElem/sec     1.00      2.7±0.01µs 359.2 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_and/8                                 1.01      2.8±0.01µs 352.5 KElem/sec     1.00      2.7±0.01µs 357.1 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_or/1                                  1.03      2.7±0.01µs 360.3 KElem/sec     1.00      2.6±0.01µs 370.4 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_or/1024                               1.02      3.0±0.01µs 321.1 KElem/sec     1.00      3.0±0.02µs 326.7 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_or/16                                 1.00      2.8±0.01µs 348.0 KElem/sec     1.00      2.8±0.02µs 349.0 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_or/2                                  1.01      2.7±0.01µs 361.7 KElem/sec     1.00      2.7±0.01µs 363.8 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_or/20                                 1.01      2.8±0.01µs 346.4 KElem/sec     1.00      2.8±0.02µs 349.2 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_or/21                                 1.01      2.8±0.01µs 347.3 KElem/sec     1.00      2.8±0.02µs 351.5 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_or/256                                1.01      2.9±0.01µs 331.2 KElem/sec     1.00      2.9±0.01µs 335.0 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_or/4                                  1.01      2.7±0.00µs 356.9 KElem/sec     1.00      2.7±0.01µs 359.5 KElem/sec
string_in_list_pruning/evaluate/1_containers/expanded_or/8                                  1.02      2.8±0.01µs 350.8 KElem/sec     1.00      2.7±0.01µs 358.2 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list/1                                      1.03      2.7±0.01µs 360.6 KElem/sec     1.00      2.6±0.01µs 370.5 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list/1024                                   1.01      2.8±0.03µs 348.8 KElem/sec     1.00      2.8±0.03µs 351.1 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list/16                                     1.01      3.1±0.01µs 310.5 KElem/sec     1.00      3.1±0.01µs 313.8 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list/2                                      1.02      2.7±0.01µs 360.1 KElem/sec     1.00      2.7±0.02µs 365.6 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list/20                                     1.01      3.3±0.01µs 299.8 KElem/sec     1.00      3.2±0.02µs 303.8 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list/21                                     1.00      2.8±0.02µs 352.7 KElem/sec     1.00      2.8±0.03µs 351.7 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list/256                                    1.00      2.8±0.03µs 350.4 KElem/sec     1.00      2.8±0.03µs 351.7 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list/4                                      1.01      2.8±0.01µs 352.5 KElem/sec     1.00      2.7±0.01µs 356.6 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list/8                                      1.01      2.9±0.01µs 336.7 KElem/sec     1.00      2.9±0.01µs 339.8 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list_with_null/1025                         1.01      2.8±0.03µs 348.4 KElem/sec     1.00      2.8±0.03µs 351.1 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list_with_null/17                           1.00      3.2±0.01µs 309.9 KElem/sec     1.00      3.1±0.02µs 310.8 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list_with_null/2                            1.02      2.7±0.01µs 357.3 KElem/sec     1.00      2.7±0.01µs 364.3 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list_with_null/21                           1.00      2.8±0.02µs 352.4 KElem/sec     1.00      2.8±0.02µs 352.0 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list_with_null/22                           1.00      2.8±0.02µs 352.5 KElem/sec     1.00      2.8±0.03µs 351.9 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list_with_null/257                          1.01      2.8±0.03µs 349.4 KElem/sec     1.00      2.8±0.02µs 352.1 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list_with_null/3                            1.01      2.7±0.01µs 355.6 KElem/sec     1.00      2.7±0.01µs 359.4 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list_with_null/5                            1.00      2.8±0.00µs 348.3 KElem/sec     1.00      2.8±0.02µs 349.6 KElem/sec
string_in_list_pruning/evaluate/1_containers/in_list_with_null/9                            1.02      2.9±0.01µs 331.7 KElem/sec     1.00      2.9±0.01µs 338.0 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list/1                                  1.02      2.7±0.01µs 363.5 KElem/sec     1.00      2.6±0.01µs 370.0 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list/1024                               1.00      2.8±0.03µs 350.9 KElem/sec     1.00      2.8±0.03µs 351.9 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list/16                                 1.01      3.1±0.01µs 311.9 KElem/sec     1.00      3.1±0.01µs 315.4 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list/2                                  1.00      2.7±0.01µs 362.9 KElem/sec     1.00      2.7±0.01µs 363.1 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list/20                                 1.01      3.2±0.01µs 301.7 KElem/sec     1.00      3.2±0.02µs 303.6 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list/21                                 1.00      2.8±0.03µs 352.4 KElem/sec     1.00      2.8±0.03µs 351.2 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list/256                                1.01      2.8±0.03µs 349.8 KElem/sec     1.00      2.8±0.03µs 352.3 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list/4                                  1.00      2.7±0.01µs 356.2 KElem/sec     1.00      2.7±0.01µs 357.0 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list/8                                  1.00      2.9±0.01µs 338.2 KElem/sec     1.00      2.9±0.01µs 339.4 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list_with_null_constant_false/1025      1.01    178.7±1.70ns  5.3 MElem/sec      1.00    177.4±1.50ns  5.4 MElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list_with_null_constant_false/17        1.00      3.2±0.01µs 309.7 KElem/sec     1.00      3.2±0.01µs 309.7 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list_with_null_constant_false/2         1.01      2.7±0.01µs 360.3 KElem/sec     1.00      2.7±0.01µs 363.1 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list_with_null_constant_false/21        1.01    178.9±1.64ns  5.3 MElem/sec      1.00    177.3±1.47ns  5.4 MElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list_with_null_constant_false/22        1.01    178.9±1.69ns  5.3 MElem/sec      1.00    177.6±1.53ns  5.4 MElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list_with_null_constant_false/257       1.01    178.5±1.73ns  5.3 MElem/sec      1.00    177.0±1.56ns  5.4 MElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list_with_null_constant_false/3         1.00      2.7±0.01µs 358.8 KElem/sec     1.00      2.7±0.01µs 360.1 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list_with_null_constant_false/5         1.00      2.8±0.01µs 348.8 KElem/sec     1.00      2.8±0.02µs 349.3 KElem/sec
string_in_list_pruning/evaluate/1_containers/not_in_list_with_null_constant_false/9         1.01      2.9±0.01µs 333.8 KElem/sec     1.00      2.9±0.01µs 336.8 KElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_and/1                               1.00      3.5±0.01µs 70.2 MElem/sec      1.01      3.5±0.01µs 69.3 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_and/1024                            1.01      4.4±0.05ms 56.9 KElem/sec      1.00      4.4±0.05ms 57.3 KElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_and/16                              1.00     64.0±0.36µs  3.8 MElem/sec      1.01     64.5±0.60µs  3.8 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_and/2                               1.00      6.3±0.02µs 38.8 MElem/sec      1.01      6.3±0.02µs 38.6 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_and/20                              1.00     83.9±0.56µs  2.9 MElem/sec      1.00     84.2±0.67µs  2.9 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_and/21                              1.00     88.1±0.61µs  2.8 MElem/sec      1.01     89.3±0.72µs  2.7 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_and/256                             1.01  1254.6±11.47µs 199.3 KElem/sec     1.00  1246.4±14.34µs 200.6 KElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_and/4                               1.00     14.7±0.05µs 16.6 MElem/sec      1.00     14.7±0.06µs 16.6 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_and/8                               1.00     30.2±0.14µs  8.1 MElem/sec      1.00     30.1±0.16µs  8.1 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_or/1                                1.00      3.6±0.01µs 67.3 MElem/sec      1.02      3.7±0.01µs 66.1 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_or/1024                             1.00      5.4±0.05ms 46.1 KElem/sec      1.00      5.4±0.07ms 46.3 KElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_or/16                               1.00     62.1±0.46µs  3.9 MElem/sec      1.00     62.3±0.49µs  3.9 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_or/2                                1.00      6.6±0.03µs 37.0 MElem/sec      1.00      6.6±0.02µs 37.0 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_or/20                               1.00     81.3±0.73µs  3.0 MElem/sec      1.00     81.5±0.75µs  3.0 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_or/21                               1.00     86.1±0.65µs  2.8 MElem/sec      1.00     85.7±0.72µs  2.9 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_or/256                              1.00  1370.6±12.97µs 182.4 KElem/sec     1.00  1366.2±16.17µs 183.0 KElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_or/4                                1.00     13.6±0.05µs 17.9 MElem/sec      1.01     13.8±0.06µs 17.7 MElem/sec
string_in_list_pruning/evaluate/256_containers/expanded_or/8                                1.01     29.7±0.18µs  8.2 MElem/sec      1.00     29.4±0.18µs  8.3 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list/1                                    1.00      3.7±0.01µs 66.6 MElem/sec      1.01      3.7±0.01µs 66.0 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list/1024                                 1.00     14.4±0.16µs 16.9 MElem/sec      1.40     20.2±0.25µs 12.1 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list/16                                   1.00     88.7±0.79µs  2.8 MElem/sec      1.00     88.5±0.94µs  2.8 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list/2                                    1.00      6.6±0.03µs 36.9 MElem/sec      1.00      6.6±0.02µs 36.9 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list/20                                   1.00    126.0±1.24µs 1984.1 KElem/sec    1.00    125.4±1.40µs 1993.6 KElem/sec
string_in_list_pruning/evaluate/256_containers/in_list/21                                   1.01      9.0±0.12µs 27.3 MElem/sec      1.00      8.9±0.12µs 27.6 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list/256                                  1.00     12.6±0.14µs 19.3 MElem/sec      1.42     18.0±0.26µs 13.6 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list/4                                    1.00     14.1±0.07µs 17.3 MElem/sec      1.01     14.2±0.07µs 17.1 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list/8                                    1.00     33.7±0.23µs  7.2 MElem/sec      1.00     33.7±0.26µs  7.2 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list_with_null/1025                       1.00     14.0±0.30µs 17.4 MElem/sec      1.44     20.2±0.23µs 12.1 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list_with_null/17                         1.00     98.0±1.09µs  2.5 MElem/sec      1.00     98.0±1.24µs  2.5 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list_with_null/2                          1.00      7.3±0.13µs 33.3 MElem/sec      1.00      7.4±0.16µs 33.2 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list_with_null/21                         1.01      8.9±0.12µs 27.4 MElem/sec      1.00      8.8±0.10µs 27.7 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list_with_null/22                         1.00      8.9±0.12µs 27.5 MElem/sec      1.00      8.9±0.15µs 27.5 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list_with_null/257                        1.00     12.7±0.15µs 19.3 MElem/sec      1.42     18.0±0.24µs 13.6 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list_with_null/3                          1.00     10.7±0.19µs 22.9 MElem/sec      1.00     10.7±0.19µs 22.8 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list_with_null/5                          1.00     18.9±0.29µs 12.9 MElem/sec      1.01     19.0±0.27µs 12.8 MElem/sec
string_in_list_pruning/evaluate/256_containers/in_list_with_null/9                          1.00     39.8±0.48µs  6.1 MElem/sec      1.00     40.0±0.57µs  6.1 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list/1                                1.00      3.5±0.01µs 69.5 MElem/sec      1.01      3.5±0.01µs 68.9 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list/1024                             1.07     11.1±0.14µs 21.9 MElem/sec      1.00     10.4±0.14µs 23.5 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list/16                               1.00     90.2±0.82µs  2.7 MElem/sec      1.00     90.2±0.85µs  2.7 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list/2                                1.00      6.2±0.03µs 39.1 MElem/sec      1.00      6.2±0.02µs 39.1 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list/20                               1.00    128.5±1.26µs 1945.0 KElem/sec    1.00    128.0±1.35µs 1953.3 KElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list/21                               1.05      8.3±0.11µs 29.5 MElem/sec      1.00      7.9±0.11µs 30.9 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list/256                              1.07     10.0±0.13µs 24.5 MElem/sec      1.00      9.3±0.11µs 26.1 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list/4                                1.01     15.2±0.06µs 16.1 MElem/sec      1.00     15.1±0.05µs 16.2 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list/8                                1.00     34.4±0.22µs  7.1 MElem/sec      1.00     34.3±0.23µs  7.1 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list_with_null_constant_false/1025    1.00    159.2±1.03ns 1533.8 MElem/sec    1.02    162.9±0.33ns 1498.8 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list_with_null_constant_false/17      1.00    101.2±1.13µs  2.4 MElem/sec      1.00    101.4±1.20µs  2.4 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list_with_null_constant_false/2       1.00      7.2±0.13µs 34.0 MElem/sec      1.00      7.2±0.13µs 34.0 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list_with_null_constant_false/21      1.10    173.1±0.88ns 1410.7 MElem/sec    1.00    157.8±0.59ns 1547.6 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list_with_null_constant_false/22      1.04    163.0±0.88ns 1497.5 MElem/sec    1.00    156.7±0.68ns 1558.4 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list_with_null_constant_false/257     1.00    157.7±0.92ns 1548.3 MElem/sec    1.03    163.1±1.10ns 1496.8 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list_with_null_constant_false/3       1.00     10.3±0.19µs 23.6 MElem/sec      1.01     10.4±0.19µs 23.5 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list_with_null_constant_false/5       1.00     20.1±0.31µs 12.1 MElem/sec      1.00     20.1±0.25µs 12.1 MElem/sec
string_in_list_pruning/evaluate/256_containers/not_in_list_with_null_constant_false/9       1.00     41.3±0.46µs  5.9 MElem/sec      1.00     41.2±0.50µs  5.9 MElem/sec
string_in_list_pruning/evaluate/expanded_and/1                                              1.00     11.4±0.01µs 343.7 MElem/sec     1.00     11.4±0.04µs 342.4 MElem/sec
string_in_list_pruning/evaluate/expanded_and/1024                                           1.00      9.8±0.07ms 406.5 KElem/sec     1.00      9.8±0.07ms 407.6 KElem/sec
string_in_list_pruning/evaluate/expanded_and/16                                             1.01    131.0±0.37µs 29.8 MElem/sec      1.00    130.1±0.43µs 30.0 MElem/sec
string_in_list_pruning/evaluate/expanded_and/2                                              1.00     19.3±0.03µs 202.8 MElem/sec     1.00     19.2±0.02µs 202.9 MElem/sec
string_in_list_pruning/evaluate/expanded_and/20                                             1.00    162.7±0.54µs 24.0 MElem/sec      1.00    162.5±0.58µs 24.0 MElem/sec
string_in_list_pruning/evaluate/expanded_and/21                                             1.01    170.3±0.79µs 22.9 MElem/sec      1.00    169.4±0.66µs 23.1 MElem/sec
string_in_list_pruning/evaluate/expanded_and/256                                            1.01      2.3±0.01ms 1757.6 KElem/sec    1.00      2.2±0.01ms 1783.8 KElem/sec
string_in_list_pruning/evaluate/expanded_and/4                                              1.00     39.6±0.06µs 98.6 MElem/sec      1.00     39.5±0.08µs 98.9 MElem/sec
string_in_list_pruning/evaluate/expanded_and/8                                              1.01     70.1±0.18µs 55.7 MElem/sec      1.00     69.6±0.15µs 56.1 MElem/sec
string_in_list_pruning/evaluate/expanded_or/1                                               1.00     13.9±0.01µs 281.0 MElem/sec     1.00     13.9±0.02µs 280.1 MElem/sec
string_in_list_pruning/evaluate/expanded_or/1024                                            1.00     13.9±0.05ms 287.1 KElem/sec     1.00     13.9±0.05ms 288.4 KElem/sec
string_in_list_pruning/evaluate/expanded_or/16                                              1.00    185.5±0.37µs 21.1 MElem/sec      1.00    185.6±0.44µs 21.1 MElem/sec
string_in_list_pruning/evaluate/expanded_or/2                                               1.00     24.3±0.02µs 160.6 MElem/sec     1.00     24.4±0.03µs 160.1 MElem/sec
string_in_list_pruning/evaluate/expanded_or/20                                              1.00    234.9±0.96µs 16.6 MElem/sec      1.00    235.1±0.52µs 16.6 MElem/sec
string_in_list_pruning/evaluate/expanded_or/21                                              1.00    245.9±0.51µs 15.9 MElem/sec      1.00    246.4±0.62µs 15.9 MElem/sec
string_in_list_pruning/evaluate/expanded_or/256                                             1.00      3.3±0.01ms 1220.3 KElem/sec    1.00      3.3±0.01ms 1219.8 KElem/sec
string_in_list_pruning/evaluate/expanded_or/4                                               1.00     45.9±0.06µs 85.2 MElem/sec      1.00     45.8±0.06µs 85.4 MElem/sec
string_in_list_pruning/evaluate/expanded_or/8                                               1.00     95.4±0.12µs 40.9 MElem/sec      1.00     95.2±0.12µs 41.0 MElem/sec
string_in_list_pruning/evaluate/in_list/1                                                   1.00     13.9±0.01µs 281.4 MElem/sec     1.00     13.9±0.02µs 280.1 MElem/sec
string_in_list_pruning/evaluate/in_list/1024                                                1.07    232.6±1.12µs 16.8 MElem/sec      1.00    218.1±0.98µs 17.9 MElem/sec
string_in_list_pruning/evaluate/in_list/16                                                  1.00    214.3±0.75µs 18.2 MElem/sec      1.00    213.4±0.79µs 18.3 MElem/sec
string_in_list_pruning/evaluate/in_list/2                                                   1.00     24.3±0.03µs 160.5 MElem/sec     1.00     24.4±0.02µs 160.2 MElem/sec
string_in_list_pruning/evaluate/in_list/20                                                  1.00    282.0±1.16µs 13.9 MElem/sec      1.00    281.5±1.20µs 13.9 MElem/sec
string_in_list_pruning/evaluate/in_list/21                                                  1.01     98.3±0.13µs 39.7 MElem/sec      1.00     97.3±0.12µs 40.1 MElem/sec
string_in_list_pruning/evaluate/in_list/256                                                 1.00    193.3±1.55µs 20.2 MElem/sec      1.20    231.0±1.53µs 16.9 MElem/sec
string_in_list_pruning/evaluate/in_list/4                                                   1.00     46.4±0.07µs 84.2 MElem/sec      1.00     46.2±0.07µs 84.5 MElem/sec
string_in_list_pruning/evaluate/in_list/8                                                   1.00     99.8±0.16µs 39.1 MElem/sec      1.00     99.7±0.18µs 39.2 MElem/sec
string_in_list_pruning/evaluate/in_list_with_null/1025                                      1.08    234.4±1.74µs 16.7 MElem/sec      1.00    216.3±1.44µs 18.1 MElem/sec
string_in_list_pruning/evaluate/in_list_with_null/17                                        1.00    225.2±1.16µs 17.3 MElem/sec      1.00    225.2±0.88µs 17.3 MElem/sec
string_in_list_pruning/evaluate/in_list_with_null/2                                         1.00     19.7±0.03µs 198.1 MElem/sec     1.00     19.8±0.04µs 197.5 MElem/sec
string_in_list_pruning/evaluate/in_list_with_null/21                                        1.01     98.4±0.15µs 39.7 MElem/sec      1.00     97.2±0.12µs 40.2 MElem/sec
string_in_list_pruning/evaluate/in_list_with_null/22                                        1.00     98.4±0.14µs 39.7 MElem/sec      1.05    102.9±0.14µs 38.0 MElem/sec
string_in_list_pruning/evaluate/in_list_with_null/257                                       1.00    192.5±1.73µs 20.3 MElem/sec      1.20    230.7±1.49µs 16.9 MElem/sec
string_in_list_pruning/evaluate/in_list_with_null/3                                         1.00     30.6±0.04µs 127.8 MElem/sec     1.00     30.7±0.23µs 127.4 MElem/sec
string_in_list_pruning/evaluate/in_list_with_null/5                                         1.00     53.2±0.10µs 73.5 MElem/sec      1.00     53.2±0.09µs 73.4 MElem/sec
string_in_list_pruning/evaluate/in_list_with_null/9                                         1.00    108.2±0.19µs 36.1 MElem/sec      1.00    108.0±0.22µs 36.2 MElem/sec
string_in_list_pruning/evaluate/not_in_list/1                                               1.00     11.4±0.02µs 343.8 MElem/sec     1.00     11.4±0.01µs 343.5 MElem/sec
string_in_list_pruning/evaluate/not_in_list/1024                                            1.00    231.8±1.61µs 16.9 MElem/sec      1.00    231.0±1.00µs 16.9 MElem/sec
string_in_list_pruning/evaluate/not_in_list/16                                              1.01    159.2±0.74µs 24.5 MElem/sec      1.00    157.6±0.84µs 24.8 MElem/sec
string_in_list_pruning/evaluate/not_in_list/2                                               1.00     19.2±0.03µs 203.1 MElem/sec     1.00     19.2±0.02µs 203.2 MElem/sec
string_in_list_pruning/evaluate/not_in_list/20                                              1.01    210.8±1.18µs 18.5 MElem/sec      1.00    209.0±1.29µs 18.7 MElem/sec
string_in_list_pruning/evaluate/not_in_list/21                                              1.07     88.2±0.25µs 44.3 MElem/sec      1.00     82.4±1.10µs 47.4 MElem/sec
string_in_list_pruning/evaluate/not_in_list/256                                             1.10    157.5±0.47µs 24.8 MElem/sec      1.00    142.8±0.88µs 27.4 MElem/sec
string_in_list_pruning/evaluate/not_in_list/4                                               1.01     40.2±0.17µs 97.2 MElem/sec      1.00     39.8±0.06µs 98.1 MElem/sec
string_in_list_pruning/evaluate/not_in_list/8                                               1.01     74.7±0.20µs 52.3 MElem/sec      1.00     74.2±0.22µs 52.6 MElem/sec
string_in_list_pruning/evaluate/not_in_list_with_null_constant_false/1025                   1.01    268.8±0.88ns 14.2 GElem/sec      1.00    265.5±0.58ns 14.4 GElem/sec
string_in_list_pruning/evaluate/not_in_list_with_null_constant_false/17                     1.01    171.2±0.85µs 22.8 MElem/sec      1.00    169.9±0.91µs 23.0 MElem/sec
string_in_list_pruning/evaluate/not_in_list_with_null_constant_false/2                      1.00     17.6±0.02µs 222.5 MElem/sec     1.00     17.5±0.09µs 223.6 MElem/sec
string_in_list_pruning/evaluate/not_in_list_with_null_constant_false/21                     1.01    265.8±0.77ns 14.4 GElem/sec      1.00    261.9±0.57ns 14.6 GElem/sec
string_in_list_pruning/evaluate/not_in_list_with_null_constant_false/22                     1.01    264.5±1.00ns 14.4 GElem/sec      1.00    263.1±0.67ns 14.5 GElem/sec
string_in_list_pruning/evaluate/not_in_list_with_null_constant_false/257                    1.01    264.4±0.95ns 14.4 GElem/sec      1.00    262.4±0.66ns 14.5 GElem/sec
string_in_list_pruning/evaluate/not_in_list_with_null_constant_false/3                      1.00     25.8±0.02µs 151.3 MElem/sec     1.00     25.7±0.07µs 152.0 MElem/sec
string_in_list_pruning/evaluate/not_in_list_with_null_constant_false/5                      1.01     47.5±0.21µs 82.2 MElem/sec      1.00     47.2±0.25µs 82.7 MElem/sec
string_in_list_pruning/evaluate/not_in_list_with_null_constant_false/9                      1.01     83.5±0.22µs 46.8 MElem/sec      1.00     82.8±0.27µs 47.2 MElem/sec
string_in_list_pruning/not_in_distributions/long_common_prefix/expanded_and/21              1.00    108.9±0.07µs 35.9 MElem/sec      1.01    109.7±0.13µs 35.6 MElem/sec
string_in_list_pruning/not_in_distributions/long_common_prefix/not_in_list/21               1.00     47.0±0.04µs 83.1 MElem/sec      1.06     49.9±0.04µs 78.3 MElem/sec
string_in_list_pruning/not_in_distributions/long_literal_prefix/expanded_and/21             1.01    128.2±0.17µs 30.5 MElem/sec      1.00    127.3±0.22µs 30.7 MElem/sec
string_in_list_pruning/not_in_distributions/long_literal_prefix/not_in_list/21              1.00     47.0±0.03µs 83.1 MElem/sec      1.06     49.8±0.03µs 78.4 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/expanded_and/1                1.00     11.1±0.01µs 351.4 MElem/sec     1.00     11.1±0.01µs 351.5 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/expanded_and/1024             1.00     11.5±0.01µs 339.4 MElem/sec     1.00     11.6±0.02µs 337.8 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/expanded_and/16               1.00     11.3±0.01µs 345.9 MElem/sec     1.00     11.3±0.02µs 345.7 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/expanded_and/2                1.00     11.1±0.02µs 351.0 MElem/sec     1.00     11.1±0.02µs 350.8 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/expanded_and/20               1.00     11.3±0.02µs 347.0 MElem/sec     1.00     11.3±0.03µs 346.3 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/expanded_and/21               1.00     11.2±0.02µs 347.3 MElem/sec     1.01     11.3±0.04µs 345.4 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/expanded_and/256              1.00     11.5±0.02µs 340.9 MElem/sec     1.00     11.5±0.01µs 341.1 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/expanded_and/4                1.00     11.2±0.01µs 349.9 MElem/sec     1.01     11.3±0.02µs 346.9 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/expanded_and/8                1.00     11.3±0.01µs 347.2 MElem/sec     1.00     11.3±0.02µs 346.2 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/not_in_list/1                 1.00     11.1±0.01µs 351.8 MElem/sec     1.00     11.1±0.01µs 351.6 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/not_in_list/1024              1.10    130.3±0.28µs 30.0 MElem/sec      1.00    118.6±2.15µs 32.9 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/not_in_list/16                1.00     11.8±0.02µs 330.7 MElem/sec     1.00     11.8±0.02µs 331.9 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/not_in_list/2                 1.00     11.1±0.01µs 350.9 MElem/sec     1.00     11.1±0.02µs 350.7 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/not_in_list/20                1.00     11.9±0.02µs 328.1 MElem/sec     1.01     12.0±0.04µs 326.3 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/not_in_list/21                1.12     88.8±0.16µs 44.0 MElem/sec      1.00     79.0±0.05µs 49.4 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/not_in_list/256               1.01    109.1±0.07µs 35.8 MElem/sec      1.00    107.9±0.42µs 36.2 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/not_in_list/4                 1.00     11.2±0.01µs 349.4 MElem/sec     1.00     11.2±0.03µs 347.6 MElem/sec
string_in_list_pruning/not_in_distributions/uniform_singleton/not_in_list/8                 1.00     11.4±0.01µs 343.3 MElem/sec     1.01     11.5±0.01µs 340.3 MElem/sec

Resource Usage

string_in_list_pruning — base (merge-base)

Metric	Value
Wall time	3220.8s
Peak memory	238.9 MiB
Avg memory	41.7 MiB
CPU user	3637.1s
CPU sys	3.5s
Peak spill	0 B

string_in_list_pruning — branch

Metric	Value
Wall time	3200.8s
Peak memory	242.1 MiB
Avg memory	43.2 MiB
CPU user	3614.9s
CPU sys	3.4s
Peak spill	0 B

File an issue against this benchmark runner

kosiew and others added 3 commits September 17, 2026 22:04

bench: isolate compact IN-list pruning benchmark changes

d170cbc

refactor: separate compact IN-list pruning threshold from the default…

2bbcbb4

… cap

Merge main and retain the independent compact pruning threshold

de602a5

kosiew mentioned this pull request Sep 18, 2026

refactor: separate compact IN-list pruning threshold from the default cap #25044

Open

Navigation Menu

DRAFT Bench 25044 - #25410

DRAFT Bench 25044#25410
kosiew wants to merge 3 commits into
apache:mainfrom
kosiew:bench-25044

kosiew commented Sep 17, 2026

Uh oh!

kosiew commented Sep 17, 2026

Uh oh!

adriangbot commented Sep 17, 2026

Uh oh!

codecov-commenter commented Sep 17, 2026

Uh oh!

adriangbot commented Sep 17, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

kosiew commented Sep 17, 2026

Uh oh!

kosiew commented Sep 17, 2026

Uh oh!

adriangbot commented Sep 17, 2026

Uh oh!

codecov-commenter commented Sep 17, 2026

Codecov Report

Uh oh!

adriangbot commented Sep 17, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants