Skip to content

Support i128 and i256 decimals in DecimalByteParts encoding - #9834

Merged
mhk197 merged 5 commits into
developfrom
mk/dbp-v2-feature
Sep 18, 2026
Merged

mhk197 merged 5 commits into
developfrom
mk/dbp-v2-feature

Conversation

@mhk197

@mhk197 mhk197 commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Summary

DecimalBytePartsArray stored the whole unscaled decimal value in one signed integer child. That capped it at values that fit in 64 bits. This PR adds support for i128 and i256 decimals.

Each value is now split into a signed most significant part (MSP) plus up to three unsigned 64-bit lower parts. Every part is an independent child array, so each one compresses on its own. The frozen vortex.decimal_byte_parts file format is untouched. Arrays with lower parts serialize under a new vortex.decimal_byte_parts.v2 format owned by a plugin.

This is the integration branch for three reviewed sub-PRs: #9808 (splitting and assembly), #9809 (array and kernels), and #9810 (serde plugin).

Representation

Decimal storage Children
i8, i16, i32, i64 Signed MSP only. Shares the original value buffer.
i128 i64 MSP holding the high 64 bits, plus one u64 lower part.
i256 i64 MSP holding the high 64 bits, plus three u64 lower parts.

Parts are ordered most significant first. The MSP carries the sign and the null mask. Lower parts are non-nullable unsigned integers. A lower part may use a narrower dtype such as u8, u16, or u32 when its values fit. Its position still counts as a full 64-bit window. Splitting writes zeroes at null positions so stray bytes in null slots do not hurt compression of the lower parts.

Splitting and assembly

DecimalByteParts::encode splits a DecimalArray into parts. split_decimal exposes the raw parts for callers that want to build the array themselves.

Assembly picks a path from the number of lower parts:

  • None. Reuse the MSP buffer as decimal storage without copying.
  • One. Combine the MSP and the lower part into an i128.
  • Two. The lower parts form the low 128 bits of an i256. The MSP is sign-extended into the high 128 bits.
  • Three. The MSP and the first lower part form the high 128 bits. The remaining two form the low 128 bits.

Assembly casts narrowed lower parts back to u64 first. The i256 assembly loop vectorizes on local ARM64 builds. Marking i256's shifts #[inline] removed three out-of-line calls per row.

Rows With #[inline] Without
1,024 0.917 µs 6.207 µs
8,192 6.332 µs 48.540 µs

Medians of five alternating release runs. From<i64> and From<u64> for i256 are added in vortex-array.

Compute

execute::<DecimalArray> reassembles the canonical array from all parts. The compare, filter, is-constant, and take kernels understand lower parts. Slice and mask apply per child.

Two limits are documented in code. Take with nullable indices on an array with lower parts falls back to canonical execution, because taking each part would make the lower parts nullable. The CUDA kernel rejects arrays with lower parts, because GPU reassembly is not implemented yet.

Serialization

DecimalBytePartsPlugin owns both wire formats and picks one from the array layout.

Array layout Serialized ID
MSP only vortex.decimal_byte_parts
MSP plus one to three lower parts vortex.decimal_byte_parts.v2

The v1 format is frozen. Its metadata and decoder live in plugin/v1.rs and are byte-identical to what shipped. The v1 decoder rejects any payload that claims lower parts.

The v2 format records the MSP's integer type and one integer type per lower part. The lower part count is the length of that list. The decoder validates every type and restores each child with its recorded dtype. The v2 format itself accepts zero lower parts. The plugin only chooses it when lower parts are present, so files stay readable by older readers whenever possible.

The in-memory encoding ID is now vortex.decimal_byte_parts.v2. The registry maps both wire IDs to the plugin, so existing v1 files read through it with no migration.

No edition declares the v2 format yet. Writing an array with lower parts under an edition that does not permit v2 fails with an explicit error rather than silently falling back.

Compression

The BtrBlocks decimal scheme still narrows decimals that fit in i64 and wraps them in a single-part array. Wide decimals stay canonical. Nothing in this PR writes the v2 format through the compressor.

The scheme now declares vortex.decimal_byte_parts as its produced encoding rather than the in-memory ID. Since #9914 that list holds the serialized IDs a scheme writes, and this scheme only ever writes the frozen format. Without that change every writer that filters schemes by edition would drop the decimal scheme, because no edition permits the in-memory v2 name.

API Changes

Breaking. Registering DecimalByteParts directly no longer supports serde for either format. Replace session.arrays().register(DecimalByteParts) with session.arrays().register(DecimalBytePartsPlugin). vortex_decimal_byte_parts::initialize already does this.

Breaking. dbp_encode is replaced by DecimalByteParts::encode.

Breaking. DecimalBytesPartsMetadata is no longer public. DecimalBytePartsV2Metadata is exposed instead.

The in-memory encoding ID string changed from vortex.decimal_byte_parts to vortex.decimal_byte_parts.v2. This affects display and trace output, not files.

New public items: DecimalByteParts::try_new_with_lower_parts, DecimalByteParts::encode, split_decimal, DecimalParts, DecimalBytePartsPlugin, decimal_byte_parts_v1_id, and decimal_byte_parts_v2_id.

@mhk197 mhk197 added the changelog/feature A new feature label Sep 10, 2026
@codspeed

codspeed Bot commented Sep 10, 2026

Copy link
Copy Markdown

Merging this PR will regress 2 benchmarks

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 5 improved benchmarks
❌ 2 regressed benchmarks
✅ 2240 untouched benchmarks
🆕 48 new benchmarks
⏩ 176 skipped benchmarks1
🗄️ 1 archived benchmark run2

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation decode_primitives[f32, (1000, 512)] 42.2 µs 64.6 µs -34.67%
WallTime words_gather_scalar_avx2[65536] 8.2 µs 9.3 µs -11.82%
WallTime arrow_checked_add_u32_neon[16384] 20.5 µs 12.9 µs +58.74%
WallTime filtered_sink_i64_avx2[OneNullInEight] 26.4 µs 22.2 µs +18.81%
Simulation allocate_drop_vortex_minimal_alignment[0] 1,077.2 ns 968.9 ns +11.18%
Simulation allocate_drop_vortex[0] 1.1 µs 1 µs +10.57%
Simulation allocate_drop_bytes[0] 581.3 ns 527.2 ns +10.27%
🆕 WallTime dbp_assemble_kernel_avx2[(I128, 1024)] N/A 552 ns N/A
🆕 WallTime dbp_assemble_kernel_avx2[(I128, 8192)] N/A 4.4 µs N/A
🆕 WallTime dbp_assemble_kernel_avx2[(I256, 1024)] N/A 1.1 µs N/A
🆕 WallTime dbp_assemble_kernel_avx2[(I256, 8192)] N/A 8.6 µs N/A
🆕 WallTime dbp_assemble_kernel_narrow_msp_avx2[(I128, 1024)] N/A 612 ns N/A
🆕 WallTime dbp_assemble_kernel_narrow_msp_avx2[(I128, 8192)] N/A 4.9 µs N/A
🆕 WallTime dbp_assemble_kernel_narrow_msp_avx2[(I256, 1024)] N/A 1.2 µs N/A
🆕 WallTime dbp_assemble_kernel_narrow_msp_avx2[(I256, 8192)] N/A 9.1 µs N/A
🆕 WallTime dbp_split_kernel_all_valid_avx2[(I128, 1024)] N/A 897 ns N/A
🆕 WallTime dbp_split_kernel_all_valid_avx2[(I128, 8192)] N/A 6.6 µs N/A
🆕 WallTime dbp_split_kernel_all_valid_avx2[(I256, 1024)] N/A 2.1 µs N/A
🆕 WallTime dbp_split_kernel_all_valid_avx2[(I256, 8192)] N/A 54.2 µs N/A
🆕 WallTime dbp_split_kernel_mixed_null_avx2[(I128, 1024)] N/A 1.2 µs N/A
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing mk/dbp-v2-feature (026bb26) with develop (ae00d7a)

Open in CodSpeed

Footnotes

  1. 176 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. 1 benchmark was run, but is now archived. If it was deleted in another branch, consider rebasing to remove it from the report. Instead if it was added back, click here to restore it.

@mhk197
mhk197 force-pushed the mk/dbp-v2-feature branch 2 times, most recently from e0d2bf4 to ac1f5a0 Compare September 16, 2026 15:22
@mhk197
mhk197 changed the base branch from develop to mk/scheme-serialized-ids September 16, 2026 16:16
mhk197 added a commit that referenced this pull request Sep 16, 2026
)

## Summary

Compression schemes are filtered against the IDs a writer may emit.
Today that filter mixes two ID spaces. Schemes declare their in-memory
encoding ID, while most callers pass the serialized IDs from their
enabled editions. The two only line up because every encoding currently
uses the same string for both.

`DecimalByteParts` stops doing that in #9834. Its in-memory ID becomes
`vortex.decimal_byte_parts.v2` while the frozen wire ID stays
`vortex.decimal_byte_parts`. With the current filter, every caller that
passes edition IDs would silently drop the decimal scheme and write
decimals canonical.

This PR makes the contract explicit. Schemes declare the serialized IDs
they write, and every caller filters with serialized IDs.

## Changes

- The file writer no longer maps permitted serialized IDs through the
registry to plugin in-memory IDs before filtering schemes.
`new_array_context` returns only the array context, which is seeded with
exactly the permitted IDs, and the writer reads them back with `to_ids`
into a named set for the compressor builder. This matches the Python,
TUI, CUDA, bench, and golden-test callers, which already pass serialized
IDs.

## Behavior

No scheme changes behavior. In-memory and wire IDs coincide for every
scheme on develop, so the same schemes are retained from the same inputs
and no snapshot changes.

## Follow-ups

- #9834 declares `vortex.decimal_byte_parts` from the decimal scheme on
top of this.
- #9770 builds on this with a permitted-ID snapshot in
`CompressorContext`, so a scheme can choose a wire format when it
compresses. If the method names should say serialized IDs, renaming
`produced_encodings` and `retain_allowed_encodings` together belongs
there.

---------

Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Base automatically changed from mk/scheme-serialized-ids to develop September 16, 2026 17:31
@mhk197
mhk197 marked this pull request as ready for review September 16, 2026 17:39
@mhk197 mhk197 added changelog/break A breaking API change and removed changelog/feature A new feature labels Sep 16, 2026
mhk197 and others added 5 commits September 17, 2026 11:34
Signed-off-by: "Matt Katz" <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
`DecimalBytePartsArray` previously stored the entire unscaled decimal
value in one signed integer child, limiting it to values that fit in 64
bits. It now supports wide decimals by representing each value as
integer parts that can be compressed independently, while preserving the
decimal's logical precision, scale, and nullability.

The array has a signed most significant part (MSP) and up to three
unsigned 64-bit lower parts, ordered most significant first. Splitting
canonical decimal storage produces:

| Decimal storage | Children |
| --- | --- |
| `i8` / `i16` / `i32` / `i64` | Signed MSP only; shares the original
value buffer |
| `i128` | `i64` MSP + one `u64` lower part |
| `i256` | `i64` MSP + three `u64` lower parts |

Only the MSP carries validity. Every lower part must be a non-nullable
`u64` array with the same length, and splitting wide decimals zeroes the
parts at null positions. All children remain `ArrayRef`s, so their
individual encodings are independent of the decimal representation.

`execute::<DecimalArray>` reassembles a `DecimalArray` from the MSP and
lower parts children.

`take` with nullable indices is not yet supported by the
DecimalByteParts kernel for arrays with lower parts; it falls back to
canonical execution. Taking each part directly would make the lower
parts nullable, violating the representation's invariant. The frozen
serializer also continues to reject arrays with lower parts.

This PR also refines the splitting and assembly modules.
* Assembly takes `ArrayRef`s instead of `PrimitiveArray`s so that in the
future, we can add special fast paths for constant arrays
* Assembly casts lower parts to `u64`s, allowing for assembly of
narrowed lower parts.
* Assembly loop is optimized such that it vectorizes for `i256` assembly
on local runs.

---------

Signed-off-by: Matt Katz <mhkatz97@gmail.com>
…mat (#9810)

Add serialization for `DecimalBytePartsArray` with lower parts while
preserving the frozen v1 file format. `DecimalBytePartsPlugin` owns both
formats and selects the serialized ID from the array's layout:

| Array layout | Serialized ID |
| --- | --- |
| Signed most significant part (MSP) only | `vortex.decimal_byte_parts`
|
| Signed MSP plus one to three unsigned lower parts |
`vortex.decimal_byte_parts_v2` |

Both formats deserialize into the same in-memory array representation.
Each lower part represents a 64-bit window, but its storage dtype may be
narrowed to `u8`, `u16`, or `u32` when its values fit.

- Record the MSP's physical integer type, lower-part count, and each
lower part's physical integer type in metadata. Deserialization
validates these types and restores each child with its recorded dtype.
- Keep the frozen format restricted to zero lower parts and require at
least one for v2. Frozen metadata remains byte-identical.
- Make DBP's VTable `serialize` and `deserialize` methods return errors
directing callers to `DecimalBytePartsPlugin`. Keep DBP metadata and
serde helpers in `plugin.rs` so the dedicated plugin owns both formats.
- Add a separate v2 compatibility fixture covering positive and negative
wide `i128` values and nullable `i256` values. The frozen fixture is
unchanged.

**Breaking:** directly registering `DecimalByteParts`, or calling its
VTable serde methods, now errors for both serialization and
deserialization, including the frozen v1 format. Replace:

```rust
session.arrays().register(DecimalByteParts);
```

with:

```rust
session.arrays().register(DecimalBytePartsPlugin);
```

`vortex_decimal_byte_parts::initialize(&session)` already registers the
plugin. Existing v1 files remain readable through it; no file migration
is required.

---------

Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
@mhk197
mhk197 added this pull request to stack #9933 September 17, 2026 15:49
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 17, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 17, 2026
@github-actions

github-actions Bot commented Sep 17, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 026bb26 statpopgen 1 Explore Profiling Data
🟢 Done 026bb26 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 026bb26 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 026bb26 fineweb 1 Explore Profiling Data
🟢 Done 026bb26 fineweb-s3 1 Explore Profiling Data
🟢 Done 026bb26 tpcds-nvme 1 Explore Profiling Data
🟢 Done 026bb26 clickbench-nvme 1 Explore Profiling Data
🟢 Done 026bb26 polarsignals 1 Explore Profiling Data
🟢 Done 026bb26 tpch-nvme 1 Explore Profiling Data
🟢 Done 026bb26 tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 026bb264 vs base ae00d7a1
Vortex (geomean): hot 1.006x ➖ · cold 0.902x ➖


datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45156766 / 45493544 / -0.7% 85450205 / 90902984 / -6.0% 0.53 / 0.50 / +5.6%
polarsignals_q01/datafusion:vortex-file-compressed 50927010 / 51001635 / -0.1% 110138260 / 114948016 / -4.2% 0.46 / 0.44 / +4.2%
polarsignals_q02/datafusion:vortex-file-compressed 35373877 / 36850204 / -4.0% 74630046 / 81871326 / -8.8% 0.47 / 0.45 / +5.3%
polarsignals_q03/datafusion:vortex-file-compressed 53824674 / 53796944 / +0.1% 112562094 / 117270929 / -4.0% 0.48 / 0.46 / +4.2%
polarsignals_q04/datafusion:vortex-file-compressed 9665518 / 9426100 / +2.5% 42780310 / 51333478 / -16.7% 🟢 0.23 / 0.18 / +23.0%
polarsignals_q05/datafusion:vortex-file-compressed 11838715 / 11773706 / +0.6% 48311896 / 55689583 / -13.2% 🟢 0.25 / 0.21 / +15.9%
polarsignals_q06/datafusion:vortex-file-compressed 21868624 / 21200146 / +3.2% 55670111 / 62787183 / -11.3% 🟢 0.39 / 0.34 / +16.3%
polarsignals_q07/datafusion:vortex-file-compressed 11362508 / 10871090 / +4.5% 46991239 / 55205147 / -14.9% 🟢 0.24 / 0.20 / +22.8%
polarsignals_q08/datafusion:vortex-file-compressed 98331728 / 97856293 / +0.5% 160435935 / 163481619 / -1.9% 0.61 / 0.60 / +2.4%
polarsignals_q09/datafusion:vortex-file-compressed 9873819 / 9895236 / -0.2% 42732419 / 50651130 / -15.6% 🟢 0.23 / 0.20 / +18.3%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 026bb264 vs base ae00d7a1
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.002x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16863423 / 16535955 / +2.0% 45330381 / 46350676 / -2.2% 0.37 / 0.36 / +4.3%
tpch_q02/datafusion:vortex-file-compressed 17137879 / 17455685 / -1.8% 37544584 / 36357807 / +3.3% 0.46 / 0.48 / -4.9%
tpch_q03/datafusion:vortex-file-compressed 19251775 / 19622865 / -1.9% 50567271 / 48575705 / +4.1% 0.38 / 0.40 / -5.8%
tpch_q04/datafusion:vortex-file-compressed 10105356 / 10436793 / -3.2% 34770255 / 35739263 / -2.7% 0.29 / 0.29 / -0.5%
tpch_q05/datafusion:vortex-file-compressed 37431850 / 36878376 / +1.5% 65833458 / 64651170 / +1.8% 0.57 / 0.57 / -0.3%
tpch_q06/datafusion:vortex-file-compressed 6418087 / 6360418 / +0.9% 30904506 / 30365976 / +1.8% 0.21 / 0.21 / -0.9%
tpch_q07/datafusion:vortex-file-compressed 51122296 / 51904685 / -1.5% 82633492 / 80812560 / +2.3% 0.62 / 0.64 / -3.7%
tpch_q08/datafusion:vortex-file-compressed 52093629 / 52249341 / -0.3% 79551961 / 82148825 / -3.2% 0.65 / 0.64 / +3.0%
tpch_q09/datafusion:vortex-file-compressed 49535399 / 49205281 / +0.7% 77382356 / 80524601 / -3.9% 0.64 / 0.61 / +4.8%
tpch_q10/datafusion:vortex-file-compressed 17510692 / 16929997 / +3.4% 52275893 / 49463488 / +5.7% 0.33 / 0.34 / -2.1%
tpch_q11/datafusion:vortex-file-compressed 15164578 / 15109256 / +0.4% 33788652 / 32971793 / +2.5% 0.45 / 0.46 / -2.1%
tpch_q12/datafusion:vortex-file-compressed 22480504 / 22907794 / -1.9% 49963349 / 47928317 / +4.2% 0.45 / 0.48 / -5.9%
tpch_q13/datafusion:vortex-file-compressed 20032668 / 19607148 / +2.2% 40864647 / 41905404 / -2.5% 0.49 / 0.47 / +4.8%
tpch_q14/datafusion:vortex-file-compressed 14860261 / 15142448 / -1.9% 42993206 / 39790977 / +8.0% 0.35 / 0.38 / -9.2%
tpch_q15/datafusion:vortex-file-compressed 18707670 / 18378432 / +1.8% 48054415 / 45551113 / +5.5% 0.39 / 0.40 / -3.5%
tpch_q16/datafusion:vortex-file-compressed 18551615 / 18886671 / -1.8% 37968162 / 36964978 / +2.7% 0.49 / 0.51 / -4.4%
tpch_q17/datafusion:vortex-file-compressed 28295705 / 28082532 / +0.8% 59057938 / 58792314 / +0.5% 0.48 / 0.48 / +0.3%
tpch_q18/datafusion:vortex-file-compressed 36704997 / 36665238 / +0.1% 59138355 / 57392760 / +3.0% 0.62 / 0.64 / -2.8%
tpch_q19/datafusion:vortex-file-compressed 13685144 / 13635137 / +0.4% 40709629 / 38142799 / +6.7% 0.34 / 0.36 / -6.0%
tpch_q20/datafusion:vortex-file-compressed 20871507 / 20766650 / +0.5% 47331586 / 46661491 / +1.4% 0.44 / 0.45 / -0.9%
tpch_q21/datafusion:vortex-file-compressed 39368724 / 39240996 / +0.3% 65653382 / 66493172 / -1.3% 0.60 / 0.59 / +1.6%
tpch_q22/datafusion:vortex-file-compressed 11121750 / 11364731 / -2.1% 31904371 / 31087868 / +2.6% 0.35 / 0.37 / -4.6%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 66880341 / 67188427 / -0.5% 86199171 / 85888725 / +0.4% 0.78 / 0.78 / -0.8%
tpch_q02/datafusion:parquet 53330137 / 52255557 / +2.1% 71814374 / 70707223 / +1.6% 0.74 / 0.74 / +0.5%
tpch_q03/datafusion:parquet 73033071 / 72583517 / +0.6% 97750392 / 96374873 / +1.4% 0.75 / 0.75 / -0.8%
tpch_q04/datafusion:parquet 39635919 / 39443085 / +0.5% 60396389 / 58719880 / +2.9% 0.66 / 0.67 / -2.3%
tpch_q05/datafusion:parquet 88037040 / 87254878 / +0.9% 118906415 / 115302563 / +3.1% 0.74 / 0.76 / -2.2%
tpch_q06/datafusion:parquet 27797316 / 28056282 / -0.9% 48285440 / 48273615 / +0.0% 0.58 / 0.58 / -0.9%
tpch_q07/datafusion:parquet 95565386 / 93812913 / +1.9% 123341770 / 121222396 / +1.7% 0.77 / 0.77 / +0.1%
tpch_q08/datafusion:parquet 94740699 / 95368312 / -0.7% 129843843 / 122053683 / +6.4% 0.73 / 0.78 / -6.6%
tpch_q09/datafusion:parquet 113732905 / 112501492 / +1.1% 146965971 / 146523029 / +0.3% 0.77 / 0.77 / +0.8%
tpch_q10/datafusion:parquet 79760848 / 79176129 / +0.7% 113266151 / 114057138 / -0.7% 0.70 / 0.69 / +1.4%
tpch_q11/datafusion:parquet 38658892 / 38441444 / +0.6% 60977831 / 60026456 / +1.6% 0.63 / 0.64 / -1.0%
tpch_q12/datafusion:parquet 61805792 / 61995765 / -0.3% 92017538 / 87870287 / +4.7% 0.67 / 0.71 / -4.8%
tpch_q13/datafusion:parquet 159609503 / 160017119 / -0.3% 181544854 / 181552551 / -0.0% 0.88 / 0.88 / -0.3%
tpch_q14/datafusion:parquet 39466249 / 39874617 / -1.0% 65262500 / 66140336 / -1.3% 0.60 / 0.60 / +0.3%
tpch_q15/datafusion:parquet 45909205 / 46333974 / -0.9% 70550060 / 67954196 / +3.8% 0.65 / 0.68 / -4.6%
tpch_q16/datafusion:parquet 38248851 / 38071944 / +0.5% 56449265 / 55983230 / +0.8% 0.68 / 0.68 / -0.4%
tpch_q17/datafusion:parquet 116247465 / 116332231 / -0.1% 142410765 / 142297513 / +0.1% 0.82 / 0.82 / -0.2%
tpch_q18/datafusion:parquet 114966292 / 114973203 / -0.0% 137501737 / 139686321 / -1.6% 0.84 / 0.82 / +1.6%
tpch_q19/datafusion:parquet 49677344 / 49841375 / -0.3% 78946657 / 79224807 / -0.4% 0.63 / 0.63 / +0.0%
tpch_q20/datafusion:parquet 58126809 / 58159297 / -0.1% 84261867 / 84589459 / -0.4% 0.69 / 0.69 / +0.3%
tpch_q21/datafusion:parquet 98158956 / 98321764 / -0.2% 121399795 / 122450732 / -0.9% 0.81 / 0.80 / +0.7%
tpch_q22/datafusion:parquet 42258384 / 42577276 / -0.7% 61448505 / 61494620 / -0.1% 0.69 / 0.69 / -0.7%
duckdb / vortex-file-compressed / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11566832 / 11134438 / +3.9% 22185464 / 22160301 / +0.1% 0.52 / 0.50 / +3.8%
tpch_q02/duckdb:vortex-file-compressed 17290871 / 17420064 / -0.7% 26217861 / 24511036 / +7.0% 0.66 / 0.71 / -7.2%
tpch_q03/duckdb:vortex-file-compressed 18032407 / 18618908 / -3.2% 33145969 / 33924012 / -2.3% 0.54 / 0.55 / -0.9%
tpch_q04/duckdb:vortex-file-compressed 16918712 / 17932192 / -5.7% 31187366 / 31080612 / +0.3% 0.54 / 0.58 / -6.0%
tpch_q05/duckdb:vortex-file-compressed 21929285 / 22315089 / -1.7% 37294837 / 40932564 / -8.9% 0.59 / 0.55 / +7.9%
tpch_q06/duckdb:vortex-file-compressed 5929442 / 5507197 / +7.7% 15342995 / 15369046 / -0.2% 0.39 / 0.36 / +7.8%
tpch_q07/duckdb:vortex-file-compressed 20402384 / 20437717 / -0.2% 37558949 / 40800299 / -7.9% 0.54 / 0.50 / +8.4%
tpch_q08/duckdb:vortex-file-compressed 22963710 / 23145811 / -0.8% 38798913 / 42268063 / -8.2% 0.59 / 0.55 / +8.1%
tpch_q09/duckdb:vortex-file-compressed 29287871 / 30122049 / -2.8% 48934088 / 49092891 / -0.3% 0.60 / 0.61 / -2.5%
tpch_q10/duckdb:vortex-file-compressed 27902049 / 27939529 / -0.1% 44164448 / 44638622 / -1.1% 0.63 / 0.63 / +0.9%
tpch_q11/duckdb:vortex-file-compressed 8720990 / 8634028 / +1.0% 14141366 / 14564459 / -2.9% 0.62 / 0.59 / +4.0%
tpch_q12/duckdb:vortex-file-compressed 17259111 / 15994895 / +7.9% 35800938 / 30560284 / +17.1% 🔴 0.48 / 0.52 / -7.9%
tpch_q13/duckdb:vortex-file-compressed 21585065 / 21908672 / -1.5% 38199432 / 39957957 / -4.4% 0.57 / 0.55 / +3.1%
tpch_q14/duckdb:vortex-file-compressed 13014024 / 13673066 / -4.8% 24239493 / 26302708 / -7.8% 0.54 / 0.52 / +3.3%
tpch_q15/duckdb:vortex-file-compressed 9644341 / 9150894 / +5.4% 20577119 / 18504322 / +11.2% 🔴 0.47 / 0.49 / -5.2%
tpch_q16/duckdb:vortex-file-compressed 18658804 / 18258919 / +2.2% 26097705 / 26116922 / -0.1% 0.71 / 0.70 / +2.3%
tpch_q17/duckdb:vortex-file-compressed 14743742 / 16045389 / -8.1% 35498181 / 34434904 / +3.1% 0.42 / 0.47 / -10.9%
tpch_q18/duckdb:vortex-file-compressed 24524215 / 26189963 / -6.4% 35179038 / 37019591 / -5.0% 0.70 / 0.71 / -1.5%
tpch_q19/duckdb:vortex-file-compressed 23282939 / 22390822 / +4.0% 36704478 / 35505357 / +3.4% 0.63 / 0.63 / +0.6%
tpch_q20/duckdb:vortex-file-compressed 16862519 / 17072689 / -1.2% 33340322 / 33689309 / -1.0% 0.51 / 0.51 / -0.2%
tpch_q21/duckdb:vortex-file-compressed 65390938 / 65714672 / -0.5% 81253227 / 87349908 / -7.0% 0.80 / 0.75 / +7.0%
tpch_q22/duckdb:vortex-file-compressed 12075882 / 13690363 / -11.8% 🟢 20290650 / 22634335 / -10.4% 🟢 0.60 / 0.60 / -1.6%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60037738 / 60225419 / -0.3% 66602209 / 66482644 / +0.2% 0.90 / 0.91 / -0.5%
tpch_q02/duckdb:parquet 34717784 / 34722581 / -0.0% 42898456 / 42669599 / +0.5% 0.81 / 0.81 / -0.5%
tpch_q03/duckdb:parquet 62232196 / 62071121 / +0.3% 73892945 / 76045121 / -2.8% 0.84 / 0.82 / +3.2%
tpch_q04/duckdb:parquet 43259738 / 43025507 / +0.5% 53540254 / 53321609 / +0.4% 0.81 / 0.81 / +0.1%
tpch_q05/duckdb:parquet 60908326 / 60567333 / +0.6% 73660842 / 73116927 / +0.7% 0.83 / 0.83 / -0.2%
tpch_q06/duckdb:parquet 20155624 / 20307025 / -0.7% 25323881 / 24161371 / +4.8% 0.80 / 0.84 / -5.3%
tpch_q07/duckdb:parquet 60668718 / 60834914 / -0.3% 71435076 / 75412303 / -5.3% 0.85 / 0.81 / +5.3%
tpch_q08/duckdb:parquet 73462013 / 73348491 / +0.2% 86318829 / 87559784 / -1.4% 0.85 / 0.84 / +1.6%
tpch_q09/duckdb:parquet 114157392 / 113677835 / +0.4% 128316571 / 127449446 / +0.7% 0.89 / 0.89 / -0.3%
tpch_q10/duckdb:parquet 108646383 / 108236981 / +0.4% 121822822 / 124595819 / -2.2% 0.89 / 0.87 / +2.7%
tpch_q11/duckdb:parquet 20042241 / 19927367 / +0.6% 23928435 / 23814181 / +0.5% 0.84 / 0.84 / +0.1%
tpch_q12/duckdb:parquet 41407252 / 41171855 / +0.6% 49231654 / 48918086 / +0.6% 0.84 / 0.84 / -0.1%
tpch_q13/duckdb:parquet 238494716 / 239190440 / -0.3% 248201558 / 246859853 / +0.5% 0.96 / 0.97 / -0.8%
tpch_q14/duckdb:parquet 43613684 / 43439720 / +0.4% 52267676 / 52405905 / -0.3% 0.83 / 0.83 / +0.7%
tpch_q15/duckdb:parquet 24959605 / 24671202 / +1.2% 31638097 / 31311963 / +1.0% 0.79 / 0.79 / +0.1%
tpch_q16/duckdb:parquet 50071094 / 51251595 / -2.3% 56447772 / 57541934 / -1.9% 0.89 / 0.89 / -0.4%
tpch_q17/duckdb:parquet 44508214 / 44354534 / +0.3% 54524413 / 54703155 / -0.3% 0.82 / 0.81 / +0.7%
tpch_q18/duckdb:parquet 87849675 / 89329130 / -1.7% 101381516 / 99281595 / +2.1% 0.87 / 0.90 / -3.7%
tpch_q19/duckdb:parquet 61206727 / 61053854 / +0.3% 71073236 / 71206919 / -0.2% 0.86 / 0.86 / +0.4%
tpch_q20/duckdb:parquet 58771017 / 58637288 / +0.2% 71390909 / 70330495 / +1.5% 0.82 / 0.83 / -1.3%
tpch_q21/duckdb:parquet 136541070 / 136347323 / +0.1% 148683880 / 147597517 / +0.7% 0.92 / 0.92 / -0.6%
tpch_q22/duckdb:parquet 50460922 / 50571008 / -0.2% 57987318 / 58282724 / -0.5% 0.87 / 0.87 / +0.3%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 026bb264 vs base ae00d7a1
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.0%
Engines: DataFusion No clear signal (-5.0%, low confidence) · DuckDB No clear signal (+9.4%, low confidence)
Vortex (geomean): hot 1.046x ➖ · cold 1.066x ➖
Parquet (geomean): hot 1.026x ➖ · cold 1.017x ➖
Shifts: Parquet (control) +2.6% · Median polish +3.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6717766 / 6934374 / -3.1% 21135864 / 19459793 / +8.6% 0.32 / 0.36 / -10.8%
fineweb_q01/datafusion:vortex-file-compressed 12065938 / 11340966 / +6.4% 51339695 / 46715172 / +9.9% 0.24 / 0.24 / -3.2%
fineweb_q02/datafusion:vortex-file-compressed 12495630 / 13731492 / -9.0% 54338630 / 49392600 / +10.0% 🔴 0.23 / 0.28 / -17.3%
fineweb_q03/datafusion:vortex-file-compressed 19751176 / 19742186 / +0.0% 106311595 / 98144203 / +8.3% 0.19 / 0.20 / -7.6%
fineweb_q04/datafusion:vortex-file-compressed 76904800 / 74175795 / +3.7% 160423938 / 148394516 / +8.1% 0.48 / 0.50 / -4.1%
fineweb_q05/datafusion:vortex-file-compressed 60148620 / 56809712 / +5.9% 143693047 / 141371849 / +1.6% 0.42 / 0.40 / +4.2%
fineweb_q06/datafusion:vortex-file-compressed 19350854 / 19555408 / -1.0% 111137422 / 102421799 / +8.5% 0.17 / 0.19 / -8.8%
fineweb_q07/datafusion:vortex-file-compressed 17149115 / 17646852 / -2.8% 103947297 / 97509296 / +6.6% 0.16 / 0.18 / -8.8%
fineweb_q08/datafusion:vortex-file-compressed 10411028 / 9823326 / +6.0% 44194348 / 42294533 / +4.5% 0.24 / 0.23 / +1.4%
datafusion / parquet / ns (1.058x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9441982 / 9454100 / -0.1% 33895406 / 32227367 / +5.2% 0.28 / 0.29 / -5.0%
fineweb_q01/datafusion:parquet 74734088 / 71090972 / +5.1% 149062572 / 150236386 / -0.8% 0.50 / 0.47 / +6.0%
fineweb_q02/datafusion:parquet 74961740 / 70821418 / +5.8% 152694516 / 140816343 / +8.4% 0.49 / 0.50 / -2.4%
fineweb_q03/datafusion:parquet 72772190 / 69453932 / +4.8% 152269471 / 150492663 / +1.2% 0.48 / 0.46 / +3.6%
fineweb_q04/datafusion:parquet 82175941 / 75897968 / +8.3% 158605402 / 147135180 / +7.8% 0.52 / 0.52 / +0.4%
fineweb_q05/datafusion:parquet 80822151 / 75096662 / +7.6% 147101897 / 140744262 / +4.5% 0.55 / 0.53 / +3.0%
fineweb_q06/datafusion:parquet 75301292 / 70928649 / +6.2% 157903039 / 151253667 / +4.4% 0.48 / 0.47 / +1.7%
fineweb_q07/datafusion:parquet 75059484 / 70464286 / +6.5% 150402623 / 143105522 / +5.1% 0.50 / 0.49 / +1.4%
fineweb_q08/datafusion:parquet 73334745 / 67856062 / +8.1% 150171160 / 150794943 / -0.4% 0.49 / 0.45 / +8.5%
duckdb / vortex-file-compressed / ns (1.088x ➖, 2↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2859158 / 1807430 / +58.2% 🔴 6643531 / 7617345 / -12.8% 🟢 0.43 / 0.24 / +81.4%
fineweb_q01/duckdb:vortex-file-compressed 19584050 / 22354022 / -12.4% 🟢 59570718 / 61774956 / -3.6% 0.33 / 0.36 / -9.1%
fineweb_q02/duckdb:vortex-file-compressed 21605856 / 22452792 / -3.8% 60955517 / 57472702 / +6.1% 0.35 / 0.39 / -9.3%
fineweb_q03/duckdb:vortex-file-compressed 25893390 / 22763513 / +13.7% 🔴 109260880 / 87970752 / +24.2% 🔴 0.24 / 0.26 / -8.4%
fineweb_q04/duckdb:vortex-file-compressed 75331972 / 73899063 / +1.9% 118754861 / 112419886 / +5.6% 0.63 / 0.66 / -3.5%
fineweb_q05/duckdb:vortex-file-compressed 64264800 / 58131902 / +10.5% 🔴 140734294 / 100500544 / +40.0% 🔴 0.46 / 0.58 / -21.1%
fineweb_q06/duckdb:vortex-file-compressed 36668966 / 40931189 / -10.4% 🟢 134588177 / 138688808 / -3.0% 0.27 / 0.30 / -7.7%
fineweb_q07/duckdb:vortex-file-compressed 30402384 / 26189546 / +16.1% 🔴 100443259 / 92058801 / +9.1% 0.30 / 0.28 / +6.4%
fineweb_q08/duckdb:vortex-file-compressed 7000424 / 5801941 / +20.7% 🔴 13753713 / 14292102 / -3.8% 0.51 / 0.41 / +25.4%
duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21795064 / 22858464 / -4.7% 23427035 / 26998400 / -13.2% 🟢 0.93 / 0.85 / +9.9%
fineweb_q01/duckdb:parquet 44481971 / 44758608 / -0.6% 55021911 / 57984132 / -5.1% 0.81 / 0.77 / +4.7%
fineweb_q02/duckdb:parquet 43589209 / 44470763 / -2.0% 56815200 / 53374290 / +6.4% 0.77 / 0.83 / -7.9%
fineweb_q03/duckdb:parquet 95141020 / 95338534 / -0.2% 187414133 / 192669978 / -2.7% 0.51 / 0.49 / +2.6%
fineweb_q04/duckdb:parquet 152932274 / 152180990 / +0.5% 213706995 / 212303641 / +0.7% 0.72 / 0.72 / -0.2%
fineweb_q05/duckdb:parquet 142504636 / 142306466 / +0.1% 204624231 / 201845749 / +1.4% 0.70 / 0.71 / -1.2%
fineweb_q06/duckdb:parquet 71037442 / 71120058 / -0.1% 128031092 / 118123580 / +8.4% 0.55 / 0.60 / -7.8%
fineweb_q07/duckdb:parquet 71961328 / 71299380 / +0.9% 149992499 / 149412054 / +0.4% 0.48 / 0.48 / +0.5%
fineweb_q08/duckdb:parquet 25096980 / 24688058 / +1.7% 24562203 / 24293669 / +1.1% 1.02 / 1.02 / +0.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 026bb264 vs base ae00d7a1
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (-1.7%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.071x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.039x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 194133060 / 191512387 / +1.4% 568604393 / 556661051 / +2.1% 0.34 / 0.34 / -0.8%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10589450 / 10647315 / -0.5% 52722963 / 47915130 / +10.0% 🔴 0.20 / 0.22 / -9.6%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11327150 / 12137284 / -6.7% 50260761 / 49441446 / +1.7% 0.23 / 0.25 / -8.2%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23041253 / 23114894 / -0.3% 69528972 / 65041944 / +6.9% 0.33 / 0.36 / -6.8%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18318448 / 17654305 / +3.8% 62314874 / 57414317 / +8.5% 0.29 / 0.31 / -4.4%
clickbench-sorted_q38/datafusion:vortex-file-compressed 16954198 / 17292769 / -2.0% 61985828 / 57948412 / +7.0% 0.27 / 0.30 / -8.3%
clickbench-sorted_q39/datafusion:vortex-file-compressed 40098098 / 40326346 / -0.6% 93681572 / 89504669 / +4.7% 0.43 / 0.45 / -5.0%
clickbench-sorted_q40/datafusion:vortex-file-compressed 11903858 / 12110752 / -1.7% 45905329 / 42654818 / +7.6% 0.26 / 0.28 / -8.7%
clickbench-sorted_q41/datafusion:vortex-file-compressed 12635581 / 12142305 / +4.1% 46623249 / 41460979 / +12.5% 🔴 0.27 / 0.29 / -7.5%
clickbench-sorted_q42/datafusion:vortex-file-compressed 10297036 / 9901224 / +4.0% 36459975 / 35413150 / +3.0% 0.28 / 0.28 / +1.0%
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 757291222 / 759510558 / -0.3% 961137997 / 964925891 / -0.4% 0.79 / 0.79 / +0.1%
clickbench-sorted_q24/datafusion:parquet 8656608 / 9436570 / -8.3% 75021257 / 69728831 / +7.6% 0.12 / 0.14 / -14.7%
clickbench-sorted_q26/datafusion:parquet 9089073 / 9259072 / -1.8% 72515410 / 73097740 / -0.8% 0.13 / 0.13 / -1.0%
clickbench-sorted_q36/datafusion:parquet 94114690 / 93366580 / +0.8% 172691082 / 167338661 / +3.2% 0.54 / 0.56 / -2.3%
clickbench-sorted_q37/datafusion:parquet 64350463 / 64333080 / +0.0% 132688502 / 130143093 / +2.0% 0.48 / 0.49 / -1.9%
clickbench-sorted_q38/datafusion:parquet 87849124 / 87432652 / +0.5% 164059037 / 161292007 / +1.7% 0.54 / 0.54 / -1.2%
clickbench-sorted_q39/datafusion:parquet 159336984 / 159488513 / -0.1% 237871625 / 234532596 / +1.4% 0.67 / 0.68 / -1.5%
clickbench-sorted_q40/datafusion:parquet 44713684 / 44334119 / +0.9% 118281341 / 111288524 / +6.3% 0.38 / 0.40 / -5.1%
clickbench-sorted_q41/datafusion:parquet 42226684 / 41658000 / +1.4% 113968444 / 108443080 / +5.1% 0.37 / 0.38 / -3.5%
clickbench-sorted_q42/datafusion:parquet 26213753 / 26005347 / +0.8% 87928339 / 88218669 / -0.3% 0.30 / 0.29 / +1.1%
duckdb / vortex-file-compressed / ns (0.997x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 61408004 / 58170088 / +5.6% 84918602 / 88448758 / -4.0% 0.72 / 0.66 / +10.0%
clickbench-sorted_q24/duckdb:vortex-file-compressed 18020802 / 20818564 / -13.4% 🟢 31998081 / 29671689 / +7.8% 0.56 / 0.70 / -19.7%
clickbench-sorted_q26/duckdb:vortex-file-compressed 19880946 / 15802668 / +25.8% 🔴 32549816 / 26094568 / +24.7% 🔴 0.61 / 0.61 / +0.9%
clickbench-sorted_q36/duckdb:vortex-file-compressed 31685630 / 28934645 / +9.5% 67400549 / 60540818 / +11.3% 🔴 0.47 / 0.48 / -1.6%
clickbench-sorted_q37/duckdb:vortex-file-compressed 23478504 / 25631261 / -8.4% 55237616 / 53225981 / +3.8% 0.43 / 0.48 / -11.7%
clickbench-sorted_q38/duckdb:vortex-file-compressed 25163996 / 25588682 / -1.7% 61712485 / 53282524 / +15.8% 🔴 0.41 / 0.48 / -15.1%
clickbench-sorted_q39/duckdb:vortex-file-compressed 48345792 / 48322404 / +0.0% 102924092 / 92329025 / +11.5% 🔴 0.47 / 0.52 / -10.3%
clickbench-sorted_q40/duckdb:vortex-file-compressed 15984540 / 16558862 / -3.5% 43622873 / 40014364 / +9.0% 0.37 / 0.41 / -11.5%
clickbench-sorted_q41/duckdb:vortex-file-compressed 15509274 / 15701588 / -1.2% 40361023 / 38727979 / +4.2% 0.38 / 0.41 / -5.2%
clickbench-sorted_q42/duckdb:vortex-file-compressed 12619272 / 14130954 / -10.7% 🟢 32464972 / 33387797 / -2.8% 0.39 / 0.42 / -8.2%
duckdb / parquet / ns (1.014x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 128667286 / 129908787 / -1.0% 143156243 / 139282968 / +2.8% 0.90 / 0.93 / -3.6%
clickbench-sorted_q24/duckdb:parquet 18215714 / 18286890 / -0.4% 28152541 / 33070389 / -14.9% 🟢 0.65 / 0.55 / +17.0%
clickbench-sorted_q26/duckdb:parquet 13390002 / 12702745 / +5.4% 23639338 / 24186820 / -2.3% 0.57 / 0.53 / +7.9%
clickbench-sorted_q36/duckdb:parquet 46467280 / 43493399 / +6.8% 65893728 / 59143644 / +11.4% 🔴 0.71 / 0.74 / -4.1%
clickbench-sorted_q37/duckdb:parquet 31627452 / 31849398 / -0.7% 53386497 / 46584907 / +14.6% 🔴 0.59 / 0.68 / -13.3%
clickbench-sorted_q38/duckdb:parquet 40430231 / 40349444 / +0.2% 62335232 / 57362797 / +8.7% 0.65 / 0.70 / -7.8%
clickbench-sorted_q39/duckdb:parquet 74225862 / 73880282 / +0.5% 87618085 / 87646816 / -0.0% 0.85 / 0.84 / +0.5%
clickbench-sorted_q40/duckdb:parquet 17741072 / 16810336 / +5.5% 44909818 / 35626388 / +26.1% 🔴 0.40 / 0.47 / -16.3%
clickbench-sorted_q41/duckdb:parquet 16768030 / 16839714 / -0.4% 44081289 / 35193718 / +25.3% 🔴 0.38 / 0.48 / -20.5%
clickbench-sorted_q42/duckdb:parquet 11231155 / 11459416 / -2.0% 22972499 / 25667488 / -10.5% 🟢 0.49 / 0.45 / +9.5%

File Size Changes (100 files changed, +0.0% overall, 48↑ 52↓)
File Scale Format Base HEAD Change %
hits_002.vortex 1.0 vortex-file-compressed 159.93 MB 161.74 MB +1.81 MB +1.1%
hits_090.vortex 1.0 vortex-file-compressed 192.32 MB 194.46 MB +2.13 MB +1.1%
hits_038.vortex 1.0 vortex-file-compressed 189.57 MB 191.56 MB +1.99 MB +1.0%
hits_076.vortex 1.0 vortex-file-compressed 160.01 MB 161.58 MB +1.57 MB +1.0%
hits_074.vortex 1.0 vortex-file-compressed 198.69 MB 200.11 MB +1.42 MB +0.7%
hits_055.vortex 1.0 vortex-file-compressed 199.53 MB 200.70 MB +1.18 MB +0.6%
hits_066.vortex 1.0 vortex-file-compressed 162.90 MB 163.73 MB +844.78 KB +0.5%
hits_023.vortex 1.0 vortex-file-compressed 194.91 MB 195.80 MB +908.19 KB +0.5%
hits_000.vortex 1.0 vortex-file-compressed 130.67 MB 131.04 MB +379.93 KB +0.3%
hits_064.vortex 1.0 vortex-file-compressed 190.42 MB 190.91 MB +499.59 KB +0.3%
hits_088.vortex 1.0 vortex-file-compressed 172.66 MB 173.10 MB +450.24 KB +0.3%
hits_041.vortex 1.0 vortex-file-compressed 130.35 MB 130.62 MB +280.41 KB +0.2%
hits_025.vortex 1.0 vortex-file-compressed 172.24 MB 172.57 MB +332.61 KB +0.2%
hits_022.vortex 1.0 vortex-file-compressed 200.12 MB 200.45 MB +339.48 KB +0.2%
hits_014.vortex 1.0 vortex-file-compressed 172.69 MB 172.97 MB +291.16 KB +0.2%
hits_020.vortex 1.0 vortex-file-compressed 159.76 MB 160.00 MB +248.01 KB +0.2%
hits_079.vortex 1.0 vortex-file-compressed 180.59 MB 180.84 MB +258.84 KB +0.1%
hits_081.vortex 1.0 vortex-file-compressed 201.10 MB 201.36 MB +267.63 KB +0.1%
hits_060.vortex 1.0 vortex-file-compressed 192.79 MB 193.03 MB +249.11 KB +0.1%
hits_008.vortex 1.0 vortex-file-compressed 139.55 MB 139.72 MB +174.77 KB +0.1%
hits_056.vortex 1.0 vortex-file-compressed 135.47 MB 135.61 MB +143.38 KB +0.1%
hits_029.vortex 1.0 vortex-file-compressed 200.82 MB 201.01 MB +200.98 KB +0.1%
hits_043.vortex 1.0 vortex-file-compressed 126.64 MB 126.73 MB +96.23 KB +0.1%
hits_086.vortex 1.0 vortex-file-compressed 191.73 MB 191.87 MB +144.48 KB +0.1%
hits_044.vortex 1.0 vortex-file-compressed 201.26 MB 201.39 MB +133.99 KB +0.1%
hits_052.vortex 1.0 vortex-file-compressed 130.12 MB 130.19 MB +69.15 KB +0.1%
hits_050.vortex 1.0 vortex-file-compressed 161.60 MB 161.68 MB +80.77 KB +0.0%
hits_001.vortex 1.0 vortex-file-compressed 188.70 MB 188.78 MB +85.87 KB +0.0%
hits_045.vortex 1.0 vortex-file-compressed 139.80 MB 139.86 MB +62.32 KB +0.0%
hits_058.vortex 1.0 vortex-file-compressed 154.41 MB 154.48 MB +68.58 KB +0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.20 MB 156.26 MB +68.13 KB +0.0%
hits_018.vortex 1.0 vortex-file-compressed 200.66 MB 200.74 MB +75.59 KB +0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.34 MB 130.39 MB +48.37 KB +0.0%
hits_046.vortex 1.0 vortex-file-compressed 100.72 MB 100.75 MB +27.59 KB +0.0%
hits_040.vortex 1.0 vortex-file-compressed 144.01 MB 144.04 MB +29.03 KB +0.0%
hits_085.vortex 1.0 vortex-file-compressed 200.68 MB 200.72 MB +40.07 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.84 MB 171.87 MB +32.44 KB +0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.74 MB 161.76 MB +21.71 KB +0.0%
hits_011.vortex 1.0 vortex-file-compressed 200.21 MB 200.24 MB +25.80 KB +0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.75 MB 142.77 MB +15.03 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 127.05 MB 127.06 MB +10.44 KB +0.0%
hits_042.vortex 1.0 vortex-file-compressed 201.99 MB 202.01 MB +14.70 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 161.31 MB 161.32 MB +10.92 KB +0.0%
hits_027.vortex 1.0 vortex-file-compressed 189.54 MB 189.55 MB +12.61 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.66 MB 161.67 MB +7.90 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.07 MB 131.08 MB +5.93 KB +0.0%
hits_054.vortex 1.0 vortex-file-compressed 147.24 MB 147.24 MB +5.48 KB +0.0%
hits_024.vortex 1.0 vortex-file-compressed 161.18 MB 161.19 MB +5.52 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 178.19 MB 178.19 MB 464 B -0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.80 MB 153.80 MB 2.80 KB -0.0%
hits_028.vortex 1.0 vortex-file-compressed 152.15 MB 152.15 MB 3.58 KB -0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.08 MB 189.07 MB 4.58 KB -0.0%
hits_004.vortex 1.0 vortex-file-compressed 130.96 MB 130.95 MB 4.56 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.68 MB 153.67 MB 7.09 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.08 MB 191.07 MB 10.20 KB -0.0%
hits_012.vortex 1.0 vortex-file-compressed 190.40 MB 190.38 MB 22.38 KB -0.0%
hits_048.vortex 1.0 vortex-file-compressed 200.70 MB 200.68 MB 24.42 KB -0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.18 MB 102.17 MB 12.88 KB -0.0%
hits_051.vortex 1.0 vortex-file-compressed 172.92 MB 172.90 MB 22.99 KB -0.0%
hits_095.vortex 1.0 vortex-file-compressed 153.73 MB 153.71 MB 22.24 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.18 MB 159.14 MB 43.00 KB -0.0%
hits_068.vortex 1.0 vortex-file-compressed 160.30 MB 160.26 MB 43.44 KB -0.0%
hits_065.vortex 1.0 vortex-file-compressed 162.01 MB 161.96 MB 45.42 KB -0.0%
hits_032.vortex 1.0 vortex-file-compressed 154.06 MB 154.01 MB 43.65 KB -0.0%
hits_009.vortex 1.0 vortex-file-compressed 101.11 MB 101.09 MB 29.27 KB -0.0%
hits_089.vortex 1.0 vortex-file-compressed 130.69 MB 130.65 MB 43.75 KB -0.0%
hits_072.vortex 1.0 vortex-file-compressed 101.90 MB 101.86 MB 40.51 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.61 MB 126.55 MB 56.10 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.54 MB 136.48 MB 60.66 KB -0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.25 MB 147.19 MB 68.16 KB -0.0%
hits_082.vortex 1.0 vortex-file-compressed 139.27 MB 139.20 MB 68.76 KB -0.0%
hits_005.vortex 1.0 vortex-file-compressed 167.21 MB 167.13 MB 86.65 KB -0.1%
hits_053.vortex 1.0 vortex-file-compressed 189.55 MB 189.44 MB 109.03 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.84 MB 130.76 MB 81.52 KB -0.1%
hits_094.vortex 1.0 vortex-file-compressed 158.58 MB 158.47 MB 114.85 KB -0.1%
hits_092.vortex 1.0 vortex-file-compressed 200.71 MB 200.56 MB 154.92 KB -0.1%
hits_084.vortex 1.0 vortex-file-compressed 154.01 MB 153.89 MB 124.98 KB -0.1%
hits_091.vortex 1.0 vortex-file-compressed 147.43 MB 147.31 MB 122.29 KB -0.1%
hits_034.vortex 1.0 vortex-file-compressed 183.37 MB 183.21 MB 154.80 KB -0.1%
hits_026.vortex 1.0 vortex-file-compressed 130.56 MB 130.44 MB 124.30 KB -0.1%
hits_036.vortex 1.0 vortex-file-compressed 172.04 MB 171.88 MB 164.67 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.80 MB 137.67 MB 139.17 KB -0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.48 MB 130.35 MB 133.52 KB -0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.97 MB 130.84 MB 137.23 KB -0.1%
hits_077.vortex 1.0 vortex-file-compressed 173.20 MB 173.01 MB 187.40 KB -0.1%
hits_007.vortex 1.0 vortex-file-compressed 201.33 MB 201.12 MB 218.27 KB -0.1%
hits_070.vortex 1.0 vortex-file-compressed 199.79 MB 199.58 MB 217.31 KB -0.1%
hits_067.vortex 1.0 vortex-file-compressed 130.86 MB 130.70 MB 165.85 KB -0.1%
hits_016.vortex 1.0 vortex-file-compressed 180.02 MB 179.70 MB 327.77 KB -0.2%
hits_097.vortex 1.0 vortex-file-compressed 193.05 MB 192.65 MB 412.17 KB -0.2%
hits_057.vortex 1.0 vortex-file-compressed 160.16 MB 159.82 MB 342.91 KB -0.2%
hits_073.vortex 1.0 vortex-file-compressed 173.38 MB 172.93 MB 459.45 KB -0.3%
hits_019.vortex 1.0 vortex-file-compressed 140.76 MB 140.14 MB 630.89 KB -0.4%
hits_062.vortex 1.0 vortex-file-compressed 171.96 MB 171.20 MB 775.45 KB -0.4%
hits_071.vortex 1.0 vortex-file-compressed 139.94 MB 139.25 MB 705.03 KB -0.5%
hits_010.vortex 1.0 vortex-file-compressed 169.69 MB 168.84 MB 866.77 KB -0.5%
hits_033.vortex 1.0 vortex-file-compressed 201.03 MB 199.79 MB 1.24 MB -0.6%
hits_059.vortex 1.0 vortex-file-compressed 200.24 MB 198.99 MB 1.25 MB -0.6%
hits_096.vortex 1.0 vortex-file-compressed 200.37 MB 199.02 MB 1.35 MB -0.7%
hits_087.vortex 1.0 vortex-file-compressed 161.57 MB 160.35 MB 1.21 MB -0.8%

Totals:

  • vortex-file-compressed: 15.96 GB → 15.96 GB (+0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 026bb264 vs base ae00d7a1
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -15.0%
Engines: DataFusion No clear signal (-27.6%, environment too noisy confidence) · DuckDB No clear signal (-0.2%, environment too noisy confidence)
Vortex (geomean): hot 0.944x ➖ · cold 1.053x ➖
Parquet (geomean): hot 1.111x ➖ · cold 1.185x ➖
Shifts: Parquet (control) +11.1% · Median polish +5.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.836x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 40906539 / 75871426 / -46.1% 🟢 129981855 / 118084822 / +10.1% 0.31 / 0.64 / -51.0%
fineweb_q01/datafusion:vortex-file-compressed 515839170 / 1718616216 / -70.0% 🟢 962659626 / 1182859011 / -18.6% 0.54 / 1.45 / -63.1%
fineweb_q02/datafusion:vortex-file-compressed 437033352 / 419963637 / +4.1% 561420989 / 611655704 / -8.2% 0.78 / 0.69 / +13.4%
fineweb_q03/datafusion:vortex-file-compressed 577150461 / 566241850 / +1.9% 1090437239 / 831236061 / +31.2% 🔴 0.53 / 0.68 / -22.3%
fineweb_q04/datafusion:vortex-file-compressed 534321622 / 620731334 / -13.9% 484740665 / 553992673 / -12.5% 1.10 / 1.12 / -1.6%
fineweb_q05/datafusion:vortex-file-compressed 453602954 / 430782470 / +5.3% 485329774 / 432221749 / +12.3% 0.93 / 1.00 / -6.2%
fineweb_q06/datafusion:vortex-file-compressed 729857568 / 701994468 / +4.0% 777863826 / 690989275 / +12.6% 0.94 / 1.02 / -7.6%
fineweb_q07/datafusion:vortex-file-compressed 500766014 / 590751702 / -15.2% 485486379 / 625217206 / -22.3% 1.03 / 0.94 / +9.2%
fineweb_q08/datafusion:vortex-file-compressed 250795938 / 173127834 / +44.9% 🔴 385580776 / 192266645 / +100.5% 🔴 0.65 / 0.90 / -27.8%
datafusion / parquet / ns (1.155x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 680761846 / 520587928 / +30.8% 🔴 896440333 / 778874603 / +15.1% 0.76 / 0.67 / +13.6%
fineweb_q01/datafusion:parquet 1077434788 / 1113943128 / -3.3% 1189814768 / 812180278 / +46.5% 🔴 0.91 / 1.37 / -34.0%
fineweb_q02/datafusion:parquet 1176790927 / 772978692 / +52.2% 🔴 1198503361 / 937898829 / +27.8% 0.98 / 0.82 / +19.1%
fineweb_q03/datafusion:parquet 749568988 / 870151108 / -13.9% 723234853 / 730558844 / -1.0% 1.04 / 1.19 / -13.0%
fineweb_q04/datafusion:parquet 828263268 / 741668340 / +11.7% 800965358 / 654636487 / +22.4% 1.03 / 1.13 / -8.7%
fineweb_q05/datafusion:parquet 873269827 / 724793778 / +20.5% 985016761 / 771377077 / +27.7% 0.89 / 0.94 / -5.6%
fineweb_q06/datafusion:parquet 1117978861 / 779294329 / +43.5% 🔴 1150833702 / 866538233 / +32.8% 🔴 0.97 / 0.90 / +8.0%
fineweb_q07/datafusion:parquet 905307512 / 798325750 / +13.4% 1151704945 / 714980073 / +61.1% 🔴 0.79 / 1.12 / -29.6%
fineweb_q08/datafusion:parquet 786775050 / 783491382 / +0.4% 1013814427 / 761715017 / +33.1% 🔴 0.78 / 1.03 / -24.6%
duckdb / vortex-file-compressed / ns (1.066x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 64935390 / 66167512 / -1.9% 67940914 / 66020765 / +2.9% 0.96 / 1.00 / -4.6%
fineweb_q01/duckdb:vortex-file-compressed 426598245 / 422085922 / +1.1% 503616951 / 502291249 / +0.3% 0.85 / 0.84 / +0.8%
fineweb_q02/duckdb:vortex-file-compressed 673742266 / 595131486 / +13.2% 737020122 / 569147263 / +29.5% 0.91 / 1.05 / -12.6%
fineweb_q03/duckdb:vortex-file-compressed 1139756600 / 973175938 / +17.1% 1102685361 / 1104632215 / -0.2% 1.03 / 0.88 / +17.3%
fineweb_q04/duckdb:vortex-file-compressed 1091386726 / 974669349 / +12.0% 1077662013 / 986528985 / +9.2% 1.01 / 0.99 / +2.5%
fineweb_q05/duckdb:vortex-file-compressed 908030772 / 924566948 / -1.8% 966546834 / 996401169 / -3.0% 0.94 / 0.93 / +1.2%
fineweb_q06/duckdb:vortex-file-compressed 1253305978 / 1164025794 / +7.7% 1244597675 / 1277291062 / -2.6% 1.01 / 0.91 / +10.5%
fineweb_q07/duckdb:vortex-file-compressed 1055210356 / 955560738 / +10.4% 1092218873 / 1049481404 / +4.1% 0.97 / 0.91 / +6.1%
fineweb_q08/duckdb:vortex-file-compressed 453279200 / 438064598 / +3.5% 479579445 / 508261681 / -5.6% 0.95 / 0.86 / +9.7%
duckdb / parquet / ns (1.068x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 516080069 / 484070418 / +6.6% 585121443 / 679036334 / -13.8% 0.88 / 0.71 / +23.7%
fineweb_q01/duckdb:parquet 614553984 / 634761938 / -3.2% 822992458 / 546663734 / +50.5% 🔴 0.75 / 1.16 / -35.7%
fineweb_q02/duckdb:parquet 603392326 / 610620140 / -1.2% 631700419 / 681904474 / -7.4% 0.96 / 0.90 / +6.7%
fineweb_q03/duckdb:parquet 1608979564 / 1376811652 / +16.9% 1789619671 / 1491199974 / +20.0% 0.90 / 0.92 / -2.6%
fineweb_q04/duckdb:parquet 893508846 / 915809252 / -2.4% 952011872 / 766499833 / +24.2% 0.94 / 1.19 / -21.4%
fineweb_q05/duckdb:parquet 940643112 / 872823873 / +7.8% 1029178532 / 1041744264 / -1.2% 0.91 / 0.84 / +9.1%
fineweb_q06/duckdb:parquet 1823600304 / 1661192168 / +9.8% 1743456259 / 1874234393 / -7.0% 1.05 / 0.89 / +18.0%
fineweb_q07/duckdb:parquet 1246053426 / 1181095297 / +5.5% 1268828694 / 1020155118 / +24.4% 0.98 / 1.16 / -15.2%
fineweb_q08/duckdb:parquet 604810450 / 485024438 / +24.7% 572985210 / 522751484 / +9.6% 1.06 / 0.93 / +13.8%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 026bb264 vs base ae00d7a1
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.3%, environment too noisy confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.021x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.018x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1219457 / 1250388 / -2.5% 21499997 / 19861059 / +8.3% 0.06 / 0.06 / -9.9%
clickbench_q01/datafusion:vortex-file-compressed 6144844 / 5799156 / +6.0% 30790890 / 32660578 / -5.7% 0.20 / 0.18 / +12.4%
clickbench_q02/datafusion:vortex-file-compressed 10545712 / 10793528 / -2.3% 35926173 / 35407118 / +1.5% 0.29 / 0.30 / -3.7%
clickbench_q03/datafusion:vortex-file-compressed 11710534 / 11818445 / -0.9% 53689933 / 53113489 / +1.1% 0.22 / 0.22 / -2.0%
clickbench_q04/datafusion:vortex-file-compressed 56258929 / 56497192 / -0.4% 94754923 / 91919481 / +3.1% 0.59 / 0.61 / -3.4%
clickbench_q05/datafusion:vortex-file-compressed 74937342 / 73179956 / +2.4% 114658384 / 113871360 / +0.7% 0.65 / 0.64 / +1.7%
clickbench_q06/datafusion:vortex-file-compressed 1222038 / 1252696 / -2.4% 20920591 / 20396248 / +2.6% 0.06 / 0.06 / -4.9%
clickbench_q07/datafusion:vortex-file-compressed 10009542 / 9865628 / +1.5% 35599955 / 36746662 / -3.1% 0.28 / 0.27 / +4.7%
clickbench_q08/datafusion:vortex-file-compressed 76767786 / 74643878 / +2.8% 117953869 / 118513843 / -0.5% 0.65 / 0.63 / +3.3%
clickbench_q09/datafusion:vortex-file-compressed 168067612 / 170407442 / -1.4% 202298168 / 206220495 / -1.9% 0.83 / 0.83 / +0.5%
clickbench_q10/datafusion:vortex-file-compressed 23332876 / 23081892 / +1.1% 67875877 / 63543893 / +6.8% 0.34 / 0.36 / -5.4%
clickbench_q11/datafusion:vortex-file-compressed 27152626 / 26281587 / +3.3% 70368436 / 71804034 / -2.0% 0.39 / 0.37 / +5.4%
clickbench_q12/datafusion:vortex-file-compressed 73994703 / 71857712 / +3.0% 114620270 / 114506127 / +0.1% 0.65 / 0.63 / +2.9%
clickbench_q13/datafusion:vortex-file-compressed 118607458 / 119619146 / -0.8% 178504498 / 179282168 / -0.4% 0.66 / 0.67 / -0.4%
clickbench_q14/datafusion:vortex-file-compressed 78839810 / 73751046 / +6.9% 121124809 / 123866281 / -2.2% 0.65 / 0.60 / +9.3%
clickbench_q15/datafusion:vortex-file-compressed 60873312 / 62149484 / -2.1% 98215868 / 97258060 / +1.0% 0.62 / 0.64 / -3.0%
clickbench_q16/datafusion:vortex-file-compressed 148922818 / 151499850 / -1.7% 202369698 / 206819623 / -2.2% 0.74 / 0.73 / +0.5%
clickbench_q17/datafusion:vortex-file-compressed 147888228 / 150638106 / -1.8% 209196727 / 217343889 / -3.7% 0.71 / 0.69 / +2.0%
clickbench_q18/datafusion:vortex-file-compressed 300806720 / 296888153 / +1.3% 375619173 / 377207161 / -0.4% 0.80 / 0.79 / +1.7%
clickbench_q19/datafusion:vortex-file-compressed 7544250 / 8070575 / -6.5% 47671330 / 47713377 / -0.1% 0.16 / 0.17 / -6.4%
clickbench_q20/datafusion:vortex-file-compressed 60760482 / 62150348 / -2.2% 228392506 / 229928040 / -0.7% 0.27 / 0.27 / -1.6%
clickbench_q21/datafusion:vortex-file-compressed 90003746 / 90399826 / -0.4% 271082876 / 273046893 / -0.7% 0.33 / 0.33 / +0.3%
clickbench_q22/datafusion:vortex-file-compressed 103219491 / 103727738 / -0.5% 345453713 / 347804336 / -0.7% 0.30 / 0.30 / +0.2%
clickbench_q23/datafusion:vortex-file-compressed 202442342 / 212655306 / -4.8% 541897420 / 523524057 / +3.5% 0.37 / 0.41 / -8.0%
clickbench_q24/datafusion:vortex-file-compressed 15848616 / 16238656 / -2.4% 64661467 / 64328770 / +0.5% 0.25 / 0.25 / -2.9%
clickbench_q25/datafusion:vortex-file-compressed 18097053 / 17442508 / +3.8% 55926155 / 56648342 / -1.3% 0.32 / 0.31 / +5.1%
clickbench_q26/datafusion:vortex-file-compressed 17107008 / 16174126 / +5.8% 63133926 / 64703287 / -2.4% 0.27 / 0.25 / +8.4%
clickbench_q27/datafusion:vortex-file-compressed 96340048 / 97923522 / -1.6% 242291331 / 244270400 / -0.8% 0.40 / 0.40 / -0.8%
clickbench_q28/datafusion:vortex-file-compressed 567059122 / 570378472 / -0.6% 627019204 / 611380064 / +2.6% 0.90 / 0.93 / -3.1%
clickbench_q29/datafusion:vortex-file-compressed 23608942 / 23826976 / -0.9% 51284815 / 49398308 / +3.8% 0.46 / 0.48 / -4.6%
clickbench_q30/datafusion:vortex-file-compressed 63664959 / 59366116 / +7.2% 104898313 / 104540385 / +0.3% 0.61 / 0.57 / +6.9%
clickbench_q31/datafusion:vortex-file-compressed 71190214 / 70128589 / +1.5% 151406741 / 150772185 / +0.4% 0.47 / 0.47 / +1.1%
clickbench_q32/datafusion:vortex-file-compressed 311153032 / 305099208 / +2.0% 384912522 / 380957629 / +1.0% 0.81 / 0.80 / +0.9%
clickbench_q33/datafusion:vortex-file-compressed 331035380 / 329835726 / +0.4% 436737110 / 418230427 / +4.4% 0.76 / 0.79 / -3.9%
clickbench_q34/datafusion:vortex-file-compressed 329626754 / 324577362 / +1.6% 432235174 / 433473045 / -0.3% 0.76 / 0.75 / +1.8%
clickbench_q35/datafusion:vortex-file-compressed 53637060 / 56422530 / -4.9% 89182405 / 87893945 / +1.5% 0.60 / 0.64 / -6.3%
clickbench_q36/datafusion:vortex-file-compressed 37056556 / 37188604 / -0.4% 67051669 / 66151035 / +1.4% 0.55 / 0.56 / -1.7%
clickbench_q37/datafusion:vortex-file-compressed 21759246 / 21734810 / +0.1% 47771118 / 48265937 / -1.0% 0.46 / 0.45 / +1.1%
clickbench_q38/datafusion:vortex-file-compressed 11782123 / 11785498 / -0.0% 40040164 / 39361846 / +1.7% 0.29 / 0.30 / -1.7%
clickbench_q39/datafusion:vortex-file-compressed 77600979 / 78883990 / -1.6% 111876641 / 108781869 / +2.8% 0.69 / 0.73 / -4.3%
clickbench_q40/datafusion:vortex-file-compressed 11840724 / 11321404 / +4.6% 37170957 / 38856549 / -4.3% 0.32 / 0.29 / +9.3%
clickbench_q41/datafusion:vortex-file-compressed 10365457 / 10601354 / -2.2% 36032215 / 35838567 / +0.5% 0.29 / 0.30 / -2.8%
clickbench_q42/datafusion:vortex-file-compressed 11120850 / 11034450 / +0.8% 36141327 / 36480585 / -0.9% 0.31 / 0.30 / +1.7%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1244570 / 1289164 / -3.5% 50452332 / 49538767 / +1.8% 0.02 / 0.03 / -5.2%
clickbench_q01/datafusion:parquet 16291828 / 15922630 / +2.3% 68707531 / 73133208 / -6.1% 0.24 / 0.22 / +8.9%
clickbench_q02/datafusion:parquet 19496902 / 18798481 / +3.7% 85783631 / 82578483 / +3.9% 0.23 / 0.23 / -0.2%
clickbench_q03/datafusion:parquet 17297466 / 17238334 / +0.3% 84021294 / 82701106 / +1.6% 0.21 / 0.21 / -1.2%
clickbench_q04/datafusion:parquet 61641390 / 61215504 / +0.7% 132963046 / 128964057 / +3.1% 0.46 / 0.47 / -2.3%
clickbench_q05/datafusion:parquet 89472370 / 88526132 / +1.1% 162225350 / 155209059 / +4.5% 0.55 / 0.57 / -3.3%
clickbench_q06/datafusion:parquet 1293998 / 1251976 / +3.4% 50154462 / 49021875 / +2.3% 0.03 / 0.03 / +1.0%
clickbench_q07/datafusion:parquet 16636523 / 16601960 / +0.2% 69796000 / 69455985 / +0.5% 0.24 / 0.24 / -0.3%
clickbench_q08/datafusion:parquet 84926624 / 87275780 / -2.7% 166526497 / 163754736 / +1.7% 0.51 / 0.53 / -4.3%
clickbench_q09/datafusion:parquet 187316599 / 187582870 / -0.1% 271067309 / 267391636 / +1.4% 0.69 / 0.70 / -1.5%
clickbench_q10/datafusion:parquet 37076586 / 36400826 / +1.9% 104545601 / 101547543 / +3.0% 0.35 / 0.36 / -1.1%
clickbench_q11/datafusion:parquet 43395020 / 43629168 / -0.5% 111194773 / 111658939 / -0.4% 0.39 / 0.39 / -0.1%
clickbench_q12/datafusion:parquet 95418176 / 95554891 / -0.1% 163652186 / 159103050 / +2.9% 0.58 / 0.60 / -2.9%
clickbench_q13/datafusion:parquet 149819068 / 147258300 / +1.7% 230467802 / 222109369 / +3.8% 0.65 / 0.66 / -2.0%
clickbench_q14/datafusion:parquet 102172092 / 102391841 / -0.2% 174428128 / 171593136 / +1.7% 0.59 / 0.60 / -1.8%
clickbench_q15/datafusion:parquet 71076846 / 73358622 / -3.1% 133662265 / 130835045 / +2.2% 0.53 / 0.56 / -5.2%
clickbench_q16/datafusion:parquet 156532006 / 156542378 / -0.0% 237321550 / 236852066 / +0.2% 0.66 / 0.66 / -0.2%
clickbench_q17/datafusion:parquet 157649482 / 155341956 / +1.5% 239641026 / 238363897 / +0.5% 0.66 / 0.65 / +0.9%
clickbench_q18/datafusion:parquet 317353127 / 313281280 / +1.3% 420113906 / 409052814 / +2.7% 0.76 / 0.77 / -1.4%
clickbench_q19/datafusion:parquet 19067790 / 18881586 / +1.0% 77394267 / 75681092 / +2.3% 0.25 / 0.25 / -1.2%
clickbench_q20/datafusion:parquet 178568058 / 180023148 / -0.8% 283379744 / 275829310 / +2.7% 0.63 / 0.65 / -3.5%
clickbench_q21/datafusion:parquet 174508734 / 173549516 / +0.6% 303525000 / 293399126 / +3.5% 0.57 / 0.59 / -2.8%
clickbench_q22/datafusion:parquet 261574112 / 263310626 / -0.7% 427385648 / 414171637 / +3.2% 0.61 / 0.64 / -3.7%
clickbench_q23/datafusion:parquet 1116399245 / 1138772340 / -2.0% 1241839196 / 1231571759 / +0.8% 0.90 / 0.92 / -2.8%
clickbench_q24/datafusion:parquet 30212752 / 30298846 / -0.3% 88138262 / 87387398 / +0.9% 0.34 / 0.35 / -1.1%
clickbench_q25/datafusion:parquet 36611948 / 36452360 / +0.4% 101531561 / 97093413 / +4.6% 0.36 / 0.38 / -4.0%
clickbench_q26/datafusion:parquet 30497888 / 30916485 / -1.4% 89550868 / 88200355 / +1.5% 0.34 / 0.35 / -2.8%
clickbench_q27/datafusion:parquet 194124042 / 193582112 / +0.3% 288254262 / 285747544 / +0.9% 0.67 / 0.68 / -0.6%
clickbench_q28/datafusion:parquet 621999924 / 622980722 / -0.2% 703364460 / 698136303 / +0.7% 0.88 / 0.89 / -0.9%
clickbench_q29/datafusion:parquet 29275044 / 30375524 / -3.6% 94902174 / 93221563 / +1.8% 0.31 / 0.33 / -5.3%
clickbench_q30/datafusion:parquet 91551082 / 90613747 / +1.0% 175488415 / 173367802 / +1.2% 0.52 / 0.52 / -0.2%
clickbench_q31/datafusion:parquet 103635100 / 102849814 / +0.8% 200814866 / 188969477 / +6.3% 0.52 / 0.54 / -5.2%
clickbench_q32/datafusion:parquet 325041390 / 324285936 / +0.2% 429523178 / 427454092 / +0.5% 0.76 / 0.76 / -0.2%
clickbench_q33/datafusion:parquet 383227550 / 383804417 / -0.2% 472511694 / 475313658 / -0.6% 0.81 / 0.81 / +0.4%
clickbench_q34/datafusion:parquet 387488450 / 384049182 / +0.9% 477172320 / 475584977 / +0.3% 0.81 / 0.81 / +0.6%
clickbench_q35/datafusion:parquet 64362956 / 65765481 / -2.1% 123837632 / 123251566 / +0.5% 0.52 / 0.53 / -2.6%
clickbench_q36/datafusion:parquet 73852390 / 73486674 / +0.5% 137199965 / 135632518 / +1.2% 0.54 / 0.54 / -0.7%
clickbench_q37/datafusion:parquet 35421368 / 35726926 / -0.9% 93347573 / 91614237 / +1.9% 0.38 / 0.39 / -2.7%
clickbench_q38/datafusion:parquet 47269420 / 48045099 / -1.6% 108708938 / 106830848 / +1.8% 0.43 / 0.45 / -3.3%
clickbench_q39/datafusion:parquet 143654503 / 144002342 / -0.2% 210566006 / 206736705 / +1.9% 0.68 / 0.70 / -2.1%
clickbench_q40/datafusion:parquet 20303970 / 20161642 / +0.7% 79334872 / 77076013 / +2.9% 0.26 / 0.26 / -2.2%
clickbench_q41/datafusion:parquet 18768511 / 18965006 / -1.0% 76056183 / 75836508 / +0.3% 0.25 / 0.25 / -1.3%
clickbench_q42/datafusion:parquet 19324100 / 19182896 / +0.7% 74992526 / 74876248 / +0.2% 0.26 / 0.26 / +0.6%
duckdb / vortex-file-compressed / ns (1.007x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1587278 / 1729754 / -8.2% 24463942 / 28163911 / -13.1% 🟢 0.06 / 0.06 / +5.6%
clickbench_q01/duckdb:vortex-file-compressed 13604236 / 12064749 / +12.8% 🔴 28909979 / 27979794 / +3.3% 0.47 / 0.43 / +9.1%
clickbench_q02/duckdb:vortex-file-compressed 16301440 / 12829404 / +27.1% 🔴 36683130 / 36220023 / +1.3% 0.44 / 0.35 / +25.5%
clickbench_q03/duckdb:vortex-file-compressed 17609374 / 18667068 / -5.7% 54349650 / 42924272 / +26.6% 🔴 0.32 / 0.43 / -25.5%
clickbench_q04/duckdb:vortex-file-compressed 70125850 / 68881864 / +1.8% 109647030 / 98842599 / +10.9% 🔴 0.64 / 0.70 / -8.2%
clickbench_q05/duckdb:vortex-file-compressed 68384182 / 67137996 / +1.9% 93853325 / 92147437 / +1.9% 0.73 / 0.73 / +0.0%
clickbench_q06/duckdb:vortex-file-compressed 1859818 / 1823891 / +2.0% 27734703 / 28570226 / -2.9% 0.07 / 0.06 / +5.0%
clickbench_q07/duckdb:vortex-file-compressed 13619751 / 15342861 / -11.2% 🟢 30969474 / 35153128 / -11.9% 🟢 0.44 / 0.44 / +0.8%
clickbench_q08/duckdb:vortex-file-compressed 84749906 / 83305124 / +1.7% 127236139 / 135509457 / -6.1% 0.67 / 0.61 / +8.3%
clickbench_q09/duckdb:vortex-file-compressed 106526048 / 106324934 / +0.2% 159105295 / 154748572 / +2.8% 0.67 / 0.69 / -2.6%
clickbench_q10/duckdb:vortex-file-compressed 34371426 / 33168054 / +3.6% 68114271 / 64133369 / +6.2% 0.50 / 0.52 / -2.4%
clickbench_q11/duckdb:vortex-file-compressed 35269759 / 34683908 / +1.7% 73802804 / 70279985 / +5.0% 0.48 / 0.49 / -3.2%
clickbench_q12/duckdb:vortex-file-compressed 76112202 / 76081651 / +0.0% 108467923 / 106305642 / +2.0% 0.70 / 0.72 / -2.0%
clickbench_q13/duckdb:vortex-file-compressed 135175090 / 132996688 / +1.6% 185735092 / 172864708 / +7.4% 0.73 / 0.77 / -5.4%
clickbench_q14/duckdb:vortex-file-compressed 80280136 / 77748053 / +3.3% 109625829 / 112420038 / -2.5% 0.73 / 0.69 / +5.9%
clickbench_q15/duckdb:vortex-file-compressed 90522342 / 92493362 / -2.1% 132578484 / 128273964 / +3.4% 0.68 / 0.72 / -5.3%
clickbench_q16/duckdb:vortex-file-compressed 159737033 / 162520464 / -1.7% 211912129 / 202988507 / +4.4% 0.75 / 0.80 / -5.9%
clickbench_q17/duckdb:vortex-file-compressed 169753440 / 162633436 / +4.4% 214133025 / 201984559 / +6.0% 0.79 / 0.81 / -1.5%
clickbench_q18/duckdb:vortex-file-compressed 323118542 / 319706382 / +1.1% 444394570 / 379076676 / +17.2% 🔴 0.73 / 0.84 / -13.8%
clickbench_q19/duckdb:vortex-file-compressed 17983990 / 17612447 / +2.1% 44349513 / 40130939 / +10.5% 🔴 0.41 / 0.44 / -7.6%
clickbench_q20/duckdb:vortex-file-compressed 114331781 / 112237720 / +1.9% 195277405 / 185925673 / +5.0% 0.59 / 0.60 / -3.0%
clickbench_q21/duckdb:vortex-file-compressed 156345144 / 158365380 / -1.3% 299308355 / 281827375 / +6.2% 0.52 / 0.56 / -7.0%
clickbench_q22/duckdb:vortex-file-compressed 241592787 / 240428644 / +0.5% 468301708 / 421782480 / +11.0% 🔴 0.52 / 0.57 / -9.5%
clickbench_q23/duckdb:vortex-file-compressed 59976307 / 58066942 / +3.3% 100338928 / 106205709 / -5.5% 0.60 / 0.55 / +9.3%
clickbench_q24/duckdb:vortex-file-compressed 25499140 / 26569836 / -4.0% 48448597 / 39903808 / +21.4% 🔴 0.53 / 0.67 / -21.0%
clickbench_q25/duckdb:vortex-file-compressed 33928700 / 32690141 / +3.8% 54048988 / 57489661 / -6.0% 0.63 / 0.57 / +10.4%
clickbench_q26/duckdb:vortex-file-compressed 21370492 / 18826536 / +13.5% 🔴 37154749 / 36936381 / +0.6% 0.58 / 0.51 / +12.8%
clickbench_q27/duckdb:vortex-file-compressed 146362465 / 143180352 / +2.2% 254641197 / 238260852 / +6.9% 0.57 / 0.60 / -4.4%
clickbench_q28/duckdb:vortex-file-compressed 606082069 / 654367072 / -7.4% 671634520 / 664313139 / +1.1% 0.90 / 0.99 / -8.4%
clickbench_q29/duckdb:vortex-file-compressed 17617164 / 17434372 / +1.0% 41433654 / 35568265 / +16.5% 🔴 0.43 / 0.49 / -13.3%
clickbench_q30/duckdb:vortex-file-compressed 65579147 / 66289354 / -1.1% 114748963 / 105312020 / +9.0% 0.57 / 0.63 / -9.2%
clickbench_q31/duckdb:vortex-file-compressed 124222734 / 123911683 / +0.3% 209049957 / 197483585 / +5.9% 0.59 / 0.63 / -5.3%
clickbench_q32/duckdb:vortex-file-compressed 454116984 / 459560869 / -1.2% 548782181 / 503785122 / +8.9% 0.83 / 0.91 / -9.3%
clickbench_q33/duckdb:vortex-file-compressed 396288939 / 389200827 / +1.8% 507082150 / 485150695 / +4.5% 0.78 / 0.80 / -2.6%
clickbench_q34/duckdb:vortex-file-compressed 428089194 / 412215208 / +3.9% 529659805 / 516092352 / +2.6% 0.81 / 0.80 / +1.2%
clickbench_q35/duckdb:vortex-file-compressed 101050297 / 101736794 / -0.7% 138888373 / 136823414 / +1.5% 0.73 / 0.74 / -2.2%
clickbench_q36/duckdb:vortex-file-compressed 15346925 / 16552292 / -7.3% 30170549 / 36719209 / -17.8% 🟢 0.51 / 0.45 / +12.8%
clickbench_q37/duckdb:vortex-file-compressed 12045590 / 11705145 / +2.9% 29178222 / 27885093 / +4.6% 0.41 / 0.42 / -1.7%
clickbench_q38/duckdb:vortex-file-compressed 14020889 / 13221890 / +6.0% 32658883 / 27683533 / +18.0% 🔴 0.43 / 0.48 / -10.1%
clickbench_q39/duckdb:vortex-file-compressed 23226678 / 22742530 / +2.1% 44155208 / 37666382 / +17.2% 🔴 0.53 / 0.60 / -12.9%
clickbench_q40/duckdb:vortex-file-compressed 10923346 / 10544168 / +3.6% 31157713 / 28211747 / +10.4% 🔴 0.35 / 0.37 / -6.2%
clickbench_q41/duckdb:vortex-file-compressed 10683863 / 11343786 / -5.8% 26338833 / 29639536 / -11.1% 🟢 0.41 / 0.38 / +6.0%
clickbench_q42/duckdb:vortex-file-compressed 11194670 / 13196036 / -15.2% 🟢 28843770 / 27840552 / +3.6% 0.39 / 0.47 / -18.1%
duckdb / parquet / ns (1.004x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 10933420 / 8539684 / +28.0% 🔴 18928399 / 18887524 / +0.2% 0.58 / 0.45 / +27.8%
clickbench_q01/duckdb:parquet 8795252 / 10155830 / -13.4% 🟢 19021752 / 19123701 / -0.5% 0.46 / 0.53 / -12.9%
clickbench_q02/duckdb:parquet 15370315 / 15040158 / +2.2% 32673086 / 31283224 / +4.4% 0.47 / 0.48 / -2.2%
clickbench_q03/duckdb:parquet 15992454 / 16729910 / -4.4% 54426717 / 51821076 / +5.0% 0.29 / 0.32 / -9.0%
clickbench_q04/duckdb:parquet 70115166 / 71098779 / -1.4% 95798048 / 93526619 / +2.4% 0.73 / 0.76 / -3.7%
clickbench_q05/duckdb:parquet 81725851 / 80638908 / +1.3% 118543825 / 113282962 / +4.6% 0.69 / 0.71 / -3.1%
clickbench_q06/duckdb:parquet 16049142 / 15150239 / +5.9% 24368860 / 24283568 / +0.4% 0.66 / 0.62 / +5.6%
clickbench_q07/duckdb:parquet 11975130 / 10311945 / +16.1% 🔴 23246385 / 22715521 / +2.3% 0.52 / 0.45 / +13.5%
clickbench_q08/duckdb:parquet 84366474 / 84266658 / +0.1% 133627222 / 123852998 / +7.9% 0.63 / 0.68 / -7.2%
clickbench_q09/duckdb:parquet 116030780 / 115484156 / +0.5% 163443122 / 162277219 / +0.7% 0.71 / 0.71 / -0.2%
clickbench_q10/duckdb:parquet 32708198 / 35747090 / -8.5% 69354763 / 69663389 / -0.4% 0.47 / 0.51 / -8.1%
clickbench_q11/duckdb:parquet 37183240 / 40539625 / -8.3% 78360952 / 77262837 / +1.4% 0.47 / 0.52 / -9.6%
clickbench_q12/duckdb:parquet 95461874 / 97795572 / -2.4% 145192105 / 131180917 / +10.7% 🔴 0.66 / 0.75 / -11.8%
clickbench_q13/duckdb:parquet 146595146 / 146730292 / -0.1% 217118409 / 208275927 / +4.2% 0.68 / 0.70 / -4.2%
clickbench_q14/duckdb:parquet 97629088 / 98307603 / -0.7% 151757682 / 137523266 / +10.4% 🔴 0.64 / 0.71 / -10.0%
clickbench_q15/duckdb:parquet 94353862 / 94578824 / -0.2% 127288092 / 120587274 / +5.6% 0.74 / 0.78 / -5.5%
clickbench_q16/duckdb:parquet 167003046 / 168853866 / -1.1% 230882886 / 230221972 / +0.3% 0.72 / 0.73 / -1.4%
clickbench_q17/duckdb:parquet 178984342 / 184088085 / -2.8% 236460719 / 219464991 / +7.7% 0.76 / 0.84 / -9.8%
clickbench_q18/duckdb:parquet 322638991 / 344829442 / -6.4% 408577653 / 409474012 / -0.2% 0.79 / 0.84 / -6.2%
clickbench_q19/duckdb:parquet 13353970 / 13332682 / +0.2% 46056722 / 42124422 / +9.3% 0.29 / 0.32 / -8.4%
clickbench_q20/duckdb:parquet 136872344 / 134484858 / +1.8% 240275412 / 240054709 / +0.1% 0.57 / 0.56 / +1.7%
clickbench_q21/duckdb:parquet 187551620 / 177631000 / +5.6% 323815630 / 326907024 / -0.9% 0.58 / 0.54 / +6.6%
clickbench_q22/duckdb:parquet 252268442 / 232308076 / +8.6% 414121360 / 402895344 / +2.8% 0.61 / 0.58 / +5.6%
clickbench_q23/duckdb:parquet 145554662 / 145618419 / -0.0% 173661755 / 165915055 / +4.7% 0.84 / 0.88 / -4.5%
clickbench_q24/duckdb:parquet 42508977 / 43898244 / -3.2% 58326089 / 65063240 / -10.4% 🟢 0.73 / 0.67 / +8.0%
clickbench_q25/duckdb:parquet 40639922 / 40385575 / +0.6% 91414131 / 87662482 / +4.3% 0.44 / 0.46 / -3.5%
clickbench_q26/duckdb:parquet 31872426 / 29690104 / +7.4% 47500024 / 44121666 / +7.7% 0.67 / 0.67 / -0.3%
clickbench_q27/duckdb:parquet 147490524 / 151033724 / -2.3% 260031688 / 256814077 / +1.3% 0.57 / 0.59 / -3.6%
clickbench_q28/duckdb:parquet 899331062 / 898326820 / +0.1% 987850999 / 981537215 / +0.6% 0.91 / 0.92 / -0.5%
clickbench_q29/duckdb:parquet 17277802 / 17752859 / -2.7% 32683163 / 29302921 / +11.5% 🔴 0.53 / 0.61 / -12.7%
clickbench_q30/duckdb:parquet 91372654 / 90160160 / +1.3% 172632763 / 173544012 / -0.5% 0.53 / 0.52 / +1.9%
clickbench_q31/duckdb:parquet 148156397 / 143341744 / +3.4% 269298754 / 291600860 / -7.6% 0.55 / 0.49 / +11.9%
clickbench_q32/duckdb:parquet 443768454 / 437563883 / +1.4% 492975938 / 516164262 / -4.5% 0.90 / 0.85 / +6.2%
clickbench_q33/duckdb:parquet 458132280 / 456874482 / +0.3% 487574401 / 473349073 / +3.0% 0.94 / 0.97 / -2.7%
clickbench_q34/duckdb:parquet 464714610 / 441795145 / +5.2% 503494656 / 472792996 / +6.5% 0.92 / 0.93 / -1.2%
clickbench_q35/duckdb:parquet 101432561 / 104626273 / -3.1% 118145678 / 118901593 / -0.6% 0.86 / 0.88 / -2.4%
clickbench_q36/duckdb:parquet 30653142 / 31434756 / -2.5% 40559633 / 40539397 / +0.0% 0.76 / 0.78 / -2.5%
clickbench_q37/duckdb:parquet 22827027 / 22730740 / +0.4% 31979639 / 31489114 / +1.6% 0.71 / 0.72 / -1.1%
clickbench_q38/duckdb:parquet 24172134 / 23647436 / +2.2% 33230151 / 33021494 / +0.6% 0.73 / 0.72 / +1.6%
clickbench_q39/duckdb:parquet 55868862 / 56680124 / -1.4% 66380979 / 67116704 / -1.1% 0.84 / 0.84 / -0.3%
clickbench_q40/duckdb:parquet 12694830 / 12574659 / +1.0% 22149894 / 22366387 / -1.0% 0.57 / 0.56 / +1.9%
clickbench_q41/duckdb:parquet 12832012 / 12968194 / -1.1% 22314511 / 22875825 / -2.5% 0.58 / 0.57 / +1.4%
clickbench_q42/duckdb:parquet 14273506 / 14364812 / -0.6% 24332916 / 25112056 / -3.1% 0.59 / 0.57 / +2.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 026bb264 vs base ae00d7a1
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.025x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.012x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 23659162 / 24243890 / -2.4% 44150121 / 43521228 / +1.4% 0.54 / 0.56 / -3.8%
tpcds_q02/datafusion:vortex-file-compressed 44569852 / 45219254 / -1.4% 63154525 / 61813117 / +2.2% 0.71 / 0.73 / -3.5%
tpcds_q03/datafusion:vortex-file-compressed 11546246 / 11520157 / +0.2% 28541585 / 28291241 / +0.9% 0.40 / 0.41 / -0.7%
tpcds_q04/datafusion:vortex-file-compressed 113372764 / 112351384 / +0.9% 141210419 / 144043971 / -2.0% 0.80 / 0.78 / +2.9%
tpcds_q05/datafusion:vortex-file-compressed 59340939 / 59423129 / -0.1% 80089074 / 80075400 / +0.0% 0.74 / 0.74 / -0.2%
tpcds_q06/datafusion:vortex-file-compressed 23770458 / 23632804 / +0.6% 44892837 / 43567428 / +3.0% 0.53 / 0.54 / -2.4%
tpcds_q07/datafusion:vortex-file-compressed 32938298 / 32341346 / +1.8% 55823158 / 53321468 / +4.7% 0.59 / 0.61 / -2.7%
tpcds_q08/datafusion:vortex-file-compressed 25243922 / 25334389 / -0.4% 43754872 / 42161707 / +3.8% 0.58 / 0.60 / -4.0%
tpcds_q09/datafusion:vortex-file-compressed 17531954 / 17182541 / +2.0% 34168214 / 35054759 / -2.5% 0.51 / 0.49 / +4.7%
tpcds_q10/datafusion:vortex-file-compressed 29193569 / 28539342 / +2.3% 49704335 / 48400724 / +2.7% 0.59 / 0.59 / -0.4%
tpcds_q11/datafusion:vortex-file-compressed 61864326 / 61401459 / +0.8% 88583544 / 85991862 / +3.0% 0.70 / 0.71 / -2.2%
tpcds_q12/datafusion:vortex-file-compressed 15795874 / 16511074 / -4.3% 32104049 / 30839166 / +4.1% 0.49 / 0.54 / -8.1%
tpcds_q13/datafusion:vortex-file-compressed 33969830 / 34409456 / -1.3% 52516275 / 52605823 / -0.2% 0.65 / 0.65 / -1.1%
tpcds_q14/datafusion:vortex-file-compressed 92183302 / 91054514 / +1.2% 116839788 / 118574777 / -1.5% 0.79 / 0.77 / +2.7%
tpcds_q15/datafusion:vortex-file-compressed 23582612 / 23948980 / -1.5% 43196307 / 44555551 / -3.1% 0.55 / 0.54 / +1.6%
tpcds_q16/datafusion:vortex-file-compressed 20331536 / 20264034 / +0.3% 41287090 / 41413872 / -0.3% 0.49 / 0.49 / +0.6%
tpcds_q17/datafusion:vortex-file-compressed 60673088 / 62303430 / -2.6% 83960422 / 74348735 / +12.9% 🔴 0.72 / 0.84 / -13.8%
tpcds_q18/datafusion:vortex-file-compressed 68454492 / 69276382 / -1.2% 90358762 / 89749749 / +0.7% 0.76 / 0.77 / -1.9%
tpcds_q19/datafusion:vortex-file-compressed 18413777 / 18151758 / +1.4% 39816399 / 40266148 / -1.1% 0.46 / 0.45 / +2.6%
tpcds_q20/datafusion:vortex-file-compressed 17452965 / 17566170 / -0.6% 33542569 / 33960765 / -1.2% 0.52 / 0.52 / +0.6%
tpcds_q21/datafusion:vortex-file-compressed 17010883 / 17565062 / -3.2% 40629486 / 40107835 / +1.3% 0.42 / 0.44 / -4.4%
tpcds_q22/datafusion:vortex-file-compressed 49253548 / 49450235 / -0.4% 69057310 / 69285935 / -0.3% 0.71 / 0.71 / -0.1%
tpcds_q23/datafusion:vortex-file-compressed 72026492 / 73202908 / -1.6% 98279871 / 96962012 / +1.4% 0.73 / 0.75 / -2.9%
tpcds_q24/datafusion:vortex-file-compressed 70191494 / 70079228 / +0.2% 95238115 / 94147937 / +1.2% 0.74 / 0.74 / -1.0%
tpcds_q25/datafusion:vortex-file-compressed 52658404 / 53331998 / -1.3% 84738989 / 72173550 / +17.4% 🔴 0.62 / 0.74 / -15.9%
tpcds_q26/datafusion:vortex-file-compressed 30382044 / 29814630 / +1.9% 51422807 / 49421431 / +4.0% 0.59 / 0.60 / -2.1%
tpcds_q27/datafusion:vortex-file-compressed 63222502 / 64323588 / -1.7% 88879415 / 83181790 / +6.8% 0.71 / 0.77 / -8.0%
tpcds_q28/datafusion:vortex-file-compressed 17638371 / 17878822 / -1.3% 36347268 / 37121997 / -2.1% 0.49 / 0.48 / +0.8%
tpcds_q29/datafusion:vortex-file-compressed 60904094 / 60328172 / +1.0% 82538016 / 73179899 / +12.8% 🔴 0.74 / 0.82 / -10.5%
tpcds_q30/datafusion:vortex-file-compressed 26859157 / 27606382 / -2.7% 45063980 / 46218905 / -2.5% 0.60 / 0.60 / -0.2%
tpcds_q31/datafusion:vortex-file-compressed 64154797 / 64351636 / -0.3% 91986842 / 91507249 / +0.5% 0.70 / 0.70 / -0.8%
tpcds_q32/datafusion:vortex-file-compressed 13312290 / 13794442 / -3.5% 30983383 / 30357959 / +2.1% 0.43 / 0.45 / -5.4%
tpcds_q33/datafusion:vortex-file-compressed 26772102 / 27151018 / -1.4% 48435725 / 47071385 / +2.9% 0.55 / 0.58 / -4.2%
tpcds_q34/datafusion:vortex-file-compressed 18485348 / 18508784 / -0.1% 36926075 / 37183008 / -0.7% 0.50 / 0.50 / +0.6%
tpcds_q35/datafusion:vortex-file-compressed 35075161 / 35879122 / -2.2% 58349266 / 56627444 / +3.0% 0.60 / 0.63 / -5.1%
tpcds_q36/datafusion:vortex-file-compressed 48628510 / 48305519 / +0.7% 72361850 / 70254383 / +3.0% 0.67 / 0.69 / -2.3%
tpcds_q37/datafusion:vortex-file-compressed 13579912 / 13349172 / +1.7% 34910242 / 34006110 / +2.7% 0.39 / 0.39 / -0.9%
tpcds_q38/datafusion:vortex-file-compressed 30036540 / 29827848 / +0.7% 51082881 / 49399798 / +3.4% 0.59 / 0.60 / -2.6%
tpcds_q39/datafusion:vortex-file-compressed 64599482 / 65046270 / -0.7% 90817003 / 87039049 / +4.3% 0.71 / 0.75 / -4.8%
tpcds_q40/datafusion:vortex-file-compressed 24832316 / 25355705 / -2.1% 44601329 / 43805841 / +1.8% 0.56 / 0.58 / -3.8%
tpcds_q41/datafusion:vortex-file-compressed 16697020 / 16367580 / +2.0% 30811930 / 30421406 / +1.3% 0.54 / 0.54 / +0.7%
tpcds_q42/datafusion:vortex-file-compressed 11325762 / 11418660 / -0.8% 28200627 / 27332484 / +3.2% 0.40 / 0.42 / -3.9%
tpcds_q43/datafusion:vortex-file-compressed 13452314 / 13407674 / +0.3% 32554111 / 31274958 / +4.1% 0.41 / 0.43 / -3.6%
tpcds_q44/datafusion:vortex-file-compressed 25877672 / 26314100 / -1.7% 50482513 / 46474714 / +8.6% 0.51 / 0.57 / -9.5%
tpcds_q45/datafusion:vortex-file-compressed 27588834 / 27566498 / +0.1% 47872253 / 47688910 / +0.4% 0.58 / 0.58 / -0.3%
tpcds_q46/datafusion:vortex-file-compressed 24198560 / 24501104 / -1.2% 46156695 / 47247902 / -2.3% 0.52 / 0.52 / +1.1%
tpcds_q47/datafusion:vortex-file-compressed 78103224 / 77577994 / +0.7% 104067583 / 103596366 / +0.5% 0.75 / 0.75 / +0.2%
tpcds_q48/datafusion:vortex-file-compressed 31363636 / 31375216 / -0.0% 50269230 / 50127294 / +0.3% 0.62 / 0.63 / -0.3%
tpcds_q49/datafusion:vortex-file-compressed 64991116 / 60299180 / +7.8% 81999225 / 79453323 / +3.2% 0.79 / 0.76 / +4.4%
tpcds_q50/datafusion:vortex-file-compressed 34560882 / 34917554 / -1.0% 54515219 / 54439918 / +0.1% 0.63 / 0.64 / -1.2%
tpcds_q51/datafusion:vortex-file-compressed 61193956 / 60903454 / +0.5% 84123179 / 81864857 / +2.8% 0.73 / 0.74 / -2.2%
tpcds_q52/datafusion:vortex-file-compressed 11767276 / 11755858 / +0.1% 28801434 / 28134936 / +2.4% 0.41 / 0.42 / -2.2%
tpcds_q53/datafusion:vortex-file-compressed 18451078 / 18330038 / +0.7% 38964841 / 36222443 / +7.6% 0.47 / 0.51 / -6.4%
tpcds_q54/datafusion:vortex-file-compressed 34196513 / 33786931 / +1.2% 55796432 / 57996470 / -3.8% 0.61 / 0.58 / +5.2%
tpcds_q55/datafusion:vortex-file-compressed 11110050 / 11314695 / -1.8% 28306947 / 26946152 / +5.1% 0.39 / 0.42 / -6.5%
tpcds_q56/datafusion:vortex-file-compressed 26728807 / 27160916 / -1.6% 47364296 / 47684318 / -0.7% 0.56 / 0.57 / -0.9%
tpcds_q57/datafusion:vortex-file-compressed 73401292 / 73513313 / -0.2% 96053188 / 96235635 / -0.2% 0.76 / 0.76 / +0.0%
tpcds_q58/datafusion:vortex-file-compressed 40633750 / 40910934 / -0.7% 65115542 / 64004454 / +1.7% 0.62 / 0.64 / -2.4%
tpcds_q59/datafusion:vortex-file-compressed 32092938 / 32211572 / -0.4% 52814108 / 52805532 / +0.0% 0.61 / 0.61 / -0.4%
tpcds_q60/datafusion:vortex-file-compressed 26124444 / 26653728 / -2.0% 47056190 / 46972790 / +0.2% 0.56 / 0.57 / -2.2%
tpcds_q61/datafusion:vortex-file-compressed 23675140 / 24939452 / -5.1% 47367401 / 44328692 / +6.9% 0.50 / 0.56 / -11.2%
tpcds_q62/datafusion:vortex-file-compressed 17158793 / 17179704 / -0.1% 35385970 / 34959595 / +1.2% 0.48 / 0.49 / -1.3%
tpcds_q63/datafusion:vortex-file-compressed 18147632 / 18748719 / -3.2% 37273568 / 37409865 / -0.4% 0.49 / 0.50 / -2.9%
tpcds_q64/datafusion:vortex-file-compressed 320844778 / 323814164 / -0.9% 362980552 / 352336374 / +3.0% 0.88 / 0.92 / -3.8%
tpcds_q65/datafusion:vortex-file-compressed 75362670 / 75522031 / -0.2% 95000441 / 93861932 / +1.2% 0.79 / 0.80 / -1.4%
tpcds_q66/datafusion:vortex-file-compressed 52597862 / 53474688 / -1.6% 76388387 / 73874641 / +3.4% 0.69 / 0.72 / -4.9%
tpcds_q67/datafusion:vortex-file-compressed 55302267 / 55579550 / -0.5% 83056904 / 82644083 / +0.5% 0.67 / 0.67 / -1.0%
tpcds_q68/datafusion:vortex-file-compressed 23920492 / 24111842 / -0.8% 46949897 / 46154823 / +1.7% 0.51 / 0.52 / -2.5%
tpcds_q69/datafusion:vortex-file-compressed 27654202 / 29329598 / -5.7% 49505027 / 47035024 / +5.3% 0.56 / 0.62 / -10.4%
tpcds_q70/datafusion:vortex-file-compressed 70780106 / 70672708 / +0.2% 91964101 / 91394659 / +0.6% 0.77 / 0.77 / -0.5%
tpcds_q71/datafusion:vortex-file-compressed 19556654 / 19781642 / -1.1% 37613502 / 39975504 / -5.9% 0.52 / 0.49 / +5.1%
tpcds_q72/datafusion:vortex-file-compressed 464496201 / 450761166 / +3.0% 493409525 / 476485702 / +3.6% 0.94 / 0.95 / -0.5%
tpcds_q73/datafusion:vortex-file-compressed 17343170 / 17572034 / -1.3% 36437393 / 35301191 / +3.2% 0.48 / 0.50 / -4.4%
tpcds_q74/datafusion:vortex-file-compressed 45764613 / 45080975 / +1.5% 69242620 / 68150010 / +1.6% 0.66 / 0.66 / -0.1%
tpcds_q75/datafusion:vortex-file-compressed 132927470 / 132033928 / +0.7% 161581546 / 160658875 / +0.6% 0.82 / 0.82 / +0.1%
tpcds_q76/datafusion:vortex-file-compressed 42672710 / 43528109 / -2.0% 63278458 / 63437987 / -0.3% 0.67 / 0.69 / -1.7%
tpcds_q77/datafusion:vortex-file-compressed 34782674 / 34932740 / -0.4% 58189652 / 56893404 / +2.3% 0.60 / 0.61 / -2.6%
tpcds_q78/datafusion:vortex-file-compressed 79477134 / 80174630 / -0.9% 108387498 / 106060293 / +2.2% 0.73 / 0.76 / -3.0%
tpcds_q79/datafusion:vortex-file-compressed 20977762 / 20695130 / +1.4% 43661225 / 40485714 / +7.8% 0.48 / 0.51 / -6.0%
tpcds_q80/datafusion:vortex-file-compressed 77500282 / 76553933 / +1.2% 108465471 / 106379747 / +2.0% 0.71 / 0.72 / -0.7%
tpcds_q81/datafusion:vortex-file-compressed 28162796 / 27959062 / +0.7% 45418775 / 43928930 / +3.4% 0.62 / 0.64 / -2.6%
tpcds_q82/datafusion:vortex-file-compressed 14447554 / 12798561 / +12.9% 🔴 34422137 / 35176629 / -2.1% 0.42 / 0.36 / +15.4%
tpcds_q83/datafusion:vortex-file-compressed 35906806 / 36076259 / -0.5% 56856368 / 55843056 / +1.8% 0.63 / 0.65 / -2.2%
tpcds_q84/datafusion:vortex-file-compressed 11725914 / 11837791 / -0.9% 28014123 / 27202919 / +3.0% 0.42 / 0.44 / -3.8%
tpcds_q85/datafusion:vortex-file-compressed 5967298 / 59448875 / +0.4% 83333084 / 82483564 / +1.0% 0.72 / 0.72 / -0.6%
tpcds_q86/datafusion:vortex-file-compressed 16327968 / 16024304 / +1.9% 32725603 / 32025126 / +2.2% 0.50 / 0.50 / -0.3%
tpcds_q87/datafusion:vortex-file-compressed 29766042 / 29175804 / +2.0% 51940272 / 49035864 / +5.9% 0.57 / 0.59 / -3.7%
tpcds_q88/datafusion:vortex-file-compressed 33910786 / 33997496 / -0.3% 59560895 / 64774613 / -8.0% 0.57 / 0.52 / +8.5%
tpcds_q89/datafusion:vortex-file-compressed 21376812 / 21495974 / -0.6% 41560423 / 40558575 / +2.5% 0.51 / 0.53 / -3.0%
tpcds_q90/datafusion:vortex-file-compressed 10448184 / 10347367 / +1.0% 27130104 / 25717899 / +5.5% 0.39 / 0.40 / -4.3%
tpcds_q91/datafusion:vortex-file-compressed 16813539 / 16381792 / +2.6% 35770524 / 35319609 / +1.3% 0.47 / 0.46 / +1.3%
tpcds_q92/datafusion:vortex-file-compressed 13814624 / 13510932 / +2.2% 31852925 / 30852414 / +3.2% 0.43 / 0.44 / -1.0%
tpcds_q93/datafusion:vortex-file-compressed 23806492 / 23326507 / +2.1% 43542781 / 42224506 / +3.1% 0.55 / 0.55 / -1.0%
tpcds_q94/datafusion:vortex-file-compressed 19780266 / 19743488 / +0.2% 39523934 / 38231281 / +3.4% 0.50 / 0.52 / -3.1%
tpcds_q95/datafusion:vortex-file-compressed 45904303 / 45454528 / +1.0% 67666956 / 66928374 / +1.1% 0.68 / 0.68 / -0.1%
tpcds_q96/datafusion:vortex-file-compressed 9567632 / 9339024 / +2.4% 25383986 / 25011055 / +1.5% 0.38 / 0.37 / +0.9%
tpcds_q97/datafusion:vortex-file-compressed 20848332 / 21064019 / -1.0% 42424418 / 41605710 / +2.0% 0.49 / 0.51 / -2.9%
tpcds_q98/datafusion:vortex-file-compressed 17001674 / 16966226 / +0.2% 35723998 / 35538176 / +0.5% 0.48 / 0.48 / -0.3%
tpcds_q99/datafusion:vortex-file-compressed 19190512 / 19627744 / -2.2% 37828635 / 38131658 / -0.8% 0.51 / 0.51 / -1.4%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 29321728 / 28465630 / +3.0% 45309238 / 46324242 / -2.2% 0.65 / 0.61 / +5.3%
tpcds_q02/datafusion:parquet 44768880 / 45988084 / -2.7% 62404593 / 61690189 / +1.2% 0.72 / 0.75 / -3.8%
tpcds_q03/datafusion:parquet 18714394 / 18948506 / -1.2% 32709347 / 30964575 / +5.6% 0.57 / 0.61 / -6.5%
tpcds_q04/datafusion:parquet 193861835 / 196037022 / -1.1% 223748825 / 217569031 / +2.8% 0.87 / 0.90 / -3.8%
tpcds_q05/datafusion:parquet 72712764 / 71093384 / +2.3% 93898637 / 95782512 / -2.0% 0.77 / 0.74 / +4.3%
tpcds_q06/datafusion:parquet 34929974 / 34677140 / +0.7% 52627530 / 50705351 / +3.8% 0.66 / 0.68 / -2.9%
tpcds_q07/datafusion:parquet 46090777 / 46246460 / -0.3% 66124812 / 67454134 / -2.0% 0.70 / 0.69 / +1.7%
tpcds_q08/datafusion:parquet 39093140 / 38728565 / +0.9% 52969372 / 56107516 / -5.6% 0.74 / 0.69 / +6.9%
tpcds_q09/datafusion:parquet 31474390 / 30136875 / +4.4% 38637742 / 37549744 / +2.9% 0.81 / 0.80 / +1.5%
tpcds_q10/datafusion:parquet 50689506 / 50174302 / +1.0% 68233275 / 67992094 / +0.4% 0.74 / 0.74 / +0.7%
tpcds_q11/datafusion:parquet 93404926 / 92062351 / +1.5% 117544998 / 114523967 / +2.6% 0.79 / 0.80 / -1.1%
tpcds_q12/datafusion:parquet 24329576 / 24117136 / +0.9% 38598724 / 35647386 / +8.3% 0.63 / 0.68 / -6.8%
tpcds_q13/datafusion:parquet 44581094 / 44790431 / -0.5% 67262168 / 65020186 / +3.4% 0.66 / 0.69 / -3.8%
tpcds_q14/datafusion:parquet 139615896 / 139827982 / -0.2% 153706213 / 158897642 / -3.3% 0.91 / 0.88 / +3.2%
tpcds_q15/datafusion:parquet 30404158 / 31403102 / -3.2% 47943060 / 47861619 / +0.2% 0.63 / 0.66 / -3.3%
tpcds_q16/datafusion:parquet 36564004 / 37885854 / -3.5% 54483574 / 55551284 / -1.9% 0.67 / 0.68 / -1.6%
tpcds_q17/datafusion:parquet 73759722 / 74818442 / -1.4% 101052499 / 98571672 / +2.5% 0.73 / 0.76 / -3.8%
tpcds_q18/datafusion:parquet 57994627 / 57892953 / +0.2% 80247180 / 78570596 / +2.1% 0.72 / 0.74 / -1.9%
tpcds_q19/datafusion:parquet 31914220 / 31830272 / +0.3% 50580072 / 50236786 / +0.7% 0.63 / 0.63 / -0.4%
tpcds_q20/datafusion:parquet 25126835 / 25269450 / -0.6% 38986924 / 37746595 / +3.3% 0.64 / 0.67 / -3.7%
tpcds_q21/datafusion:parquet 20392388 / 20455725 / -0.3% 34200879 / 32585805 / +5.0% 0.60 / 0.63 / -5.0%
tpcds_q22/datafusion:parquet 77230502 / 77348016 / -0.2% 92463784 / 90991395 / +1.6% 0.84 / 0.85 / -1.7%
tpcds_q23/datafusion:parquet 116050016 / 115194068 / +0.7% 145444654 / 131905961 / +10.3% 🔴 0.80 / 0.87 / -8.6%
tpcds_q24/datafusion:parquet 91564337 / 89254174 / +2.6% 118208177 / 119416668 / -1.0% 0.77 / 0.75 / +3.6%
tpcds_q25/datafusion:parquet 75524740 / 75659415 / -0.2% 100176966 / 98563929 / +1.6% 0.75 / 0.77 / -1.8%
tpcds_q26/datafusion:parquet 43145015 / 42921992 / +0.5% 57243371 / 58610100 / -2.3% 0.75 / 0.73 / +2.9%
tpcds_q27/datafusion:parquet 76583910 / 76970417 / -0.5% 102496137 / 100675452 / +1.8% 0.75 / 0.76 / -2.3%
tpcds_q28/datafusion:parquet 27380014 / 26554598 / +3.1% 43717116 / 44096466 / -0.9% 0.63 / 0.60 / +4.0%
tpcds_q29/datafusion:parquet 76520606 / 75138132 / +1.8% 103540282 / 100591255 / +2.9% 0.74 / 0.75 / -1.1%
tpcds_q30/datafusion:parquet 45939868 / 46881039 / -2.0% 63878562 / 63724192 / +0.2% 0.72 / 0.74 / -2.2%
tpcds_q31/datafusion:parquet 89047510 / 90695988 / -1.8% 112284553 / 107886211 / +4.1% 0.79 / 0.84 / -5.7%
tpcds_q32/datafusion:parquet 25760362 / 25732420 / +0.1% 42723034 / 41043577 / +4.1% 0.60 / 0.63 / -3.8%
tpcds_q33/datafusion:parquet 39764332 / 40685678 / -2.3% 57615083 / 54956660 / +4.8% 0.69 / 0.74 / -6.8%
tpcds_q34/datafusion:parquet 23688746 / 23609532 / +0.3% 38447417 / 38058698 / +1.0% 0.62 / 0.62 / -0.7%
tpcds_q35/datafusion:parquet 52639844 / 55302171 / -4.8% 67795151 / 70460369 / -3.8% 0.78 / 0.78 / -1.1%
tpcds_q36/datafusion:parquet 50370100 / 51883228 / -2.9% 71542824 / 70329407 / +1.7% 0.70 / 0.74 / -4.6%
tpcds_q37/datafusion:parquet 25817076 / 25358310 / +1.8% 37532133 / 40771341 / -7.9% 0.69 / 0.62 / +10.6%
tpcds_q38/datafusion:parquet 43441448 / 44774065 / -3.0% 62928653 / 61430082 / +2.4% 0.69 / 0.73 / -5.3%
tpcds_q39/datafusion:parquet 71694684 / 71908021 / -0.3% 91471153 / 88620524 / +3.2% 0.78 / 0.81 / -3.4%
tpcds_q40/datafusion:parquet 28330464 / 29615394 / -4.3% 49932620 / 48761601 / +2.4% 0.57 / 0.61 / -6.6%
tpcds_q41/datafusion:parquet 19948990 / 19789242 / +0.8% 33272844 / 32872886 / +1.2% 0.60 / 0.60 / -0.4%
tpcds_q42/datafusion:parquet 18063630 / 18250438 / -1.0% 33152897 / 32229528 / +2.9% 0.54 / 0.57 / -3.8%
tpcds_q43/datafusion:parquet 19401698 / 19389690 / +0.1% 34302498 / 33230588 / +3.2% 0.57 / 0.58 / -3.1%
tpcds_q44/datafusion:parquet 32408358 / 35319182 / -8.2% 50425418 / 52308215 / -3.6% 0.64 / 0.68 / -4.8%
tpcds_q45/datafusion:parquet 38042064 / 38320500 / -0.7% 54380282 / 52570101 / +3.4% 0.70 / 0.73 / -4.0%
tpcds_q46/datafusion:parquet 30421732 / 30317859 / +0.3% 50805872 / 48586058 / +4.6% 0.60 / 0.62 / -4.0%
tpcds_q47/datafusion:parquet 98450194 / 98532963 / -0.1% 123833256 / 123653790 / +0.1% 0.80 / 0.80 / -0.2%
tpcds_q48/datafusion:parquet 41653921 / 41438588 / +0.5% 62140389 / 60447367 / +2.8% 0.67 / 0.69 / -2.2%
tpcds_q49/datafusion:parquet 72039968 / 73139505 / -1.5% 100379085 / 99805790 / +0.6% 0.72 / 0.73 / -2.1%
tpcds_q50/datafusion:parquet 48751548 / 49223607 / -1.0% 70486436 / 67868087 / +3.9% 0.69 / 0.73 / -4.6%
tpcds_q51/datafusion:parquet 71461872 / 71777903 / -0.4% 93286784 / 92117247 / +1.3% 0.77 / 0.78 / -1.7%
tpcds_q52/datafusion:parquet 18723342 / 18490512 / +1.3% 35608182 / 30367623 / +17.3% 🔴 0.53 / 0.61 / -13.6%
tpcds_q53/datafusion:parquet 21679236 / 22043814 / -1.7% 41458948 / 41664566 / -0.5% 0.52 / 0.53 / -1.2%
tpcds_q54/datafusion:parquet 55157374 / 55981668 / -1.5% 70791896 / 73908891 / -4.2% 0.78 / 0.76 / +2.9%
tpcds_q55/datafusion:parquet 18146796 / 17875040 / +1.5% 33219908 / 30245702 / +9.8% 0.55 / 0.59 / -7.6%
tpcds_q56/datafusion:parquet 45714730 / 44909142 / +1.8% 62419035 / 61736755 / +1.1% 0.73 / 0.73 / +0.7%
tpcds_q57/datafusion:parquet 100257122 / 100697224 / -0.4% 118342738 / 123107699 / -3.9% 0.85 / 0.82 / +3.6%
tpcds_q58/datafusion:parquet 64016310 / 62728793 / +2.1% 82346354 / 82597299 / -0.3% 0.78 / 0.76 / +2.4%
tpcds_q59/datafusion:parquet 48493862 / 46966379 / +3.3% 62367480 / 62177804 / +0.3% 0.78 / 0.76 / +2.9%
tpcds_q60/datafusion:parquet 46535128 / 46768170 / -0.5% 63698462 / 58921170 / +8.1% 0.73 / 0.79 / -8.0%
tpcds_q61/datafusion:parquet 38486383 / 36749576 / +4.7% 60203645 / 58168983 / +3.5% 0.64 / 0.63 / +1.2%
tpcds_q62/datafusion:parquet 25228882 / 24912310 / +1.3% 39524644 / 38591647 / +2.4% 0.64 / 0.65 / -1.1%
tpcds_q63/datafusion:parquet 22123050 / 22222265 / -0.4% 39588478 / 39719634 / -0.3% 0.56 / 0.56 / -0.1%
tpcds_q64/datafusion:parquet 202276652 / 202317483 / -0.0% 233923865 / 232635338 / +0.6% 0.86 / 0.87 / -0.6%
tpcds_q65/datafusion:parquet 38202613 / 36565708 / +4.5% 58371353 / 56480657 / +3.3% 0.65 / 0.65 / +1.1%
tpcds_q66/datafusion:parquet 62657865 / 62366541 / +0.5% 79392884 / 78085438 / +1.7% 0.79 / 0.80 / -1.2%
tpcds_q67/datafusion:parquet 69351759 / 69197512 / +0.2% 95463187 / 94178644 / +1.4% 0.73 / 0.73 / -1.1%
tpcds_q68/datafusion:parquet 29079743 / 28969056 / +0.4% 51364994 / 49336409 / +4.1% 0.57 / 0.59 / -3.6%
tpcds_q69/datafusion:parquet 51280236 / 50424119 / +1.7% 66859821 / 61448455 / +8.8% 0.77 / 0.82 / -6.5%
tpcds_q70/datafusion:parquet 36845096 / 36345651 / +1.4% 56478905 / 52608842 / +7.4% 0.65 / 0.69 / -5.6%
tpcds_q71/datafusion:parquet 28059312 / 28879921 / -2.8% 44158133 / 42151493 / +4.8% 0.64 / 0.69 / -7.3%
tpcds_q72/datafusion:parquet 557117520 / 550049790 / +1.3% 578337735 / 592666677 / -2.4% 0.96 / 0.93 / +3.8%
tpcds_q73/datafusion:parquet 22802052 / 22894721 / -0.4% 38079445 / 38441711 / -0.9% 0.60 / 0.60 / +0.5%
tpcds_q74/datafusion:parquet 68663444 / 67865948 / +1.2% 87309280 / 87231096 / +0.1% 0.79 / 0.78 / +1.1%
tpcds_q75/datafusion:parquet 146518024 / 147161592 / -0.4% 172120080 / 171083309 / +0.6% 0.85 / 0.86 / -1.0%
tpcds_q76/datafusion:parquet 53726038 / 54812893 / -2.0% 70692203 / 70792955 / -0.1% 0.76 / 0.77 / -1.8%
tpcds_q77/datafusion:parquet 54470555 / 55403434 / -1.7% 74879565 / 74684490 / +0.3% 0.73 / 0.74 / -1.9%
tpcds_q78/datafusion:parquet 90257814 / 90886224 / -0.7% 120465599 / 118011083 / +2.1% 0.75 / 0.77 / -2.7%
tpcds_q79/datafusion:parquet 25372322 / 26133084 / -2.9% 44593353 / 44059952 / +1.2% 0.57 / 0.59 / -4.1%
tpcds_q80/datafusion:parquet 79980773 / 79870974 / +0.1% 111015265 / 109398520 / +1.5% 0.72 / 0.73 / -1.3%
tpcds_q81/datafusion:parquet 42130956 / 40670376 / +3.6% 59414849 / 58409306 / +1.7% 0.71 / 0.70 / +1.8%
tpcds_q82/datafusion:parquet 26259842 / 26097606 / +0.6% 42074945 / 41814574 / +0.6% 0.62 / 0.62 / -0.0%
tpcds_q83/datafusion:parquet 58114788 / 58116912 / -0.0% 77497805 / 76024704 / +1.9% 0.75 / 0.76 / -1.9%
tpcds_q84/datafusion:parquet 30310178 / 30962148 / -2.1% 44730719 / 44090479 / +1.5% 0.68 / 0.70 / -3.5%
tpcds_q85/datafusion:parquet 82906990 / 83787172 / -1.1% 104502902 / 106252884 / -1.6% 0.79 / 0.79 / +0.6%
tpcds_q86/datafusion:parquet 20191675 / 20354970 / -0.8% 34496714 / 34130277 / +1.1% 0.59 / 0.60 / -1.9%
tpcds_q87/datafusion:parquet 46176016 / 46479064 / -0.7% 64375485 / 61507334 / +4.7% 0.72 / 0.76 / -5.1%
tpcds_q88/datafusion:parquet 47043984 / 46920021 / +0.3% 70501682 / 62901573 / +12.1% 🔴 0.67 / 0.75 / -10.5%
tpcds_q89/datafusion:parquet 25760768 / 25826226 / -0.3% 44110815 / 42891737 / +2.8% 0.58 / 0.60 / -3.0%
tpcds_q90/datafusion:parquet 19213716 / 19853910 / -3.2% 31409885 / 32674176 / -3.9% 0.61 / 0.61 / +0.7%
tpcds_q91/datafusion:parquet 36946696 / 36340252 / +1.7% 53401682 / 52965536 / +0.8% 0.69 / 0.69 / +0.8%
tpcds_q92/datafusion:parquet 26194405 / 25747924 / +1.7% 37717007 / 42020872 / -10.2% 🟢 0.69 / 0.61 / +13.3%
tpcds_q93/datafusion:parquet 27046343 / 26468582 / +2.2% 47272093 / 47507138 / -0.5% 0.57 / 0.56 / +2.7%
tpcds_q94/datafusion:parquet 34818569 / 34330750 / +1.4% 49944360 / 50661685 / -1.4% 0.70 / 0.68 / +2.9%
tpcds_q95/datafusion:parquet 64236302 / 63740254 / +0.8% 81179736 / 79093714 / +2.6% 0.79 / 0.81 / -1.8%
tpcds_q96/datafusion:parquet 16741794 / 16722066 / +0.1% 30141215 / 29336229 / +2.7% 0.56 / 0.57 / -2.6%
tpcds_q97/datafusion:parquet 35387602 / 35300094 / +0.2% 52888858 / 53052498 / -0.3% 0.67 / 0.67 / +0.6%
tpcds_q98/datafusion:parquet 24867701 / 25135246 / -1.1% 40895703 / 41271670 / -0.9% 0.61 / 0.61 / -0.2%
tpcds_q99/datafusion:parquet 29512116 / 29469439 / +0.1% 43157842 / 43642264 / -1.1% 0.68 / 0.68 / +1.3%
duckdb / vortex-file-compressed / ns (1.007x ➖, 2↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15119748 / 15140710 / -0.1% 22777401 / 22564899 / +0.9% 0.66 / 0.67 / -1.1%
tpcds_q02/duckdb:vortex-file-compressed 14971706 / 14850722 / +0.8% 20863598 / 19302738 / +8.1% 0.72 / 0.77 / -6.7%
tpcds_q03/duckdb:vortex-file-compressed 11294504 / 11631395 / -2.9% 21265034 / 18787498 / +13.2% 🔴 0.53 / 0.62 / -14.2%
tpcds_q04/duckdb:vortex-file-compressed 50017568 / 50514060 / -1.0% 59063850 / 60243420 / -2.0% 0.85 / 0.84 / +1.0%
tpcds_q05/duckdb:vortex-file-compressed 18575508 / 18849230 / -1.5% 25446847 / 23536564 / +8.1% 0.73 / 0.80 / -8.9%
tpcds_q06/duckdb:vortex-file-compressed 30140925 / 26721128 / +12.8% 🔴 39137918 / 40575142 / -3.5% 0.77 / 0.66 / +16.9%
tpcds_q07/duckdb:vortex-file-compressed 16099744 / 15810546 / +1.8% 29977300 / 26189075 / +14.5% 🔴 0.54 / 0.60 / -11.0%
tpcds_q08/duckdb:vortex-file-compressed 19061520 / 18816816 / +1.3% 28021983 / 26268810 / +6.7% 0.68 / 0.72 / -5.0%
tpcds_q09/duckdb:vortex-file-compressed 14122398 / 13401554 / +5.4% 22252680 / 21174377 / +5.1% 0.63 / 0.63 / +0.3%
tpcds_q10/duckdb:vortex-file-compressed 27514858 / 27424584 / +0.3% 46603826 / 41263531 / +12.9% 🔴 0.59 / 0.66 / -11.2%
tpcds_q11/duckdb:vortex-file-compressed 39983984 / 40308766 / -0.8% 52514751 / 55293093 / -5.0% 0.76 / 0.73 / +4.4%
tpcds_q12/duckdb:vortex-file-compressed 10403978 / 10159898 / +2.4% 16684349 / 15810719 / +5.5% 0.62 / 0.64 / -3.0%
tpcds_q13/duckdb:vortex-file-compressed 21547747 / 20821544 / +3.5% 36614591 / 33113977 / +10.6% 🔴 0.59 / 0.63 / -6.4%
tpcds_q14/duckdb:vortex-file-compressed 57975189 / 57073890 / +1.6% 74673764 / 71134864 / +5.0% 0.78 / 0.80 / -3.2%
tpcds_q15/duckdb:vortex-file-compressed 21059182 / 20701044 / +1.7% 25259872 / 26867884 / -6.0% 0.83 / 0.77 / +8.2%
tpcds_q16/duckdb:vortex-file-compressed 17558482 / 17387894 / +1.0% 28719449 / 24984845 / +14.9% 🔴 0.61 / 0.70 / -12.2%
tpcds_q17/duckdb:vortex-file-compressed 30123119 / 29821482 / +1.0% 46063907 / 44704524 / +3.0% 0.65 / 0.67 / -2.0%
tpcds_q18/duckdb:vortex-file-compressed 28448974 / 27917054 / +1.9% 38186630 / 37241579 / +2.5% 0.74 / 0.75 / -0.6%
tpcds_q19/duckdb:vortex-file-compressed 23786960 / 23875912 / -0.4% 38740299 / 35632025 / +8.7% 0.61 / 0.67 / -8.4%
tpcds_q20/duckdb:vortex-file-compressed 10594410 / 10494690 / +1.0% 15463724 / 15433853 / +0.2% 0.69 / 0.68 / +0.8%
tpcds_q21/duckdb:vortex-file-compressed 9798734 / 9762750 / +0.4% 19005650 / 20045954 / -5.2% 0.52 / 0.49 / +5.9%
tpcds_q22/duckdb:vortex-file-compressed 29013258 / 29115466 / -0.4% 39219765 / 38564766 / +1.7% 0.74 / 0.75 / -2.0%
tpcds_q23/duckdb:vortex-file-compressed 35955798 / 36123846 / -0.5% 50095419 / 48680455 / +2.9% 0.72 / 0.74 / -3.3%
tpcds_q24/duckdb:vortex-file-compressed 28225861 / 28136586 / +0.3% 38854717 / 38016065 / +2.2% 0.73 / 0.74 / -1.8%
tpcds_q25/duckdb:vortex-file-compressed 25255896 / 25594659 / -1.3% 41098926 / 37197500 / +10.5% 🔴 0.61 / 0.69 / -10.7%
tpcds_q26/duckdb:vortex-file-compressed 13249934 / 13344602 / -0.7% 20674928 / 19575068 / +5.6% 0.64 / 0.68 / -6.0%
tpcds_q27/duckdb:vortex-file-compressed 17741804 / 17478484 / +1.5% 32187464 / 31595251 / +1.9% 0.55 / 0.55 / -0.4%
tpcds_q28/duckdb:vortex-file-compressed 12319220 / 11674550 / +5.5% 22074074 / 16876578 / +30.8% 🔴 0.56 / 0.69 / -19.3%
tpcds_q29/duckdb:vortex-file-compressed 28354284 / 28421816 / -0.2% 43804700 / 43477866 / +0.8% 0.65 / 0.65 / -1.0%
tpcds_q30/duckdb:vortex-file-compressed 19377222 / 19167716 / +1.1% 27709831 / 26656132 / +4.0% 0.70 / 0.72 / -2.8%
tpcds_q31/duckdb:vortex-file-compressed 19481048 / 19316843 / +0.9% 25802161 / 29750069 / -13.3% 🟢 0.76 / 0.65 / +16.3%
tpcds_q32/duckdb:vortex-file-compressed 9862016 / 9860167 / +0.0% 16043628 / 16665538 / -3.7% 0.61 / 0.59 / +3.9%
tpcds_q33/duckdb:vortex-file-compressed 16667096 / 16878136 / -1.3% 30045116 / 27063351 / +11.0% 🔴 0.55 / 0.62 / -11.1%
tpcds_q34/duckdb:vortex-file-compressed 15591067 / 15478394 / +0.7% 22732094 / 21831435 / +4.1% 0.69 / 0.71 / -3.3%
tpcds_q35/duckdb:vortex-file-compressed 46256368 / 45539336 / +1.6% 58408706 / 58229372 / +0.3% 0.79 / 0.78 / +1.3%
tpcds_q36/duckdb:vortex-file-compressed 14960498 / 16059340 / -6.8% 29886036 / 27066167 / +10.4% 🔴 0.50 / 0.59 / -15.6%
tpcds_q37/duckdb:vortex-file-compressed 13809276 / 14622342 / -5.6% 21992108 / 22985342 / -4.3% 0.63 / 0.64 / -1.3%
tpcds_q38/duckdb:vortex-file-compressed 22407781 / 22218412 / +0.9% 28123625 / 29018047 / -3.1% 0.80 / 0.77 / +4.1%
tpcds_q39/duckdb:vortex-file-compressed 18238370 / 18393348 / -0.8% 26811313 / 25852491 / +3.7% 0.68 / 0.71 / -4.4%
tpcds_q40/duckdb:vortex-file-compressed 13279396 / 13328862 / -0.4% 19346966 / 18512542 / +4.5% 0.69 / 0.72 / -4.7%
tpcds_q41/duckdb:vortex-file-compressed 6574540 / 6571748 / +0.0% 9294549 / 11330594 / -18.0% 🟢 0.71 / 0.58 / +22.0%
tpcds_q42/duckdb:vortex-file-compressed 8124967 / 8003495 / +1.5% 19565647 / 16254408 / +20.4% 🔴 0.42 / 0.49 / -15.7%
tpcds_q43/duckdb:vortex-file-compressed 10072607 / 11417661 / -11.8% 🟢 20903213 / 17590672 / +18.8% 🔴 0.48 / 0.65 / -25.8%
tpcds_q44/duckdb:vortex-file-compressed 15885183 / 14453470 / +9.9% 28083322 / 24312360 / +15.5% 🔴 0.57 / 0.59 / -4.9%
tpcds_q45/duckdb:vortex-file-compressed 22363181 / 22612992 / -1.1% 29101167 / 28295517 / +2.8% 0.77 / 0.80 / -3.8%
tpcds_q46/duckdb:vortex-file-compressed 18950968 / 18365856 / +3.2% 31040343 / 27168064 / +14.3% 🔴 0.61 / 0.68 / -9.7%
tpcds_q47/duckdb:vortex-file-compressed 31057076 / 30288776 / +2.5% 41963297 / 41633871 / +0.8% 0.74 / 0.73 / +1.7%
tpcds_q48/duckdb:vortex-file-compressed 19995019 / 19737276 / +1.3% 32144324 / 29921043 / +7.4% 0.62 / 0.66 / -5.7%
tpcds_q49/duckdb:vortex-file-compressed 16551458 / 16871975 / -1.9% 32174232 / 28161312 / +14.2% 🔴 0.51 / 0.60 / -14.1%
tpcds_q50/duckdb:vortex-file-compressed 16405160 / 16553078 / -0.9% 28023189 / 25504881 / +9.9% 0.59 / 0.65 / -9.8%
tpcds_q51/duckdb:vortex-file-compressed 77671373 / 52227922 / +48.7% 🔴 72150651 / 85633439 / -15.7% 🟢 1.08 / 0.61 / +76.5%
tpcds_q52/duckdb:vortex-file-compressed 9694520 / 8434429 / +14.9% 🔴 17728911 / 16581186 / +6.9% 0.55 / 0.51 / +7.5%
tpcds_q53/duckdb:vortex-file-compressed 14605060 / 15913464 / -8.2% 25125734 / 24717027 / +1.7% 0.58 / 0.64 / -9.7%
tpcds_q54/duckdb:vortex-file-compressed 20193174 / 20047578 / +0.7% 29522343 / 31989563 / -7.7% 0.68 / 0.63 / +9.1%
tpcds_q55/duckdb:vortex-file-compressed 8279714 / 8254954 / +0.3% 17238016 / 18812231 / -8.4% 0.48 / 0.44 / +9.5%
tpcds_q56/duckdb:vortex-file-compressed 17198688 / 16976280 / +1.3% 28716321 / 28732243 / -0.1% 0.60 / 0.59 / +1.4%
tpcds_q57/duckdb:vortex-file-compressed 24165578 / 24148925 / +0.1% 30974972 / 31067128 / -0.3% 0.78 / 0.78 / +0.4%
tpcds_q58/duckdb:vortex-file-compressed 17692690 / 17492586 / +1.1% 27702754 / 26042276 / +6.4% 0.64 / 0.67 / -4.9%
tpcds_q59/duckdb:vortex-file-compressed 18719931 / 18673104 / +0.3% 24965801 / 24042788 / +3.8% 0.75 / 0.78 / -3.5%
tpcds_q60/duckdb:vortex-file-compressed 17783287 / 17776984 / +0.0% 28966279 / 28113636 / +3.0% 0.61 / 0.63 / -2.9%
tpcds_q61/duckdb:vortex-file-compressed 19612200 / 19159256 / +2.4% 32096668 / 29229004 / +9.8% 0.61 / 0.66 / -6.8%
tpcds_q62/duckdb:vortex-file-compressed 12888836 / 10171990 / +26.7% 🔴 18052577 / 17477031 / +3.3% 0.71 / 0.58 / +22.7%
tpcds_q63/duckdb:vortex-file-compressed 13848755 / 13402300 / +3.3% 27815076 / 21965787 / +26.6% 🔴 0.50 / 0.61 / -18.4%
tpcds_q64/duckdb:vortex-file-compressed 63229622 / 64245528 / -1.6% 79828020 / 81689285 / -2.3% 0.79 / 0.79 / +0.7%
tpcds_q65/duckdb:vortex-file-compressed 15757401 / 16307391 / -3.4% 25197645 / 26046849 / -3.3% 0.63 / 0.63 / -0.1%
tpcds_q66/duckdb:vortex-file-compressed 21199333 / 21039150 / +0.8% 27444759 / 28663521 / -4.3% 0.77 / 0.73 / +5.2%
tpcds_q67/duckdb:vortex-file-compressed 65830610 / 64767684 / +1.6% 80372417 / 81338025 / -1.2% 0.82 / 0.80 / +2.9%
tpcds_q68/duckdb:vortex-file-compressed 18126411 / 18093918 / +0.2% 29435265 / 32265664 / -8.8% 0.62 / 0.56 / +9.8%
tpcds_q69/duckdb:vortex-file-compressed 29281705 / 28804808 / +1.7% 46543888 / 40846486 / +13.9% 🔴 0.63 / 0.71 / -10.8%
tpcds_q70/duckdb:vortex-file-compressed 18497416 / 20047340 / -7.7% 29386383 / 26609296 / +10.4% 🔴 0.63 / 0.75 / -16.5%
tpcds_q71/duckdb:vortex-file-compressed 12514408 / 12687524 / -1.4% 22331876 / 24597429 / -9.2% 0.56 / 0.52 / +8.6%
tpcds_q72/duckdb:vortex-file-compressed 62844237 / 61487807 / +2.2% 77661615 / 74246736 / +4.6% 0.81 / 0.83 / -2.3%
tpcds_q73/duckdb:vortex-file-compressed 14882498 / 14677718 / +1.4% 23252317 / 19891224 / +16.9% 🔴 0.64 / 0.74 / -13.3%
tpcds_q74/duckdb:vortex-file-compressed 27343261 / 27426878 / -0.3% 35968036 / 35376903 / +1.7% 0.76 / 0.78 / -1.9%
tpcds_q75/duckdb:vortex-file-compressed 29146300 / 28219168 / +3.3% 40725271 / 40606094 / +0.3% 0.72 / 0.69 / +3.0%
tpcds_q76/duckdb:vortex-file-compressed 12314767 / 12175390 / +1.1% 23611026 / 21836459 / +8.1% 0.52 / 0.56 / -6.5%
tpcds_q77/duckdb:vortex-file-compressed 15797312 / 16036738 / -1.5% 25953781 / 23430347 / +10.8% 🔴 0.61 / 0.68 / -11.1%
tpcds_q78/duckdb:vortex-file-compressed 37083510 / 37588848 / -1.3% 46415917 / 49475043 / -6.2% 0.80 / 0.76 / +5.2%
tpcds_q79/duckdb:vortex-file-compressed 14652812 / 14169218 / +3.4% 24610463 / 21887396 / +12.4% 🔴 0.60 / 0.65 / -8.0%
tpcds_q80/duckdb:vortex-file-compressed 27674936 / 27161510 / +1.9% 42273017 / 42621748 / -0.8% 0.65 / 0.64 / +2.7%
tpcds_q81/duckdb:vortex-file-compressed 22460069 / 22112465 / +1.6% 30176342 / 28829895 / +4.7% 0.74 / 0.77 / -3.0%
tpcds_q82/duckdb:vortex-file-compressed 31999798 / 32606780 / -1.9% 40509572 / 40840855 / -0.8% 0.79 / 0.80 / -1.1%
tpcds_q83/duckdb:vortex-file-compressed 20114926 / 20006901 / +0.5% 24588277 / 25300336 / -2.8% 0.82 / 0.79 / +3.5%
tpcds_q84/duckdb:vortex-file-compressed 12728852 / 12597100 / +1.0% 22315922 / 18601169 / +20.0% 🔴 0.57 / 0.68 / -15.8%
tpcds_q85/duckdb:vortex-file-compressed 31554495 / 31120282 / +1.4% 40515443 / 42539543 / -4.8% 0.78 / 0.73 / +6.5%
tpcds_q86/duckdb:vortex-file-compressed 10764062 / 11292573 / -4.7% 17658358 / 19734848 / -10.5% 🟢 0.61 / 0.57 / +6.5%
tpcds_q87/duckdb:vortex-file-compressed 24152084 / 24012388 / +0.6% 29962195 / 29856465 / +0.4% 0.81 / 0.80 / +0.2%
tpcds_q88/duckdb:vortex-file-compressed 32270885 / 32423826 / -0.5% 46883282 / 43371554 / +8.1% 0.69 / 0.75 / -7.9%
tpcds_q89/duckdb:vortex-file-compressed 13911300 / 13987863 / -0.5% 23867819 / 22262744 / +7.2% 0.58 / 0.63 / -7.2%
tpcds_q90/duckdb:vortex-file-compressed 8388102 / 8148497 / +2.9% 12711110 / 12672698 / +0.3% 0.66 / 0.64 / +2.6%
tpcds_q91/duckdb:vortex-file-compressed 15233743 / 15264421 / -0.2% 25093842 / 20791559 / +20.7% 🔴 0.61 / 0.73 / -17.3%
tpcds_q92/duckdb:vortex-file-compressed 13173005 / 13774822 / -4.4% 20608719 / 21244320 / -3.0% 0.64 / 0.65 / -1.4%
tpcds_q93/duckdb:vortex-file-compressed 16934732 / 17547407 / -3.5% 22613351 / 24343463 / -7.1% 0.75 / 0.72 / +3.9%
tpcds_q94/duckdb:vortex-file-compressed 16539428 / 16152606 / +2.4% 25850787 / 30222784 / -14.5% 🟢 0.64 / 0.53 / +19.7%
tpcds_q95/duckdb:vortex-file-compressed 44959840 / 44264168 / +1.6% 53636152 / 65301448 / -17.9% 🟢 0.84 / 0.68 / +23.7%
tpcds_q96/duckdb:vortex-file-compressed 7192134 / 10050482 / -28.4% 🟢 14489031 / 13468328 / +7.6% 0.50 / 0.75 / -33.5%
tpcds_q97/duckdb:vortex-file-compressed 22250284 / 22136306 / +0.5% 28374796 / 28132990 / +0.9% 0.78 / 0.79 / -0.3%
tpcds_q98/duckdb:vortex-file-compressed 13444393 / 13172090 / +2.1% 23069405 / 21577923 / +6.9% 0.58 / 0.61 / -4.5%
tpcds_q99/duckdb:vortex-file-compressed 13320881 / 13358120 / -0.3% 19889918 / 21244206 / -6.4% 0.67 / 0.63 / +6.5%
duckdb / parquet / ns (1.007x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23144682 / 25180708 / -8.1% 31952946 / 31880915 / +0.2% 0.72 / 0.79 / -8.3%
tpcds_q02/duckdb:parquet 15430022 / 15428582 / +0.0% 20440954 / 20254096 / +0.9% 0.75 / 0.76 / -0.9%
tpcds_q03/duckdb:parquet 8880362 / 8724956 / +1.8% 15389370 / 15301776 / +0.6% 0.58 / 0.57 / +1.2%
tpcds_q04/duckdb:parquet 128820350 / 128001400 / +0.6% 132376228 / 132619229 / -0.2% 0.97 / 0.97 / +0.8%
tpcds_q05/duckdb:parquet 22521899 / 21772409 / +3.4% 25481670 / 25116101 / +1.5% 0.88 / 0.87 / +2.0%
tpcds_q06/duckdb:parquet 26458812 / 26642828 / -0.7% 37581031 / 37747560 / -0.4% 0.70 / 0.71 / -0.3%
tpcds_q07/duckdb:parquet 15242149 / 15138892 / +0.7% 23371100 / 22398208 / +4.3% 0.65 / 0.68 / -3.5%
tpcds_q08/duckdb:parquet 25670368 / 25648866 / +0.1% 33879373 / 33870252 / +0.0% 0.76 / 0.76 / +0.1%
tpcds_q09/duckdb:parquet 19314027 / 18361174 / +5.2% 22740817 / 22381985 / +1.6% 0.85 / 0.82 / +3.5%
tpcds_q10/duckdb:parquet 27918648 / 27586281 / +1.2% 38286773 / 37939129 / +0.9% 0.73 / 0.73 / +0.3%
tpcds_q11/duckdb:parquet 71346396 / 72247686 / -1.2% 76553650 / 76566803 / -0.0% 0.93 / 0.94 / -1.2%
tpcds_q12/duckdb:parquet 12732886 / 12567703 / +1.3% 17869478 / 17255200 / +3.6% 0.71 / 0.73 / -2.2%
tpcds_q13/duckdb:parquet 23943178 / 23801470 / +0.6% 35170144 / 31917120 / +10.2% 🔴 0.68 / 0.75 / -8.7%
tpcds_q14/duckdb:parquet 60644638 / 61197248 / -0.9% 67784511 / 67618956 / +0.2% 0.89 / 0.91 / -1.1%
tpcds_q15/duckdb:parquet 24962102 / 24962160 / -0.0% 30630074 / 30944201 / -1.0% 0.81 / 0.81 / +1.0%
tpcds_q16/duckdb:parquet 20053824 / 19835163 / +1.1% 28751654 / 29315844 / -1.9% 0.70 / 0.68 / +3.1%
tpcds_q17/duckdb:parquet 32541676 / 32259356 / +0.9% 41411767 / 40698379 / +1.8% 0.79 / 0.79 / -0.9%
tpcds_q18/duckdb:parquet 39125070 / 39195994 / -0.2% 50045030 / 50644656 / -1.2% 0.78 / 0.77 / +1.0%
tpcds_q19/duckdb:parquet 24568416 / 24304628 / +1.1% 32068101 / 31852615 / +0.7% 0.77 / 0.76 / +0.4%
tpcds_q20/duckdb:parquet 13885842 / 13512944 / +2.8% 18254607 / 18083131 / +0.9% 0.76 / 0.75 / +1.8%
tpcds_q21/duckdb:parquet 9450328 / 9378395 / +0.8% 12275833 / 13394996 / -8.4% 0.77 / 0.70 / +10.0%
tpcds_q22/duckdb:parquet 35132742 / 36218493 / -3.0% 39275517 / 39491075 / -0.5% 0.89 / 0.92 / -2.5%
tpcds_q23/duckdb:parquet 40856594 / 40667814 / +0.5% 47747033 / 46171554 / +3.4% 0.86 / 0.88 / -2.9%
tpcds_q24/duckdb:parquet 33374216 / 33094578 / +0.8% 44445772 / 43439834 / +2.3% 0.75 / 0.76 / -1.4%
tpcds_q25/duckdb:parquet 30099646 / 30015422 / +0.3% 40417596 / 39734826 / +1.7% 0.74 / 0.76 / -1.4%
tpcds_q26/duckdb:parquet 31119948 / 31147020 / -0.1% 38358479 / 39440970 / -2.7% 0.81 / 0.79 / +2.7%
tpcds_q27/duckdb:parquet 31855918 / 31619170 / +0.7% 41242429 / 40985340 / +0.6% 0.77 / 0.77 / +0.1%
tpcds_q28/duckdb:parquet 17130598 / 16925446 / +1.2% 20046675 / 22334721 / -10.2% 🟢 0.85 / 0.76 / +12.8%
tpcds_q29/duckdb:parquet 30794691 / 30961044 / -0.5% 39821447 / 39067108 / +1.9% 0.77 / 0.79 / -2.4%
tpcds_q30/duckdb:parquet 32854116 / 32842392 / +0.0% 42035175 / 41192949 / +2.0% 0.78 / 0.80 / -2.0%
tpcds_q31/duckdb:parquet 20617562 / 20258574 / +1.8% 26023833 / 24225710 / +7.4% 0.79 / 0.84 / -5.3%
tpcds_q32/duckdb:parquet 11373292 / 11044500 / +3.0% 17434887 / 17563085 / -0.7% 0.65 / 0.63 / +3.7%
tpcds_q33/duckdb:parquet 16238994 / 15929118 / +1.9% 23056322 / 22939977 / +0.5% 0.70 / 0.69 / +1.4%
tpcds_q34/duckdb:parquet 16076952 / 15972014 / +0.7% 22516938 / 22061065 / +2.1% 0.71 / 0.72 / -1.4%
tpcds_q35/duckdb:parquet 47200373 / 46848592 / +0.8% 61273436 / 60806667 / +0.8% 0.77 / 0.77 / -0.0%
tpcds_q36/duckdb:parquet 17225580 / 15260314 / +12.9% 🔴 24848173 / 22826522 / +8.9% 0.69 / 0.67 / +3.7%
tpcds_q37/duckdb:parquet 13355558 / 12672732 / +5.4% 18030472 / 18274338 / -1.3% 0.74 / 0.69 / +6.8%
tpcds_q38/duckdb:parquet 26574396 / 26158085 / +1.6% 30100110 / 33077213 / -9.0% 0.88 / 0.79 / +11.6%
tpcds_q39/duckdb:parquet 24541331 / 24727166 / -0.8% 30928036 / 30080697 / +2.8% 0.79 / 0.82 / -3.5%
tpcds_q40/duckdb:parquet 15986614 / 15978916 / +0.0% 21480046 / 21537627 / -0.3% 0.74 / 0.74 / +0.3%
tpcds_q41/duckdb:parquet 7961454 / 7844570 / +1.5% 12957344 / 13388751 / -3.2% 0.61 / 0.59 / +4.9%
tpcds_q42/duckdb:parquet 8402702 / 8326978 / +0.9% 14631501 / 14997921 / -2.4% 0.57 / 0.56 / +3.4%
tpcds_q43/duckdb:parquet 10620809 / 10652516 / -0.3% 15538938 / 16146239 / -3.8% 0.68 / 0.66 / +3.6%
tpcds_q44/duckdb:parquet 16353991 / 16323406 / +0.2% 22466537 / 22636450 / -0.8% 0.73 / 0.72 / +0.9%
tpcds_q45/duckdb:parquet 24860270 / 23147618 / +7.4% 29599601 / 28791771 / +2.8% 0.84 / 0.80 / +4.5%
tpcds_q46/duckdb:parquet 36375420 / 35679511 / +2.0% 45632854 / 44632952 / +2.2% 0.80 / 0.80 / -0.3%
tpcds_q47/duckdb:parquet 31465216 / 30919060 / +1.8% 38044332 / 37353143 / +1.9% 0.83 / 0.83 / -0.1%
tpcds_q48/duckdb:parquet 21110808 / 20984524 / +0.6% 29392508 / 29016732 / +1.3% 0.72 / 0.72 / -0.7%
tpcds_q49/duckdb:parquet 18898772 / 18669396 / +1.2% 29482918 / 29389900 / +0.3% 0.64 / 0.64 / +0.9%
tpcds_q50/duckdb:parquet 17643321 / 17493952 / +0.9% 26326069 / 25225736 / +4.4% 0.67 / 0.69 / -3.4%
tpcds_q51/duckdb:parquet 54030580 / 52910602 / +2.1% 64063499 / 61975154 / +3.4% 0.84 / 0.85 / -1.2%
tpcds_q52/duckdb:parquet 8569470 / 8529918 / +0.5% 15111474 / 15106433 / +0.0% 0.57 / 0.56 / +0.4%
tpcds_q53/duckdb:parquet 11501233 / 11444564 / +0.5% 17095860 / 16934524 / +1.0% 0.67 / 0.68 / -0.5%
tpcds_q54/duckdb:parquet 20655340 / 20298672 / +1.8% 29649788 / 29496913 / +0.5% 0.70 / 0.69 / +1.2%
tpcds_q55/duckdb:parquet 8560737 / 8547502 / +0.2% 15079338 / 15281433 / -1.3% 0.57 / 0.56 / +1.5%
tpcds_q56/duckdb:parquet 16242014 / 16235072 / +0.0% 23704109 / 23165843 / +2.3% 0.69 / 0.70 / -2.2%
tpcds_q57/duckdb:parquet 29214324 / 29260706 / -0.2% 34014217 / 34146390 / -0.4% 0.86 / 0.86 / +0.2%
tpcds_q58/duckdb:parquet 18354838 / 19812288 / -7.4% 26263210 / 26181702 / +0.3% 0.70 / 0.76 / -7.6%
tpcds_q59/duckdb:parquet 20081448 / 19951595 / +0.7% 25668428 / 24974076 / +2.8% 0.78 / 0.80 / -2.1%
tpcds_q60/duckdb:parquet 16689473 / 17439184 / -4.3% 24794468 / 27149278 / -8.7% 0.67 / 0.64 / +4.8%
tpcds_q61/duckdb:parquet 21704112 / 21526718 / +0.8% 28945490 / 28432081 / +1.8% 0.75 / 0.76 / -1.0%
tpcds_q62/duckdb:parquet 10819309 / 10771345 / +0.4% 14639059 / 18147426 / -19.3% 🟢 0.74 / 0.59 / +24.5%
tpcds_q63/duckdb:parquet 11006054 / 10903864 / +0.9% 17248334 / 16670239 / +3.5% 0.64 / 0.65 / -2.4%
tpcds_q64/duckdb:parquet 52884308 / 54514737 / -3.0% 71337828 / 64955515 / +9.8% 0.74 / 0.84 / -11.7%
tpcds_q65/duckdb:parquet 14608425 / 17230892 / -15.2% 🟢 21722658 / 20438916 / +6.3% 0.67 / 0.84 / -20.2%
tpcds_q66/duckdb:parquet 24927403 / 24742704 / +0.7% 32376163 / 30803982 / +5.1% 0.77 / 0.80 / -4.1%
tpcds_q67/duckdb:parquet 77392174 / 77417900 / -0.0% 84587368 / 88958853 / -4.9% 0.91 / 0.87 / +5.1%
tpcds_q68/duckdb:parquet 29653236 / 29113246 / +1.9% 39822418 / 40038323 / -0.5% 0.74 / 0.73 / +2.4%
tpcds_q69/duckdb:parquet 29089250 / 28969314 / +0.4% 38930575 / 39322958 / -1.0% 0.75 / 0.74 / +1.4%
tpcds_q70/duckdb:parquet 16897944 / 16018310 / +5.5% 25985236 / 22846665 / +13.7% 🔴 0.65 / 0.70 / -7.3%
tpcds_q71/duckdb:parquet 14716546 / 14660749 / +0.4% 21128190 / 20480977 / +3.2% 0.70 / 0.72 / -2.7%
tpcds_q72/duckdb:parquet 82219670 / 82004527 / +0.3% 89349787 / 86460093 / +3.3% 0.92 / 0.95 / -3.0%
tpcds_q73/duckdb:parquet 13444275 / 13426268 / +0.1% 20033001 / 19263128 / +4.0% 0.67 / 0.70 / -3.7%
tpcds_q74/duckdb:parquet 98998222 / 98760976 / +0.2% 109964299 / 106333369 / +3.4% 0.90 / 0.93 / -3.1%
tpcds_q75/duckdb:parquet 40176128 / 40116738 / +0.1% 52106749 / 49827352 / +4.6% 0.77 / 0.81 / -4.2%
tpcds_q76/duckdb:parquet 13366103 / 13497534 / -1.0% 20522049 / 20400833 / +0.6% 0.65 / 0.66 / -1.6%
tpcds_q77/duckdb:parquet 16889714 / 17051528 / -0.9% 25183406 / 24319205 / +3.6% 0.67 / 0.70 / -4.3%
tpcds_q78/duckdb:parquet 48913959 / 48449896 / +1.0% 53700427 / 53534668 / +0.3% 0.91 / 0.91 / +0.6%
tpcds_q79/duckdb:parquet 20588766 / 20321404 / +1.3% 28884355 / 29031350 / -0.5% 0.71 / 0.70 / +1.8%
tpcds_q80/duckdb:parquet 31428084 / 31170310 / +0.8% 40157557 / 38741723 / +3.7% 0.78 / 0.80 / -2.7%
tpcds_q81/duckdb:parquet 29666521 / 29873291 / -0.7% 39878684 / 39646504 / +0.6% 0.74 / 0.75 / -1.3%
tpcds_q82/duckdb:parquet 13634705 / 12622029 / +8.0% 19280220 / 18414210 / +4.7% 0.71 / 0.69 / +3.2%
tpcds_q83/duckdb:parquet 15919578 / 15892908 / +0.2% 23619741 / 20955404 / +12.7% 🔴 0.67 / 0.76 / -11.1%
tpcds_q84/duckdb:parquet 17598344 / 17431586 / +1.0% 23601740 / 24019474 / -1.7% 0.75 / 0.73 / +2.7%
tpcds_q85/duckdb:parquet 34805208 / 34428474 / +1.1% 45666101 / 45709763 / -0.1% 0.76 / 0.75 / +1.2%
tpcds_q86/duckdb:parquet 11130827 / 10944777 / +1.7% 15802461 / 15551775 / +1.6% 0.70 / 0.70 / +0.1%
tpcds_q87/duckdb:parquet 28312900 / 28567326 / -0.9% 32103471 / 33287771 / -3.6% 0.88 / 0.86 / +2.8%
tpcds_q88/duckdb:parquet 28491620 / 26692420 / +6.7% 38010606 / 33072114 / +14.9% 🔴 0.75 / 0.81 / -7.1%
tpcds_q89/duckdb:parquet 12802737 / 12548344 / +2.0% 18958161 / 18941061 / +0.1% 0.68 / 0.66 / +1.9%
tpcds_q90/duckdb:parquet 7019366 / 7010436 / +0.1% 12065802 / 11379980 / +6.0% 0.58 / 0.62 / -5.6%
tpcds_q91/duckdb:parquet 21000614 / 20405002 / +2.9% 29093618 / 29993142 / -3.0% 0.72 / 0.68 / +6.1%
tpcds_q92/duckdb:parquet 11429186 / 11501935 / -0.6% 18375788 / 17674528 / +4.0% 0.62 / 0.65 / -4.4%
tpcds_q93/duckdb:parquet 21323254 / 21185250 / +0.7% 29299360 / 28334078 / +3.4% 0.73 / 0.75 / -2.7%
tpcds_q94/duckdb:parquet 16166449 / 15602610 / +3.6% 25158815 / 24956871 / +0.8% 0.64 / 0.63 / +2.8%
tpcds_q95/duckdb:parquet 89812332 / 90205549 / -0.4% 97382415 / 101193005 / -3.8% 0.92 / 0.89 / +3.5%
tpcds_q96/duckdb:parquet 6948008 / 6991612 / -0.6% 10869975 / 10952279 / -0.8% 0.64 / 0.64 / +0.1%
tpcds_q97/duckdb:parquet 25977041 / 26030074 / -0.2% 32700860 / 31969261 / +2.3% 0.79 / 0.81 / -2.4%
tpcds_q98/duckdb:parquet 15420655 / 14761432 / +4.5% 22094044 / 21788871 / +1.4% 0.70 / 0.68 / +3.0%
tpcds_q99/duckdb:parquet 17212371 / 17152109 / +0.4% 21223113 / 21328412 / -0.5% 0.81 / 0.80 / +0.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 026bb264 vs base ae00d7a1
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.994x ➖
Parquet (geomean): hot 0.995x ➖ · cold 0.991x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 95896697 / 95147169 / +0.8% 173950029 / 170078400 / +2.3% 0.55 / 0.56 / -1.5%
tpch_q02/datafusion:vortex-file-compressed 65015182 / 64347400 / +1.0% 95319891 / 102157729 / -6.7% 0.68 / 0.63 / +8.3%
tpch_q03/datafusion:vortex-file-compressed 64296141 / 64764092 / -0.7% 117523956 / 120269178 / -2.3% 0.55 / 0.54 / +1.6%
tpch_q04/datafusion:vortex-file-compressed 34842863 / 35024494 / -0.5% 78809934 / 82078260 / -4.0% 0.44 / 0.43 / +3.6%
tpch_q05/datafusion:vortex-file-compressed 118035222 / 115508301 / +2.2% 185191130 / 178106343 / +4.0% 0.64 / 0.65 / -1.7%
tpch_q06/datafusion:vortex-file-compressed 14418765 / 15049206 / -4.2% 71905026 / 69092265 / +4.1% 0.20 / 0.22 / -7.9%
tpch_q07/datafusion:vortex-file-compressed 138680315 / 141394351 / -1.9% 202481367 / 197290406 / +2.6% 0.68 / 0.72 / -4.4%
tpch_q08/datafusion:vortex-file-compressed 147158824 / 147398882 / -0.2% 200649390 / 213290703 / -5.9% 0.73 / 0.69 / +6.1%
tpch_q09/datafusion:vortex-file-compressed 193479834 / 184796272 / +4.7% 258155301 / 265969654 / -2.9% 0.75 / 0.69 / +7.9%
tpch_q10/datafusion:vortex-file-compressed 73332579 / 73524635 / -0.3% 144097068 / 139932760 / +3.0% 0.51 / 0.53 / -3.1%
tpch_q11/datafusion:vortex-file-compressed 42668052 / 43093189 / -1.0% 65361794 / 69926420 / -6.5% 0.65 / 0.62 / +5.9%
tpch_q12/datafusion:vortex-file-compressed 45708414 / 43588087 / +4.9% 93534243 / 98638457 / -5.2% 0.49 / 0.44 / +10.6%
tpch_q13/datafusion:vortex-file-compressed 46998930 / 46717632 / +0.6% 79893833 / 77562841 / +3.0% 0.59 / 0.60 / -2.3%
tpch_q14/datafusion:vortex-file-compressed 25350212 / 25282691 / +0.3% 96209871 / 101834995 / -5.5% 0.26 / 0.25 / +6.1%
tpch_q15/datafusion:vortex-file-compressed 37085500 / 37501207 / -1.1% 103227350 / 103935936 / -0.7% 0.36 / 0.36 / -0.4%
tpch_q16/datafusion:vortex-file-compressed 37231406 / 37281273 / -0.1% 68411183 / 66672995 / +2.6% 0.54 / 0.56 / -2.7%
tpch_q17/datafusion:vortex-file-compressed 174762194 / 175782844 / -0.6% 221505074 / 232797296 / -4.9% 0.79 / 0.76 / +4.5%
tpch_q18/datafusion:vortex-file-compressed 201232763 / 201744213 / -0.3% 263523881 / 267927537 / -1.6% 0.76 / 0.75 / +1.4%
tpch_q19/datafusion:vortex-file-compressed 34267923 / 35033900 / -2.2% 96818557 / 96234169 / +0.6% 0.35 / 0.36 / -2.8%
tpch_q20/datafusion:vortex-file-compressed 62832575 / 63809057 / -1.5% 127233650 / 124289198 / +2.4% 0.49 / 0.51 / -3.8%
tpch_q21/datafusion:vortex-file-compressed 182780832 / 184423993 / -0.9% 243294866 / 244289343 / -0.4% 0.75 / 0.75 / -0.5%
tpch_q22/datafusion:vortex-file-compressed 25787510 / 25598259 / +0.7% 56813463 / 54080615 / +5.1% 0.45 / 0.47 / -4.1%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 82924642 / 82559123 / +0.4% 132691005 / 130900312 / +1.4% 0.62 / 0.63 / -0.9%
tpch_q02/datafusion:parquet 136139415 / 136786080 / -0.5% 168708300 / 167846097 / +0.5% 0.81 / 0.81 / -1.0%
tpch_q03/datafusion:parquet 124596193 / 124427040 / +0.1% 197403525 / 196267853 / +0.6% 0.63 / 0.63 / -0.4%
tpch_q04/datafusion:parquet 53745482 / 54203849 / -0.8% 105478356 / 107426025 / -1.8% 0.51 / 0.50 / +1.0%
tpch_q05/datafusion:parquet 165780042 / 166747936 / -0.6% 245265571 / 244582118 / +0.3% 0.68 / 0.68 / -0.9%
tpch_q06/datafusion:parquet 32292287 / 32590314 / -0.9% 83979095 / 84239337 / -0.3% 0.38 / 0.39 / -0.6%
tpch_q07/datafusion:parquet 219226917 / 217716944 / +0.7% 287278420 / 301807007 / -4.8% 0.76 / 0.72 / +5.8%
tpch_q08/datafusion:parquet 211881490 / 211568081 / +0.1% 294540446 / 299111227 / -1.5% 0.72 / 0.71 / +1.7%
tpch_q09/datafusion:parquet 287276065 / 283053379 / +1.5% 371739654 / 371326824 / +0.1% 0.77 / 0.76 / +1.4%
tpch_q10/datafusion:parquet 302786516 / 305738335 / -1.0% 393787979 / 387252146 / +1.7% 0.77 / 0.79 / -2.6%
tpch_q11/datafusion:parquet 97142632 / 96785559 / +0.4% 123949913 / 123288244 / +0.5% 0.78 / 0.79 / -0.2%
tpch_q12/datafusion:parquet 79480643 / 79362115 / +0.1% 134601182 / 135481703 / -0.6% 0.59 / 0.59 / +0.8%
tpch_q13/datafusion:parquet 195333827 / 195212464 / +0.1% 233479259 / 231413233 / +0.9% 0.84 / 0.84 / -0.8%
tpch_q14/datafusion:parquet 74842911 / 76340529 / -2.0% 192612862 / 191460448 / +0.6% 0.39 / 0.40 / -2.5%
tpch_q15/datafusion:parquet 78536527 / 79056759 / -0.7% 144626437 / 147695868 / -2.1% 0.54 / 0.54 / +1.5%
tpch_q16/datafusion:parquet 84210791 / 84259606 / -0.1% 116425972 / 113533194 / +2.5% 0.72 / 0.74 / -2.5%
tpch_q17/datafusion:parquet 206916536 / 210908509 / -1.9% 270125272 / 274052218 / -1.4% 0.77 / 0.77 / -0.5%
tpch_q18/datafusion:parquet 267107194 / 265967559 / +0.4% 313435562 / 320191959 / -2.1% 0.85 / 0.83 / +2.6%
tpch_q19/datafusion:parquet 97750330 / 99185032 / -1.4% 170204967 / 168918166 / +0.8% 0.57 / 0.59 / -2.2%
tpch_q20/datafusion:parquet 154710891 / 153800993 / +0.6% 216927761 / 219235981 / -1.1% 0.71 / 0.70 / +1.7%
tpch_q21/datafusion:parquet 232720224 / 234592382 / -0.8% 314634359 / 315061741 / -0.1% 0.74 / 0.74 / -0.7%
tpch_q22/datafusion:parquet 161591384 / 162357423 / -0.5% 185795409 / 186913168 / -0.6% 0.87 / 0.87 / +0.1%
duckdb / vortex-file-compressed / ns (0.988x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 52682276 / 53631358 / -1.8% 89422241 / 97100603 / -7.9% 0.59 / 0.55 / +6.7%
tpch_q02/duckdb:vortex-file-compressed 32221371 / 32868218 / -2.0% 49144631 / 45396778 / +8.3% 0.66 / 0.72 / -9.4%
tpch_q03/duckdb:vortex-file-compressed 57887195 / 57948206 / -0.1% 119599331 / 111251366 / +7.5% 0.48 / 0.52 / -7.1%
tpch_q04/duckdb:vortex-file-compressed 79440813 / 81988564 / -3.1% 126637461 / 128310136 / -1.3% 0.63 / 0.64 / -1.8%
tpch_q05/duckdb:vortex-file-compressed 64257714 / 64503275 / -0.4% 122537228 / 121863385 / +0.6% 0.52 / 0.53 / -0.9%
tpch_q06/duckdb:vortex-file-compressed 22324865 / 22695746 / -1.6% 69202390 / 68790630 / +0.6% 0.32 / 0.33 / -2.2%
tpch_q07/duckdb:vortex-file-compressed 61732910 / 59400373 / +3.9% 141191053 / 134178782 / +5.2% 0.44 / 0.44 / -1.2%
tpch_q08/duckdb:vortex-file-compressed 83973057 / 85182811 / -1.4% 154195079 / 161743597 / -4.7% 0.54 / 0.53 / +3.4%
tpch_q09/duckdb:vortex-file-compressed 168414040 / 167529391 / +0.5% 250034679 / 248710442 / +0.5% 0.67 / 0.67 / -0.0%
tpch_q10/duckdb:vortex-file-compressed 106802631 / 107814615 / -0.9% 177683951 / 188559726 / -5.8% 0.60 / 0.57 / +5.1%
tpch_q11/duckdb:vortex-file-compressed 17143823 / 17393532 / -1.4% 35107251 / 34864079 / +0.7% 0.49 / 0.50 / -2.1%
tpch_q12/duckdb:vortex-file-compressed 55322104 / 55726611 / -0.7% 108855250 / 108019029 / +0.8% 0.51 / 0.52 / -1.5%
tpch_q13/duckdb:vortex-file-compressed 90229688 / 91494031 / -1.4% 145515968 / 148407617 / -1.9% 0.62 / 0.62 / +0.6%
tpch_q14/duckdb:vortex-file-compressed 32088468 / 30883447 / +3.9% 85619342 / 79235816 / +8.1% 0.37 / 0.39 / -3.8%
tpch_q15/duckdb:vortex-file-compressed 39361595 / 42021019 / -6.3% 100809677 / 101890572 / -1.1% 0.39 / 0.41 / -5.3%
tpch_q16/duckdb:vortex-file-compressed 42211815 / 42502115 / -0.7% 57626895 / 56429667 / +2.1% 0.73 / 0.75 / -2.7%
tpch_q17/duckdb:vortex-file-compressed 57206469 / 66853846 / -14.4% 🟢 120931868 / 142980748 / -15.4% 🟢 0.47 / 0.47 / +1.2%
tpch_q18/duckdb:vortex-file-compressed 135457905 / 130949268 / +3.4% 163662917 / 170006637 / -3.7% 0.83 / 0.77 / +7.5%
tpch_q19/duckdb:vortex-file-compressed 45034487 / 41731551 / +7.9% 109157379 / 109393272 / -0.2% 0.41 / 0.38 / +8.1%
tpch_q20/duckdb:vortex-file-compressed 60629380 / 60659701 / -0.0% 135778977 / 129374511 / +5.0% 0.45 / 0.47 / -4.8%
tpch_q21/duckdb:vortex-file-compressed 234545024 / 240754061 / -2.6% 279386603 / 288289619 / -3.1% 0.84 / 0.84 / +0.5%
tpch_q22/duckdb:vortex-file-compressed 41694010 / 43856286 / -4.9% 63864285 / 62827506 / +1.7% 0.65 / 0.70 / -6.5%
duckdb / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70354511 / 70831596 / -0.7% 87986454 / 142545608 / -38.3% 🟢 0.80 / 0.50 / +60.9%
tpch_q02/duckdb:parquet 70614175 / 70980230 / -0.5% 83595451 / 82988582 / +0.7% 0.84 / 0.86 / -1.2%
tpch_q03/duckdb:parquet 114731048 / 114061463 / +0.6% 152024283 / 150120895 / +1.3% 0.75 / 0.76 / -0.7%
tpch_q04/duckdb:parquet 74202975 / 74734655 / -0.7% 97370263 / 96780176 / +0.6% 0.76 / 0.77 / -1.3%
tpch_q05/duckdb:parquet 124854767 / 125470024 / -0.5% 160802432 / 173135997 / -7.1% 0.78 / 0.72 / +7.1%
tpch_q06/duckdb:parquet 34310475 / 34632671 / -0.9% 53772485 / 54393922 / -1.1% 0.64 / 0.64 / +0.2%
tpch_q07/duckdb:parquet 89672992 / 90138057 / -0.5% 136818259 / 127969739 / +6.9% 0.66 / 0.70 / -6.9%
tpch_q08/duckdb:parquet 146639904 / 142865138 / +2.6% 192342989 / 188937010 / +1.8% 0.76 / 0.76 / +0.8%
tpch_q09/duckdb:parquet 221978083 / 222905185 / -0.4% 270991834 / 266710089 / +1.6% 0.82 / 0.84 / -2.0%
tpch_q10/duckdb:parquet 470358051 / 471990938 / -0.3% 513335880 / 511917919 / +0.3% 0.92 / 0.92 / -0.6%
tpch_q11/duckdb:parquet 30783097 / 30788963 / -0.0% 41093224 / 39388995 / +4.3% 0.75 / 0.78 / -4.2%
tpch_q12/duckdb:parquet 73767834 / 76286778 / -3.3% 93221184 / 94190780 / -1.0% 0.79 / 0.81 / -2.3%
tpch_q13/duckdb:parquet 315590618 / 316312505 / -0.2% 330612089 / 330505732 / +0.0% 0.95 / 0.96 / -0.3%
tpch_q14/duckdb:parquet 105980549 / 106433711 / -0.4% 136823544 / 133199169 / +2.7% 0.77 / 0.80 / -3.1%
tpch_q15/duckdb:parquet 43239757 / 44701853 / -3.3% 74840199 / 66706675 / +12.2% 🔴 0.58 / 0.67 / -13.8%
tpch_q16/duckdb:parquet 113760017 / 114997927 / -1.1% 125534506 / 130620511 / -3.9% 0.91 / 0.88 / +2.9%
tpch_q17/duckdb:parquet 73039338 / 73708754 / -0.9% 101300087 / 104089385 / -2.7% 0.72 / 0.71 / +1.8%
tpch_q18/duckdb:parquet 186487682 / 205077947 / -9.1% 171918736 / 181609101 / -5.3% 1.08 / 1.13 / -3.9%
tpch_q19/duckdb:parquet 161219537 / 162272076 / -0.6% 213895901 / 190531749 / +12.3% 🔴 0.75 / 0.85 / -11.5%
tpch_q20/duckdb:parquet 130095494 / 128136925 / +1.5% 164055909 / 168304362 / -2.5% 0.79 / 0.76 / +4.2%
tpch_q21/duckdb:parquet 273552580 / 259312779 / +5.5% 286353026 / 290195219 / -1.3% 0.96 / 0.89 / +6.9%
tpch_q22/duckdb:parquet 261943901 / 263583463 / -0.6% 272200971 / 276317733 / -1.5% 0.96 / 0.95 / +0.9%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 026bb264 vs base ae00d7a1
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.014x ➖
Parquet (geomean): hot 1.014x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +1.4% · Median polish +1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9193294 / 9023941 / +1.9% 9560776 / 9457337 / +1.1% 0.96 / 0.95 / +0.8%
statpopgen_q01/duckdb:vortex-file-compressed 10358994 / 10300808 / +0.6% 14053985 / 15100943 / -6.9% 0.74 / 0.68 / +8.1%
statpopgen_q02/duckdb:vortex-file-compressed 305388844 / 301205214 / +1.4% 332989858 / 325316566 / +2.4% 0.92 / 0.93 / -0.9%
statpopgen_q03/duckdb:vortex-file-compressed 803219466 / 818417186 / -1.9% 823350522 / 826153541 / -0.3% 0.98 / 0.99 / -1.5%
statpopgen_q04/duckdb:vortex-file-compressed 821055624 / 817884370 / +0.4% 822390065 / 819762095 / +0.3% 1.00 / 1.00 / +0.1%
statpopgen_q05/duckdb:vortex-file-compressed 321071478 / 315772531 / +1.7% 344906815 / 332112661 / +3.9% 0.93 / 0.95 / -2.1%
statpopgen_q06/duckdb:vortex-file-compressed 1145131515 / 1132285098 / +1.1% 1170408394 / 1139757318 / +2.7% 0.98 / 0.99 / -1.5%
statpopgen_q07/duckdb:vortex-file-compressed 128521118 / 128358433 / +0.1% 174073023 / 150159514 / +15.9% 🔴 0.74 / 0.85 / -13.6%
statpopgen_q08/duckdb:vortex-file-compressed 141706462 / 142275730 / -0.4% 198028323 / 198653171 / -0.3% 0.72 / 0.72 / -0.1%
statpopgen_q09/duckdb:vortex-file-compressed 608513730 / 614903752 / -1.0% 618519847 / 641103889 / -3.5% 0.98 / 0.96 / +2.6%
statpopgen_q10/duckdb:vortex-file-compressed 1936111564 / 1918891767 / +0.9% 1923983027 / 1898279423 / +1.4% 1.01 / 1.01 / -0.5%
duckdb / parquet / ns (1.014x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 246093398 / 247553255 / -0.6% 245157263 / 245230586 / -0.0% 1.00 / 1.01 / -0.6%
statpopgen_q01/duckdb:parquet 304423155 / 303424668 / +0.3% 304497953 / 304768005 / -0.1% 1.00 / 1.00 / +0.4%
statpopgen_q02/duckdb:parquet 575360546 / 558849824 / +3.0% 634485935 / 582248511 / +9.0% 0.91 / 0.96 / -5.5%
statpopgen_q03/duckdb:parquet 888645552 / 852731884 / +4.2% 880267521 / 859851594 / +2.4% 1.01 / 0.99 / +1.8%
statpopgen_q04/duckdb:parquet 866884590 / 827273348 / +4.8% 851022402 / 863141519 / -1.4% 1.02 / 0.96 / +6.3%
statpopgen_q05/duckdb:parquet 588498430 / 576319182 / +2.1% 604254837 / 594310028 / +1.7% 0.97 / 0.97 / +0.4%
statpopgen_q06/duckdb:parquet 720180030 / 707893014 / +1.7% 702784434 / 720595198 / -2.5% 1.02 / 0.98 / +4.3%
statpopgen_q07/duckdb:parquet 608646256 / 605977906 / +0.4% 717074737 / 701822304 / +2.2% 0.85 / 0.86 / -1.7%
statpopgen_q08/duckdb:parquet 620796814 / 620580438 / +0.0% 716667963 / 694437713 / +3.2% 0.87 / 0.89 / -3.1%
statpopgen_q09/duckdb:parquet 801855294 / 818892540 / -2.1% 840584155 / 824147506 / +2.0% 0.95 / 0.99 / -4.0%
statpopgen_q10/duckdb:parquet 1435109490 / 1414575357 / +1.5% 1255124459 / 1386047620 / -9.4% 1.14 / 1.02 / +12.0%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 026bb264 vs base ae00d7a1
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.8%
Engines: DataFusion No clear signal (-3.4%, environment too noisy confidence) · DuckDB No clear signal (-6.1%, environment too noisy confidence)
Vortex (geomean): hot 0.980x ➖ · cold 0.966x ➖
Parquet (geomean): hot 1.029x ➖ · cold 0.940x ➖
Shifts: Parquet (control) +2.9% · Median polish +4.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 218183003 / 215971379 / +1.0% 803619114 / 607182360 / +32.4% 🔴 0.27 / 0.36 / -23.7%
tpch_q02/datafusion:vortex-file-compressed 320050226 / 321017520 / -0.3% 604439063 / 582661688 / +3.7% 0.53 / 0.55 / -3.9%
tpch_q03/datafusion:vortex-file-compressed 428698886 / 408686678 / +4.9% 1019985536 / 1205384508 / -15.4% 0.42 / 0.34 / +24.0%
tpch_q04/datafusion:vortex-file-compressed 183335973 / 199507817 / -8.1% 395750865 / 395961222 / -0.1% 0.46 / 0.50 / -8.1%
tpch_q05/datafusion:vortex-file-compressed 392308537 / 439694108 / -10.8% 664051590 / 749949056 / -11.5% 0.59 / 0.59 / +0.8%
tpch_q06/datafusion:vortex-file-compressed 295592479 / 271733481 / +8.8% 580305753 / 384351123 / +51.0% 🔴 0.51 / 0.71 / -28.0%
tpch_q07/datafusion:vortex-file-compressed 363196810 / 369559962 / -1.7% 600357984 / 480253070 / +25.0% 0.60 / 0.77 / -21.4%
tpch_q08/datafusion:vortex-file-compressed 519051351 / 514251575 / +0.9% 732206615 / 716985919 / +2.1% 0.71 / 0.72 / -1.2%
tpch_q09/datafusion:vortex-file-compressed 484287064 / 460376883 / +5.2% 526775629 / 704036126 / -25.2% 0.92 / 0.65 / +40.6%
tpch_q10/datafusion:vortex-file-compressed 397271618 / 333185555 / +19.2% 604443055 / 513199107 / +17.8% 0.66 / 0.65 / +1.2%
tpch_q11/datafusion:vortex-file-compressed 259383455 / 293488472 / -11.6% 427156997 / 501952073 / -14.9% 0.61 / 0.58 / +3.9%
tpch_q12/datafusion:vortex-file-compressed 715688372 / 311604994 / +129.7% 🔴 466244803 / 512250355 / -9.0% 1.54 / 0.61 / +152.3%
tpch_q13/datafusion:vortex-file-compressed 138363896 / 138490217 / -0.1% 515295968 / 382060822 / +34.9% 🔴 0.27 / 0.36 / -25.9%
tpch_q14/datafusion:vortex-file-compressed 189680752 / 224634319 / -15.6% 379106691 / 345569680 / +9.7% 0.50 / 0.65 / -23.0%
tpch_q15/datafusion:vortex-file-compressed 305329148 / 285087866 / +7.1% 596338290 / 484251940 / +23.1% 0.51 / 0.59 / -13.0%
tpch_q16/datafusion:vortex-file-compressed 165293813 / 151890444 / +8.8% 287730445 / 356467857 / -19.3% 0.57 / 0.43 / +34.8%
tpch_q17/datafusion:vortex-file-compressed 322557962 / 367237687 / -12.2% 616993895 / 416207852 / +48.2% 🔴 0.52 / 0.88 / -40.7%
tpch_q18/datafusion:vortex-file-compressed 272271909 / 756323945 / -64.0% 🟢 564195988 / 1209128606 / -53.3% 🟢 0.48 / 0.63 / -22.8%
tpch_q19/datafusion:vortex-file-compressed 443988958 / 321333851 / +38.2% 🔴 547932485 / 439472367 / +24.7% 0.81 / 0.73 / +10.8%
tpch_q20/datafusion:vortex-file-compressed 266757963 / 303814808 / -12.2% 478665974 / 753330450 / -36.5% 🟢 0.56 / 0.40 / +38.2%
tpch_q21/datafusion:vortex-file-compressed 628550654 / 848856529 / -26.0% 914453373 / 988700974 / -7.5% 0.69 / 0.86 / -19.9%
tpch_q22/datafusion:vortex-file-compressed 197272561 / 154249745 / +27.9% 360582991 / 349333053 / +3.2% 0.55 / 0.44 / +23.9%
datafusion / parquet / ns (1.028x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 201081528 / 169731263 / +18.5% 576501255 / 448501029 / +28.5% 0.35 / 0.38 / -7.8%
tpch_q02/datafusion:parquet 264863858 / 287653284 / -7.9% 535868995 / 776166512 / -31.0% 🟢 0.49 / 0.37 / +33.4%
tpch_q03/datafusion:parquet 301052006 / 359087470 / -16.2% 787975393 / 1026281721 / -23.2% 0.38 / 0.35 / +9.2%
tpch_q04/datafusion:parquet 153131530 / 129798449 / +18.0% 384107084 / 335105370 / +14.6% 0.40 / 0.39 / +2.9%
tpch_q05/datafusion:parquet 364041927 / 325225796 / +11.9% 430597154 / 487822130 / -11.7% 0.85 / 0.67 / +26.8%
tpch_q06/datafusion:parquet 156143972 / 131087146 / +19.1% 229641680 / 303091680 / -24.2% 0.68 / 0.43 / +57.2%
tpch_q07/datafusion:parquet 386535761 / 484657038 / -20.2% 480926103 / 501964987 / -4.2% 0.80 / 0.97 / -16.8%
tpch_q08/datafusion:parquet 412327635 / 408900431 / +0.8% 527440055 / 544582732 / -3.1% 0.78 / 0.75 / +4.1%
tpch_q09/datafusion:parquet 435668981 / 493931550 / -11.8% 612261788 / 715108144 / -14.4% 0.71 / 0.69 / +3.0%
tpch_q10/datafusion:parquet 381723246 / 370565296 / +3.0% 510741890 / 835429730 / -38.9% 🟢 0.75 / 0.44 / +68.5%
tpch_q11/datafusion:parquet 262210926 / 262144540 / +0.0% 421685430 / 427531796 / -1.4% 0.62 / 0.61 / +1.4%
tpch_q12/datafusion:parquet 238178341 / 173132000 / +37.6% 🔴 527536483 / 446014289 / +18.3% 0.45 / 0.39 / +16.3%
tpch_q13/datafusion:parquet 400576357 / 400766429 / -0.0% 530197547 / 600552427 / -11.7% 0.76 / 0.67 / +13.2%
tpch_q14/datafusion:parquet 177802977 / 171782290 / +3.5% 353557204 / 521636885 / -32.2% 🟢 0.50 / 0.33 / +52.7%
tpch_q15/datafusion:parquet 359801237 / 271317150 / +32.6% 🔴 499020421 / 563269042 / -11.4% 0.72 / 0.48 / +49.7%
tpch_q16/datafusion:parquet 105400253 / 145631219 / -27.6% 244652680 / 376714178 / -35.1% 🟢 0.43 / 0.39 / +11.4%
tpch_q17/datafusion:parquet 302393797 / 310527992 / -2.6% 412369648 / 600882425 / -31.4% 🟢 0.73 / 0.52 / +41.9%
tpch_q18/datafusion:parquet 447486356 / 393335405 / +13.8% 576806215 / 560908842 / +2.8% 0.78 / 0.70 / +10.6%
tpch_q19/datafusion:parquet 163504023 / 162022816 / +0.9% 268027614 / 337237380 / -20.5% 0.61 / 0.48 / +27.0%
tpch_q20/datafusion:parquet 261550619 / 244354867 / +7.0% 435226621 / 425062674 / +2.4% 0.60 / 0.57 / +4.5%
tpch_q21/datafusion:parquet 391080447 / 374703415 / +4.4% 751135276 / 631615349 / +18.9% 0.52 / 0.59 / -12.2%
tpch_q22/datafusion:parquet 233104535 / 229643185 / +1.5% 403919766 / 819568372 / -50.7% 🟢 0.58 / 0.28 / +106.0%
duckdb / vortex-file-compressed / ns (0.967x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 194990588 / 190110588 / +2.6% 247530364 / 269528578 / -8.2% 0.79 / 0.71 / +11.7%
tpch_q02/duckdb:vortex-file-compressed 450774855 / 376064748 / +19.9% 468826246 / 424102726 / +10.5% 0.96 / 0.89 / +8.4%
tpch_q03/duckdb:vortex-file-compressed 474643253 / 443675095 / +7.0% 461615127 / 582810184 / -20.8% 1.03 / 0.76 / +35.1%
tpch_q04/duckdb:vortex-file-compressed 271178567 / 244894642 / +10.7% 336295804 / 295167998 / +13.9% 0.81 / 0.83 / -2.8%
tpch_q05/duckdb:vortex-file-compressed 432931924 / 430199553 / +0.6% 527503250 / 479061918 / +10.1% 0.82 / 0.90 / -8.6%
tpch_q06/duckdb:vortex-file-compressed 298260992 / 252426127 / +18.2% 292367625 / 499377807 / -41.5% 🟢 1.02 / 0.51 / +101.8%
tpch_q07/duckdb:vortex-file-compressed 472755447 / 480715045 / -1.7% 525360308 / 506253102 / +3.8% 0.90 / 0.95 / -5.2%
tpch_q08/duckdb:vortex-file-compressed 600634471 / 624188905 / -3.8% 677596364 / 804225735 / -15.7% 0.89 / 0.78 / +14.2%
tpch_q09/duckdb:vortex-file-compressed 503533463 / 1957051312 / -74.3% 🟢 463994435 / 1089306951 / -57.4% 🟢 1.09 / 1.80 / -39.6%
tpch_q10/duckdb:vortex-file-compressed 489379888 / 512541132 / -4.5% 581096787 / 562470174 / +3.3% 0.84 / 0.91 / -7.6%
tpch_q11/duckdb:vortex-file-compressed 178776510 / 190131944 / -6.0% 241983963 / 215396194 / +12.3% 0.74 / 0.88 / -16.3%
tpch_q12/duckdb:vortex-file-compressed 516134089 / 393901198 / +31.0% 🔴 552418251 / 466382835 / +18.4% 0.93 / 0.84 / +10.6%
tpch_q13/duckdb:vortex-file-compressed 461427721 / 401144907 / +15.0% 391484853 / 513207821 / -23.7% 1.18 / 0.78 / +50.8%
tpch_q14/duckdb:vortex-file-compressed 253676895 / 370516631 / -31.5% 🟢 327355438 / 292506961 / +11.9% 0.77 / 1.27 / -38.8%
tpch_q15/duckdb:vortex-file-compressed 153137777 / 149884932 / +2.2% 200283454 / 214904425 / -6.8% 0.76 / 0.70 / +9.6%
tpch_q16/duckdb:vortex-file-compressed 184481604 / 172857336 / +6.7% 266098755 / 198200098 / +34.3% 🔴 0.69 / 0.87 / -20.5%
tpch_q17/duckdb:vortex-file-compressed 462000588 / 441988492 / +4.5% 445757363 / 499628618 / -10.8% 1.04 / 0.88 / +17.2%
tpch_q18/duckdb:vortex-file-compressed 306880858 / 429586455 / -28.6% 336265048 / 774750717 / -56.6% 🟢 0.91 / 0.55 / +64.6%
tpch_q19/duckdb:vortex-file-compressed 346228554 / 323055989 / +7.2% 346543562 / 366697218 / -5.5% 1.00 / 0.88 / +13.4%
tpch_q20/duckdb:vortex-file-compressed 369576938 / 380187828 / -2.8% 444133736 / 445908149 / -0.4% 0.83 / 0.85 / -2.4%
tpch_q21/duckdb:vortex-file-compressed 683958848 / 619764491 / +10.4% 914392872 / 613805857 / +49.0% 🔴 0.75 / 1.01 / -25.9%
tpch_q22/duckdb:vortex-file-compressed 216319538 / 163872029 / +32.0% 🔴 244204294 / 206391112 / +18.3% 0.89 / 0.79 / +11.6%
duckdb / parquet / ns (1.030x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 313367094 / 281566516 / +11.3% 550034732 / 389433467 / +41.2% 🔴 0.57 / 0.72 / -21.2%
tpch_q02/duckdb:parquet 661737139 / 735858601 / -10.1% 622232985 / 870113413 / -28.5% 1.06 / 0.85 / +25.8%
tpch_q03/duckdb:parquet 813507458 / 784870126 / +3.6% 797834870 / 925402398 / -13.8% 1.02 / 0.85 / +20.2%
tpch_q04/duckdb:parquet 553297116 / 516221857 / +7.2% 795153217 / 554829391 / +43.3% 🔴 0.70 / 0.93 / -25.2%
tpch_q05/duckdb:parquet 991441352 / 927063424 / +6.9% 1132371162 / 871833904 / +29.9% 0.88 / 1.06 / -17.7%
tpch_q06/duckdb:parquet 349124052 / 311095912 / +12.2% 418146739 / 567481843 / -26.3% 0.83 / 0.55 / +52.3%
tpch_q07/duckdb:parquet 946021315 / 849169327 / +11.4% 830561496 / 926219135 / -10.3% 1.14 / 0.92 / +24.2%
tpch_q08/duckdb:parquet 1052944079 / 1133869606 / -7.1% 1161282165 / 1137692508 / +2.1% 0.91 / 1.00 / -9.0%
tpch_q09/duckdb:parquet 1031059824 / 1023150627 / +0.8% 1014738283 / 1074235769 / -5.5% 1.02 / 0.95 / +6.7%
tpch_q10/duckdb:parquet 1060091297 / 945638483 / +12.1% 1271346512 / 990823784 / +28.3% 0.83 / 0.95 / -12.6%
tpch_q11/duckdb:parquet 444930261 / 435186349 / +2.2% 446691008 / 439069010 / +1.7% 1.00 / 0.99 / +0.5%
tpch_q12/duckdb:parquet 612385021 / 556151083 / +10.1% 699077884 / 617892159 / +13.1% 0.88 / 0.90 / -2.7%
tpch_q13/duckdb:parquet 805509949 / 758811625 / +6.2% 915647787 / 902025008 / +1.5% 0.88 / 0.84 / +4.6%
tpch_q14/duckdb:parquet 562596581 / 529650478 / +6.2% 547082148 / 546793317 / +0.1% 1.03 / 0.97 / +6.2%
tpch_q15/duckdb:parquet 377021737 / 399185365 / -5.6% 393339695 / 442673452 / -11.1% 0.96 / 0.90 / +6.3%
tpch_q16/duckdb:parquet 522957231 / 510306582 / +2.5% 475398198 / 519800936 / -8.5% 1.10 / 0.98 / +12.1%
tpch_q17/duckdb:parquet 538093865 / 494497491 / +8.8% 491188530 / 514725288 / -4.6% 1.10 / 0.96 / +14.0%
tpch_q18/duckdb:parquet 646764386 / 633824951 / +2.0% 666724115 / 702869317 / -5.1% 0.97 / 0.90 / +7.6%
tpch_q19/duckdb:parquet 627840048 / 604341154 / +3.9% 732308370 / 604277542 / +21.2% 0.86 / 1.00 / -14.3%
tpch_q20/duckdb:parquet 818976360 / 848140369 / -3.4% 880355303 / 815898848 / +7.9% 0.93 / 1.04 / -10.5%
tpch_q21/duckdb:parquet 710812790 / 707969629 / +0.4% 795394139 / 798612801 / -0.4% 0.89 / 0.89 / +0.8%
tpch_q22/duckdb:parquet 373529441 / 414177437 / -9.8% 521279019 / 407407916 / +28.0% 0.72 / 1.02 / -29.5%

@robert3005

Copy link
Copy Markdown
Contributor

The only thing here is we should ensure that we actually have the number of children that matches the dtype when deserialising

@mhk197
mhk197 merged commit 7eca46d into develop Sep 18, 2026
150 of 153 checks passed
@mhk197
mhk197 deleted the mk/dbp-v2-feature branch September 18, 2026 13:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/break A breaking API change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants