Skip to content

feat(blob): add standalone BlobDescriptor reader - #762

Open
XiaoHongbo-Hope wants to merge 3 commits into
apache:mainfrom
XiaoHongbo-Hope:codex/blob-descriptor-reader-core
Open

feat(blob): add standalone BlobDescriptor reader#762
XiaoHongbo-Hope wants to merge 3 commits into
apache:mainfrom
XiaoHongbo-Hope:codex/blob-descriptor-reader-core

Conversation

@XiaoHongbo-Hope

@XiaoHongbo-Hope XiaoHongbo-Hope commented Aug 29, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add a Rust BlobReader for serialized BlobDescriptor values
  • reuse existing validation, FileIO, URI grouping, range merging, and bounded concurrency
  • preserve input order and sanitize descriptor errors
  • support an existing FileIO so catalog-provided credential refresh is retained

This is the Rust core split from draft #761. C and Go bindings will follow separately.

Testing

  • cargo test -p paimon table::blob_resolver::tests --lib (11 passed)
  • DLF token-refresh BlobReader regression test
  • cargo clippy -p paimon --all-targets -- -D warnings
  • rustfmt and diff checks

Comment thread crates/paimon/src/table/blob_resolver.rs
@XiaoHongbo-Hope
XiaoHongbo-Hope marked this pull request as draft August 29, 2026 09:53
@XiaoHongbo-Hope
XiaoHongbo-Hope marked this pull request as ready for review August 29, 2026 10:04

@QuakeWang QuakeWang left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants