Skip to content

[python] Add commit support for resumable row-id updates - #8982

Closed
XiaoHongbo-Hope wants to merge 6 commits into
apache:masterfrom
XiaoHongbo-Hope:codex/pr8826-commit-guards
Closed

[python] Add commit support for resumable row-id updates#8982
XiaoHongbo-Hope wants to merge 6 commits into
apache:masterfrom
XiaoHongbo-Hope:codex/pr8826-commit-guards

Conversation

@XiaoHongbo-Hope

@XiaoHongbo-Hope XiaoHongbo-Hope commented Aug 1, 2026

Copy link
Copy Markdown
Contributor

Depends on #8826.

This adds the remaining commit primitives needed by resumable row-id writers:

  • read live entries intersecting planned row-id ranges;
  • verify planned target files are still live before commit;
  • attach checkpoint properties and create metadata-only stream commits.

Tests: commit scanner/conflict and table commit suites; project flake8 clean.

@XiaoHongbo-Hope XiaoHongbo-Hope changed the title [python] Guard resumable row-id commits against rewrites [python] Add commit support for resumable row-id updates Aug 2, 2026
@XiaoHongbo-Hope

Copy link
Copy Markdown
Contributor Author

Closing this draft because the current direction is the standalone time-based incremental write_paimon implementation in #9033. #9033 includes the minimal snapshot-property, metadata-commit, and conservative conflict guards it needs directly on master; the row-id-specific guards in this stacked PR are no longer required.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant