Skip to content

[To dev/1.3] Pipe: Handle transient resource failures locally (#18381) - #18430

Merged
jt2594838 merged 2 commits into
apache:dev/1.3from
Caideyipi:cp-d1f362d3-dev-1.3
Aug 12, 2026
Merged

[To dev/1.3] Pipe: Handle transient resource failures locally (#18381)#18430
jt2594838 merged 2 commits into
apache:dev/1.3from
Caideyipi:cp-d1f362d3-dev-1.3

Conversation

@Caideyipi

Copy link
Copy Markdown
Collaborator

Summary

  • Backport Pipe: Handle transient resource failures locally #18381 to dev/1.3.
  • Handle transient sink resource failures locally and stop pipes based on recent failure thresholds.
  • Aggregate recent memory and disk failures through pipe heartbeats and expose them in tree-model SHOW PIPES.
  • Adapt the change to dev/1.3 APIs while preserving the upstream Thrift field IDs 6, 11, and 19 for compatibility.

Testing

  • mvn -o -nsu -Ddevelocity.off=true -Dtest=PipeRecentFailureCounterTest,PipeStopStrategyTest,PipeTemporaryMetaTest -pl iotdb-core/node-commons test
  • mvn -o -nsu -Ddevelocity.off=true -Dtest=PipeTableRespTest,PipeHeartbeatParserTest -pl iotdb-core/confignode test
  • mvn -o -nsu -Ddevelocity.off=true -Dtest=PipeSinkSubtaskTest,ShowPipeTaskTest -pl iotdb-core/datanode test
  • mvn -o -nsu -Ddevelocity.off=true -pl iotdb-core/node-commons,iotdb-core/datanode,iotdb-core/confignode spotless:apply
  • git diff --check

@jt2594838
jt2594838 merged commit 79c9459 into apache:dev/1.3 Aug 12, 2026
23 checks passed
@jt2594838
jt2594838 deleted the cp-d1f362d3-dev-1.3 branch August 12, 2026 01:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants