The initial approach in DolphinScheduler for tracking YARN tasks relied on application IDs, but this led to incomplete status tracking and issues, particularly with detached clients.
In Flink Stream Application mode, client Shell's immediate exit can incorrectly lead DolphinScheduler to mark tasks as successful, despite YARN tasks still running.
The AbstractYarnTask class, as an abstraction for YARN tasks, provides core methods to submit applications, track application status, and cancel applications efficiently.
By refactoring the method for tracking YARN task statuses, DolphinScheduler aims to address inconsistent task state determination and simplify task lifecycle management.
Collection
[
|
...
]