- <init>
- cleanBaseDirsAndReadOffsetFiles
For each store for this task, a. Deletes the corresponding non-logged-store base
dir. b. Deletes the
- getChangeLogOldestOffsetsForPartition
Builds a map from SystemStreamPartition to oldest offset for changelogs.
- getOldestChangeLogOffsets
Get the oldest offset for each changelog SSP based on the stream's metadata
(obtained from streamMet
- getStartingOffset
Returns the offset with which the changelog consumer should be initialized for
the given SystemStrea
- initialize
Cleans up and sets up store directories, validates changeLog SSPs for all stores
of this task, and r
- isLoggedStoreValid
Directory loggedStoreDir associated with the logged store storeName is
determined to be valid if all
- registerStartingOffsets
Determines the starting offset for each store SSP (based on
#getStartingOffset(SystemStreamPartition
- restoreStores
Restore each store in taskStoresToRestore sequentially
- setupBaseDirs
Create stores' base directories for logged-stores if they dont exist.
- stopPersistentStores
Stop only persistent stores. In case of certain stores and store mode (such as
RocksDB), this can in
- validateChangelogStreams
Validates each changelog system-stream with its respective SystemAdmin.