Codota Logo
HoodieActiveTimeline.getTimelineOfActions
Code IndexAdd Codota to your IDE (free)

How to use
getTimelineOfActions
method
in
com.uber.hoodie.common.table.timeline.HoodieActiveTimeline

Best Java code snippets using com.uber.hoodie.common.table.timeline.HoodieActiveTimeline.getTimelineOfActions (Showing top 14 results out of 315)

  • Common ways to obtain HoodieActiveTimeline
private void myMethod () {
HoodieActiveTimeline h =
  • Codota IconHoodieTableMetaClient hoodieTableMetaClient;hoodieTableMetaClient.getActiveTimeline()
  • Smart code suggestions by Codota
}
origin: uber/hudi

/**
 * Get all instants (commits, delta commits) that produce new data, in the active timeline *
 *
 */
public HoodieTimeline getCommitsTimeline() {
 return getTimelineOfActions(
   Sets.newHashSet(COMMIT_ACTION, DELTA_COMMIT_ACTION));
}
origin: uber/hudi

/**
 * Get all instants (commits, delta commits, in-flight/request compaction) that produce new data, in the active
 * timeline *
 * With Async compaction a requested/inflight compaction-instant is a valid baseInstant for a file-slice as there
 * could be delta-commits with that baseInstant.
 */
public HoodieTimeline getCommitsAndCompactionTimeline() {
 return getTimelineOfActions(
   Sets.newHashSet(COMMIT_ACTION, DELTA_COMMIT_ACTION, COMPACTION_ACTION));
}
origin: uber/hudi

/**
 * Get all instants (commits, delta commits, clean, savepoint, rollback) that result in actions,
 * in the active timeline *
 */
public HoodieTimeline getAllCommitsTimeline() {
 return getTimelineOfActions(
   Sets.newHashSet(COMMIT_ACTION, DELTA_COMMIT_ACTION, CLEAN_ACTION, COMPACTION_ACTION,
     SAVEPOINT_ACTION, ROLLBACK_ACTION));
}
origin: uber/hudi

/**
 * Get only pure commits (inflight and completed) in the active timeline
 */
public HoodieTimeline getCommitTimeline() {
 return getTimelineOfActions(Sets.newHashSet(COMMIT_ACTION));
}
origin: uber/hudi

 /**
  * Obtain all the commits, compactions that have occurred on the timeline, whose instant times
  * could be fed into the datasource options.
  */
 public static HoodieTimeline allCompletedCommitsCompactions(FileSystem fs, String basePath) {
  HoodieTableMetaClient metaClient = new HoodieTableMetaClient(fs.getConf(), basePath, true);
  if (metaClient.getTableType().equals(HoodieTableType.MERGE_ON_READ)) {
   return metaClient.getActiveTimeline().getTimelineOfActions(
     Sets.newHashSet(HoodieActiveTimeline.COMMIT_ACTION,
       HoodieActiveTimeline.DELTA_COMMIT_ACTION));
  } else {
   return metaClient.getCommitTimeline().filterCompletedInstants();
  }
 }
}
origin: com.uber.hoodie/hoodie-spark

 /**
  * Obtain all the commits, compactions that have occurred on the timeline, whose instant times
  * could be fed into the datasource options.
  */
 public static HoodieTimeline allCompletedCommitsCompactions(FileSystem fs, String basePath) {
  HoodieTableMetaClient metaClient = new HoodieTableMetaClient(fs.getConf(), basePath, true);
  if (metaClient.getTableType().equals(HoodieTableType.MERGE_ON_READ)) {
   return metaClient.getActiveTimeline().getTimelineOfActions(
     Sets.newHashSet(HoodieActiveTimeline.COMMIT_ACTION,
       HoodieActiveTimeline.DELTA_COMMIT_ACTION));
  } else {
   return metaClient.getCommitTimeline().filterCompletedInstants();
  }
 }
}
origin: uber/hudi

String maxCommitTime = metaClient.getActiveTimeline().getTimelineOfActions(
  Sets.newHashSet(HoodieTimeline.COMMIT_ACTION, HoodieTimeline.ROLLBACK_ACTION,
    HoodieTimeline.DELTA_COMMIT_ACTION)).filterCompletedInstants().lastInstant()
origin: uber/hudi

.getTimelineOfActions(Sets.newHashSet(HoodieActiveTimeline.COMMIT_ACTION,
  HoodieActiveTimeline.DELTA_COMMIT_ACTION, HoodieActiveTimeline.COMPACTION_ACTION)).getInstants()
.filter(i -> commits.contains(i.getTimestamp()))
origin: uber/hudi

  .getTimelineOfActions(Sets.newHashSet(HoodieTimeline.CLEAN_ACTION))
  .filterCompletedInstants();
Stream<HoodieInstant> instants = cleanAndRollbackTimeline.getInstants()
origin: com.uber.hoodie/hoodie-client

  .getTimelineOfActions(Sets.newHashSet(HoodieTimeline.CLEAN_ACTION))
  .filterCompletedInstants();
Stream<HoodieInstant> instants = cleanAndRollbackTimeline.getInstants()
origin: com.uber.hoodie/hoodie-client

.getTimelineOfActions(Sets.newHashSet(HoodieActiveTimeline.COMMIT_ACTION,
  HoodieActiveTimeline.DELTA_COMMIT_ACTION, HoodieActiveTimeline.COMPACTION_ACTION)).getInstants()
.filter(i -> commits.contains(i.getTimestamp()))
origin: uber/hudi

 private void verifyInflightInstants(HoodieTableMetaClient metaClient, int expectedTotalInstants) {
  HoodieTimeline timeline = metaClient.getActiveTimeline().reload()
    .getTimelineOfActions(Sets.newHashSet(HoodieTimeline.CLEAN_ACTION)).filterInflights();
  assertEquals("Loaded inflight clean actions and the count should match", expectedTotalInstants,
    timeline.countInstants());
 }
}
origin: uber/hudi

.getTimelineOfActions(
  Sets.newHashSet(HoodieTimeline.COMMIT_ACTION, HoodieTimeline.ROLLBACK_ACTION,
    HoodieTimeline.DELTA_COMMIT_ACTION))
origin: com.uber.hoodie/hoodie-client

.getTimelineOfActions(
  Sets.newHashSet(HoodieTimeline.COMMIT_ACTION, HoodieTimeline.ROLLBACK_ACTION,
    HoodieTimeline.DELTA_COMMIT_ACTION))
com.uber.hoodie.common.table.timelineHoodieActiveTimelinegetTimelineOfActions

Javadoc

Get a timeline of a specific set of actions. useful to create a merged timeline of multiple actions

Popular methods of HoodieActiveTimeline

  • getCommitTimeline
  • getCommitsTimeline
  • getCommitsAndCompactionTimeline
  • getInstantDetails
  • createNewCommitTime
  • getInstantAuxiliaryDetails
  • reload
  • <init>
  • createInflight
  • filterPendingCompactionTimeline
  • getDeltaCommitTimeline
  • lastInstant
  • getDeltaCommitTimeline,
  • lastInstant,
  • saveAsComplete,
  • saveToCompactionRequested,
  • transitionCompactionRequestedToInflight,
  • deleteCompactionRequested,
  • deleteInflight,
  • filterInflightsExcludingCompaction,
  • getAllCommitsTimeline

Popular in Java

  • Making http requests using okhttp
  • getApplicationContext (Context)
  • putExtra (Intent)
  • getContentResolver (Context)
  • Queue (java.util)
    A collection designed for holding elements prior to processing. Besides basic java.util.Collection o
  • Random (java.util)
    This class provides methods that return pseudo-random values.It is dangerous to seed Random with the
  • ZipFile (java.util.zip)
    This class provides random read access to a zip file. You pay more to read the zip file's central di
  • Reference (javax.naming)
  • JFrame (javax.swing)
  • IOUtils (org.apache.commons.io)
    General IO stream manipulation utilities. This class provides static utility methods for input/outpu
Codota Logo
  • Products

    Search for Java codeSearch for JavaScript codeEnterprise
  • IDE Plugins

    IntelliJ IDEAWebStormAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimAtomGoLandRubyMineEmacsJupyter
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogCodota Academy Plugin user guide Terms of usePrivacy policyJava Code IndexJavascript Code Index
Get Codota for your IDE now