How to use
commitProgress
method
in
org.apache.storm.hdfs.spout.HdfsSpout

Best Java code snippets using org.apache.storm.hdfs.spout.HdfsSpout.commitProgress (Showing top 4 results out of 315)

Add the Codota plugin to your IDE and get smart completions

private void myMethod () {
 SimpleDateFormat s =String pattern;new SimpleDateFormat(pattern)
String template;Locale locale;new SimpleDateFormat(template, locale)
new SimpleDateFormat()
Smart code suggestions by Codota
}

@Override
public void ack(Object msgId) {
  LOG.trace("Ack received for msg {} on spout {}", msgId, spoutId);
  if (!ackEnabled) {
    return;
  }
  MessageId id = (MessageId) msgId;
  inflight.remove(id);
  ++acksSinceLastCommit;
  tracker.recordAckedOffset(id.offset);
  commitProgress(tracker.getCommitPosition());
  if (fileReadCompletely && inflight.isEmpty()) {
    markFileAsDone(reader.getFilePath());
    reader = null;
  }
  super.ack(msgId);
}

  commitProgress(reader.getFileOffset());
} else {
  commitProgress(tracker.getCommitPosition());

@Override
public void ack(Object msgId) {
  LOG.trace("Ack received for msg {} on spout {}", msgId, spoutId);
  if (!ackEnabled) {
    return;
  }
  MessageId id = (MessageId) msgId;
  inflight.remove(id);
  ++acksSinceLastCommit;
  tracker.recordAckedOffset(id.offset);
  commitProgress(tracker.getCommitPosition());
  if (fileReadCompletely && inflight.isEmpty()) {
    markFileAsDone(reader.getFilePath());
    reader = null;
  }
  super.ack(msgId);
}

  commitProgress(reader.getFileOffset());
} else {
  commitProgress(tracker.getCommitPosition());

Popular methods of HdfsSpout

<init>
setArchiveDir
setBadFilesDir
setHdfsUri
setReaderType
setSourceDir
withOutputFields
Output field names. Number of fields depends upon the reader type
ack
canCommitNow
checkValidReader
close
closeReaderAndResetTrackers

Popular in Java

Making http requests using okhttp
onCreateOptionsMenu (Activity)
runOnUiThread (Activity)
getContentResolver (Context)
Color (java.awt)
The Color class is used encapsulate colors in the default sRGB color space or colors in arbitrary co
URLEncoder (java.net)
This class is used to encode a string using the format required by application/x-www-form-urlencoded
Connection (java.sql)
A connection represents a link from a Java application to a database. All SQL statements and results
SQLException (java.sql)
An exception that indicates a failed JDBC operation. It provides the following information about pro
Date (java.util)
A specific moment in time, with millisecond precision. Values typically come from System#currentTime
StringTokenizer (java.util)
The string tokenizer class allows an application to break a string into tokens. The tokenization met

How to use commitProgressmethodin org.apache.storm.hdfs.spout.HdfsSpout

Best Java code snippets using org.apache.storm.hdfs.spout.HdfsSpout.commitProgress (Showing top 4 results out of 315)

How to use
commitProgress
method
in
org.apache.storm.hdfs.spout.HdfsSpout