Codota Logo
CommonTokenStream.seek
Code IndexAdd Codota to your IDE (free)

How to use
seek
method
in
org.antlr.v4.runtime.CommonTokenStream

Best Java code snippets using org.antlr.v4.runtime.CommonTokenStream.seek (Showing top 6 results out of 315)

  • Common ways to obtain CommonTokenStream
private void myMethod () {
CommonTokenStream c =
  • Codota IconTokenSource tokenSource;new CommonTokenStream(tokenSource)
  • Codota IconRecognizer recognizer;(CommonTokenStream) recognizer.getInputStream()
  • Smart code suggestions by Codota
}
origin: confluentinc/ksql

private ParserRuleContext getParseTree(final String sql) {
 final SqlBaseLexer sqlBaseLexer = new SqlBaseLexer(
   new CaseInsensitiveStream(CharStreams.fromString(sql)));
 final CommonTokenStream tokenStream = new CommonTokenStream(sqlBaseLexer);
 final SqlBaseParser sqlBaseParser = new SqlBaseParser(tokenStream);
 sqlBaseLexer.removeErrorListeners();
 sqlBaseLexer.addErrorListener(ERROR_LISTENER);
 sqlBaseParser.removeErrorListeners();
 sqlBaseParser.addErrorListener(ERROR_LISTENER);
 final Function<SqlBaseParser, ParserRuleContext> parseFunction = SqlBaseParser::statements;
 try {
  // first, try parsing with potentially faster SLL mode
  sqlBaseParser.getInterpreter().setPredictionMode(PredictionMode.SLL);
  return parseFunction.apply(sqlBaseParser);
 } catch (final ParseCancellationException ex) {
  // if we fail, parse with LL mode
  tokenStream.seek(0); // rewind input stream
  sqlBaseParser.reset();
  sqlBaseParser.getInterpreter().setPredictionMode(PredictionMode.LL);
  return parseFunction.apply(sqlBaseParser);
 }
}
origin: org.bitbucket.goalhub.krTools.krLanguages/swiprolog

public void switchToFullLL() {
  // First rewind the token stream
  this.tokens.seek(0);
  // Use full (custom) error reporting now
  this.parser.setErrorHandler(new ErrorStrategy4());
  this.parser.addErrorListener(this);
  // Now try full LL(*)
  this.parser.getInterpreter().setPredictionMode(PredictionMode.LL);
}
origin: stanford-futuredata/macrobase

private Node invokeParser(String name, String sql,
  Function<SqlBaseParser, ParserRuleContext> parseFunction) {
  try {
    SqlBaseLexer lexer = new SqlBaseLexer(
      new CaseInsensitiveStream(new ANTLRInputStream(sql)));
    CommonTokenStream tokenStream = new CommonTokenStream(lexer);
    SqlBaseParser parser = new SqlBaseParser(tokenStream);
    parser.addParseListener(new PostProcessor(Arrays.asList(parser.getRuleNames())));
    lexer.removeErrorListeners();
    lexer.addErrorListener(ERROR_LISTENER);
    parser.removeErrorListeners();
    parser.addErrorListener(ERROR_LISTENER);
    ParserRuleContext tree;
    try {
      // first, try parsing with potentially faster SLL mode
      parser.getInterpreter().setPredictionMode(PredictionMode.SLL);
      tree = parseFunction.apply(parser);
    } catch (ParseCancellationException ex) {
      // if we fail, parse with LL mode
      tokenStream.seek(0); // rewind input stream
      parser.reset();
      parser.getInterpreter().setPredictionMode(PredictionMode.LL);
      tree = parseFunction.apply(parser);
    }
    return new AstBuilder().visit(tree);
  } catch (StackOverflowError e) {
    throw new ParsingException(name + " is too large (stack overflow while parsing)");
  }
}
origin: harbby/sylph

tokenStream.seek(0); // rewind input stream
parser.reset();
origin: bkiers/Liqp

private ParseTree parse(LiquidLexer lexer) {
  lexer.removeErrorListeners();
  lexer.addErrorListener(new BaseErrorListener(){
    @Override
    public void syntaxError(Recognizer<?, ?> recognizer, Object offendingSymbol, int line, int charPositionInLine, String msg, RecognitionException e) {
      throw new RuntimeException(String.format("lexer error on line %s, index %s", line, charPositionInLine), e);
    }
  });
  CommonTokenStream tokens = new CommonTokenStream(lexer);
  LiquidParser parser = new LiquidParser(tokens);
  parser.removeErrorListeners();
  parser.addErrorListener(new BaseErrorListener(){
    @Override
    public void syntaxError(Recognizer<?, ?> recognizer, Object offendingSymbol, int line, int charPositionInLine, String msg, RecognitionException e) {
      throw new RuntimeException(String.format("parser error on line %s, index %s", line, charPositionInLine), e);
    }
  });
  
  parser.getInterpreter().setPredictionMode(PredictionMode.SLL);
  try {
    return parser.parse();
  } catch (Exception e) {
    tokens.seek(0);
    parser.reset();
    parser.getInterpreter().setPredictionMode(PredictionMode.LL);
    return parser.parse();
  }
}
origin: org.bitbucket.goalhub.grammar/languageTools

this.tokens.seek(0);
org.antlr.v4.runtimeCommonTokenStreamseek

Popular methods of CommonTokenStream

  • <init>
    Constructs a new CommonTokenStream using the specified token source and filtering tokens to the spec
  • getTokens
  • fill
  • get
  • getHiddenTokensToLeft
  • size
  • LA
  • getHiddenTokensToRight
  • reset
  • LB
  • getText
  • getTokenSource
  • getText,
  • getTokenSource,
  • lazyInit,
  • nextTokenOnChannel,
  • previousTokenOnChannel,
  • sync,
  • LT,
  • consume,
  • index

Popular in Java

  • Reading from database using SQL prepared statement
  • setContentView (Activity)
  • getSystemService (Context)
  • putExtra (Intent)
  • Kernel (java.awt.image)
  • MessageDigest (java.security)
    Uses a one-way hash function to turn an arbitrary number of bytes into a fixed-length byte sequence.
  • HashSet (java.util)
    This class implements the Set interface, backed by a hash table (actually a HashMap instance). It m
  • StringTokenizer (java.util)
    The string tokenizer class allows an application to break a string into tokens. The tokenization met
  • Callable (java.util.concurrent)
    A task that returns a result and may throw an exception. Implementors define a single method with no
  • Executors (java.util.concurrent)
    Factory and utility methods for Executor, ExecutorService, ScheduledExecutorService, ThreadFactory,
Codota Logo
  • Products

    Search for Java codeSearch for JavaScript codeEnterprise
  • IDE Plugins

    IntelliJ IDEAWebStormAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimAtomGoLandRubyMineEmacsJupyter
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogCodota Academy Plugin user guide Terms of usePrivacy policyJava Code IndexJavascript Code Index
Get Codota for your IDE now