public class BasicTokenStream extends Object implements TokenStream
| Modifier and Type | Field and Description |
|---|---|
protected CharacterStream |
characterStream |
protected Token |
currentToken |
| Constructor and Description |
|---|
BasicTokenStream(Reader reader) |
| Modifier and Type | Method and Description |
|---|---|
protected static boolean |
isNumberCharacter(char x) |
protected static boolean |
isQuoteCharacter(char x) |
protected static boolean |
isTokenCharacter(char x) |
protected Token |
parseNextToken() |
Token |
peek()
Examine the current token.
|
void |
skip()
Skip the current token.
|
protected CharacterStream characterStream
protected Token currentToken
public BasicTokenStream(Reader reader)
public Token peek() throws ScriptException
TokenStreampeek in interface TokenStreamScriptExceptionpublic void skip()
TokenStreamskip in interface TokenStreamprotected Token parseNextToken() throws ScriptException
ScriptExceptionprotected static boolean isQuoteCharacter(char x)
protected static boolean isNumberCharacter(char x)
protected static boolean isTokenCharacter(char x)