Class java.io.StreamTokenizer 
All Packages  Class Hierarchy  This Package  Previous  Next  Index

Class java.io.StreamTokenizer 

java.lang.Object
|
   +----java.io.StreamTokenizer
public class StreamTokenizer
extends Object
A class to turn an input stream into a stream of tokens. There are a number of methods that define the lexical syntax of tokens.

Variable Index

o nval
The number value.
o sval
The Stream value.
o TT_EOF
The End-of-file token.
o TT_EOL
The End-of-line token.
o TT_NUMBER
The number token.
o TT_WORD
The word token.
o ttype
The type of the last token returned.

Constructor Index

o StreamTokenizer(InputStream)
Creates a stream tokenizer that parses the specified input stream.

Method Index

o commentChar(int)
Specifies that this character starts a single line comment.
o eolIsSignificant(boolean)
If the flag is true, end-of-lines are significant (TT_EOL will be returned by nexttoken).
o lineno()
Return the current line number.
o lowerCaseMode(boolean)
Examines a boolean to decide whether TT_WORD tokens are forced to be lower case.
o nextToken()
Parses a token from the input stream.
o ordinaryChar(int)
Specifies that this character is 'ordinary': it removes any significance as a word, comment, string, whitespace or number character.
o ordinaryChars(int, int)
Specifies that characters in this range are 'ordinary'.
o parseNumbers()
Specifies that numbers should be parsed.
o pushBack()
Pushes back a stream token.
o quoteChar(int)
Specifies that matching pairs of this character delimit String constants.
o resetSyntax()
Resets the syntax table so that all characters are special.
o slashSlashComments(boolean)
If the flag is true, recognize C++ style( // ) comments.
o slashStarComments(boolean)
If the flag is true, recognize C style( /* ) comments.
o toString()
Returns the String representation of the stream token.
o whitespaceChars(int, int)
Specifies that characters in this range are whitespace characters.
o wordChars(int, int)
Specifies that characters in this range are word characters.

Variables

o ttype 
public int ttype
The type of the last token returned. It's value will either be one of the following TT_* constants, or a single character. For example, if '+' is encountered and is not a valid word character, ttype will be '+'
o TT_EOF 
public final static int TT_EOF
The End-of-file token.
o TT_EOL 
public final static int TT_EOL
The End-of-line token.
o TT_NUMBER 
public final static int TT_NUMBER
The number token. This value is in nval.
o TT_WORD 
public final static int TT_WORD
The word token. This value is in sval.
o sval 
public String sval
The Stream value.
o nval 
public double nval
The number value.

Constructors

o StreamTokenizer 
public StreamTokenizer(InputStream I)
Creates a stream tokenizer that parses the specified input stream. By default, it recognizes numbers, Strings quoted with single and double quotes, and all the alphabetics.
Parameters:
I - the input stream

Methods

o resetSyntax 
public void resetSyntax()
Resets the syntax table so that all characters are special.
o wordChars 
public void wordChars(int low,
                        int hi)
Specifies that characters in this range are word characters.
Parameters:
low - the low end of the range
hi - the high end of the range
o whitespaceChars 
public void whitespaceChars(int low,
                              int hi)
Specifies that characters in this range are whitespace characters.
Parameters:
low - the low end of the range
hi - the high end of the range
o ordinaryChars 
public void ordinaryChars(int low,
                            int hi)
Specifies that characters in this range are 'ordinary'. Ordinary characters mean that any significance as words, comments, strings, whitespaces or number characters are removed. When these characters are encountered by the parser, they return a ttype equal to the character.
Parameters:
low - the low end of the range
hi - the high end of the range
o ordinaryChar 
public void ordinaryChar(int ch)
Specifies that this character is 'ordinary': it removes any significance as a word, comment, string, whitespace or number character. When encountered by the parser, it returns a ttype equal to the character.
Parameters:
ch - the character
o commentChar 
public void commentChar(int ch)
Specifies that this character starts a single line comment.
Parameters:
ch - the character
o quoteChar 
public void quoteChar(int ch)
Specifies that matching pairs of this character delimit String constants. When a String constant is recognized, ttype will be the character that delimits the String, and sval will have the body of the String.
Parameters:
ch - the character
o parseNumbers 
public void parseNumbers()
Specifies that numbers should be parsed. This method accepts double precision floating point numbers and returns a ttype of TT_NUMBER with the value in nval.
o eolIsSignificant 
public void eolIsSignificant(boolean flag)
If the flag is true, end-of-lines are significant (TT_EOL will be returned by nexttoken). If false, they will be treated as whitespace.
o slashStarComments 
public void slashStarComments(boolean flag)
If the flag is true, recognize C style( /* ) comments.
o slashSlashComments 
public void slashSlashComments(boolean flag)
If the flag is true, recognize C++ style( // ) comments.
o lowerCaseMode 
public void lowerCaseMode(boolean fl)
Examines a boolean to decide whether TT_WORD tokens are forced to be lower case.
Parameters:
fl - the boolean flag
o nextToken 
public int nextToken() throws IOException
Parses a token from the input stream. The return value is the same as the value of ttype. Typical clients of this class first set up the syntax tables and then sit in a loop calling nextToken to parse successive tokens until TT_EOF is returned.
o pushBack 
public void pushBack()
Pushes back a stream token.
o lineno 
public int lineno()
Return the current line number.
o toString 
public String toString()
Returns the String representation of the stream token.
Overrides:
toString in class Object 
All Packages  Class Hierarchy  This Package  Previous  Next  Index