Tanl Linguistic Pipeline

Parser::Scanner::Token Struct Reference

Represents a token recognized by the scanner. More...

#include <Tokenizer.h>

List of all members.

Public Member Functions

 Token (char const *text=0, TokenType type=(TokenType) 0)
Token const & operator= (Token const &o)
void serialize (std::ostream &stream)

Public Attributes

char const * text
 the text of the token
TokenType type
 the type of the token

Detailed Description

Represents a token recognized by the scanner.


The documentation for this struct was generated from the following files:
 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Defines
 
Copyright © 2005-2011 G. Attardi. Generated on 4 Mar 2011 by doxygen 1.6.1.