![]() |
LIMA
Libre Multilingual Analyzer — C++ API
|
This is a stream of tokens. More...
#include <linguisticProcessing/core/DocumentsReader/tokensstream.h>
Public Member Functions | |
| TokensStream () | |
| TokensStream (const TokensStream &) | |
| TokensStream & | operator= (const TokensStream &) |
| virtual | ~TokensStream () |
| void | copy (const TokensStream &) |
| void | clear () |
| void | push (const IndexToken &) |
| bool | hasToken () const |
| Tests if a token is available. | |
| IndexToken * | nextToken () |
| Returns the next token. | |
This is a stream of tokens.
It is fed up by the linguistic analysis and emptied when reading a document during indexing Gael de Chalendar
Definition at line 21 of file tokensstream.h.
| Lima::DocumentsReader::TokensStream::TokensStream | ( | ) |
Definition at line 15 of file tokensstream.cpp.
| Lima::DocumentsReader::TokensStream::TokensStream | ( | const TokensStream & | t | ) |
Definition at line 21 of file tokensstream.cpp.
|
virtual |
Definition at line 37 of file tokensstream.cpp.
| void Lima::DocumentsReader::TokensStream::clear | ( | ) |
Definition at line 50 of file tokensstream.cpp.
| void Lima::DocumentsReader::TokensStream::copy | ( | const TokensStream & | t | ) |
Definition at line 44 of file tokensstream.cpp.
| bool Lima::DocumentsReader::TokensStream::hasToken | ( | ) | const |
Tests if a token is available.
Definition at line 67 of file tokensstream.cpp.
| IndexToken * Lima::DocumentsReader::TokensStream::nextToken | ( | ) |
Returns the next token.
It will be no more available
Definition at line 75 of file tokensstream.cpp.
| TokensStream & Lima::DocumentsReader::TokensStream::operator= | ( | const TokensStream & | t | ) |
Definition at line 27 of file tokensstream.cpp.
| void Lima::DocumentsReader::TokensStream::push | ( | const IndexToken & | t | ) |
Definition at line 60 of file tokensstream.cpp.