LIMA
Libre Multilingual Analyzer — C++ API
Loading...
Searching...
No Matches
Lima::DocumentsReader::TokensStream Class Reference

This is a stream of tokens. More...

#include <linguisticProcessing/core/DocumentsReader/tokensstream.h>

Inheritance diagram for Lima::DocumentsReader::TokensStream:

Public Member Functions

 TokensStream ()
 
 TokensStream (const TokensStream &)
 
TokensStream & operator= (const TokensStream &)
 
virtual ~TokensStream ()
 
void copy (const TokensStream &)
 
void clear ()
 
void push (const IndexToken &)
 
bool hasToken () const
 Tests if a token is available.
 
IndexToken * nextToken ()
 Returns the next token.
 

Detailed Description

This is a stream of tokens.

It is fed up by the linguistic analysis and emptied when reading a document during indexing Gael de Chalendar

Definition at line 21 of file tokensstream.h.

Constructor & Destructor Documentation

◆ TokensStream() [1/2]

Lima::DocumentsReader::TokensStream::TokensStream ( )

Definition at line 15 of file tokensstream.cpp.

◆ TokensStream() [2/2]

Lima::DocumentsReader::TokensStream::TokensStream ( const TokensStream &  t)

Definition at line 21 of file tokensstream.cpp.

◆ ~TokensStream()

Lima::DocumentsReader::TokensStream::~TokensStream ( )
virtual

Definition at line 37 of file tokensstream.cpp.

Member Function Documentation

◆ clear()

void Lima::DocumentsReader::TokensStream::clear ( )

Definition at line 50 of file tokensstream.cpp.

◆ copy()

void Lima::DocumentsReader::TokensStream::copy ( const TokensStream &  t)

Definition at line 44 of file tokensstream.cpp.

◆ hasToken()

bool Lima::DocumentsReader::TokensStream::hasToken ( ) const

Tests if a token is available.

Definition at line 67 of file tokensstream.cpp.

◆ nextToken()

IndexToken * Lima::DocumentsReader::TokensStream::nextToken ( )

Returns the next token.

It will be no more available

Definition at line 75 of file tokensstream.cpp.

◆ operator=()

TokensStream & Lima::DocumentsReader::TokensStream::operator= ( const TokensStream &  t)

Definition at line 27 of file tokensstream.cpp.

◆ push()

void Lima::DocumentsReader::TokensStream::push ( const IndexToken &  t)

Definition at line 60 of file tokensstream.cpp.


The documentation for this class was generated from the following files: