LIMA
Libre Multilingual Analyzer — C++ API
Loading...
Searching...
No Matches
deeplima::segmentation::ISegmentation Class Referenceabstract

#include <deeplima/segmentation/impl/segmentation_impl.h>

Inheritance diagram for deeplima::segmentation::ISegmentation:
deeplima::segmentation::FormattedReaderBase deeplima::segmentation::impl::SegmentationImpl deeplima::segmentation::CoNLLUReader

Public Types

typedef std::function< bool(uint8_t *buffer, int32_t &read, int32_t max) > read_callback_t
 

Public Member Functions

virtual void parse_from_stream (const read_callback_t fn)=0
 
virtual void register_handler (const segmentation_callback_t fn)=0
 
virtual void finalize ()=0
 Cleanup all remaining locks if any.
 
virtual bool predicts_mwt () const
 Whether this segmenter predicts multiword-token surfaces (sets the token_flags_t::multiword flag).
 
virtual ~ISegmentation ()
 

Detailed Description

Definition at line 31 of file segmentation_impl.h.

Member Typedef Documentation

◆ read_callback_t

typedef std::function< bool (uint8_t* buffer, int32_t& read, int32_t max) > deeplima::segmentation::ISegmentation::read_callback_t

Definition at line 36 of file segmentation_impl.h.

Constructor & Destructor Documentation

◆ ~ISegmentation()

virtual deeplima::segmentation::ISegmentation::~ISegmentation ( )
inlinevirtual

Definition at line 48 of file segmentation_impl.h.

Member Function Documentation

◆ finalize()

virtual void deeplima::segmentation::ISegmentation::finalize ( )
pure virtual

Cleanup all remaining locks if any.

Implemented in deeplima::segmentation::CoNLLUReader, and deeplima::segmentation::impl::SegmentationImpl.

◆ parse_from_stream()

virtual void deeplima::segmentation::ISegmentation::parse_from_stream ( const read_callback_t  fn)
pure virtual

◆ predicts_mwt()

virtual bool deeplima::segmentation::ISegmentation::predicts_mwt ( ) const
inlinevirtual

Whether this segmenter predicts multiword-token surfaces (sets the token_flags_t::multiword flag).

Lets the MWT expander gate expansion on the model's prediction; a segmenter that can't predict it returns false.

Reimplemented in deeplima::segmentation::impl::SegmentationImpl.

Definition at line 46 of file segmentation_impl.h.

◆ register_handler()

virtual void deeplima::segmentation::ISegmentation::register_handler ( const segmentation_callback_t  fn)
pure virtual

The documentation for this class was generated from the following file: