![]() |
LIMA
Libre Multilingual Analyzer — C++ API
|
#include <deeplima/segmentation/impl/segmentation_impl.h>
Public Types | |
| typedef std::function< bool(uint8_t *buffer, int32_t &read, int32_t max) > | read_callback_t |
Public Member Functions | |
| virtual void | parse_from_stream (const read_callback_t fn)=0 |
| virtual void | register_handler (const segmentation_callback_t fn)=0 |
| virtual void | finalize ()=0 |
| Cleanup all remaining locks if any. | |
| virtual bool | predicts_mwt () const |
| Whether this segmenter predicts multiword-token surfaces (sets the token_flags_t::multiword flag). | |
| virtual | ~ISegmentation () |
Definition at line 31 of file segmentation_impl.h.
| typedef std::function< bool (uint8_t* buffer, int32_t& read, int32_t max) > deeplima::segmentation::ISegmentation::read_callback_t |
Definition at line 36 of file segmentation_impl.h.
|
inlinevirtual |
Definition at line 48 of file segmentation_impl.h.
|
pure virtual |
Cleanup all remaining locks if any.
Implemented in deeplima::segmentation::CoNLLUReader, and deeplima::segmentation::impl::SegmentationImpl.
|
pure virtual |
Implemented in deeplima::segmentation::CoNLLUReader, and deeplima::segmentation::impl::SegmentationImpl.
|
inlinevirtual |
Whether this segmenter predicts multiword-token surfaces (sets the token_flags_t::multiword flag).
Lets the MWT expander gate expansion on the model's prediction; a segmenter that can't predict it returns false.
Reimplemented in deeplima::segmentation::impl::SegmentationImpl.
Definition at line 46 of file segmentation_impl.h.
|
pure virtual |