LIMA
Libre Multilingual Analyzer — C++ API
Loading...
Searching...
No Matches
deeplima::segmentation Namespace Reference

Namespaces

namespace  eigen_impl
 
namespace  impl
 
namespace  train
 

Classes

class  CoNLLUReader
 
class  FormattedReaderBase
 
class  ISegmentation
 
struct  token_pos
 

Typedefs

typedef std::function< void(const std::vector< token_pos > &tokens, uint32_t len) > segmentation_callback_t
 

Enumerations

enum  segm_tag_t : uint8_t {
  X = 0x00 , B = 0x01 , I = 0x02 , E = 0x03 ,
  S = 0x04 , max_tok_tag = 0x05 , E_EOS = 0x05 , S_EOS = 0x06 ,
  max_segm_tag = 0x07 , E_MWT = 0x07 , S_MWT = 0x08 , E_EOS_MWT = 0x09 ,
  S_EOS_MWT = 0x0A , max_segm_mwt_tag = 0x0B
}
 

Typedef Documentation

◆ segmentation_callback_t

typedef std::function< void (const std::vector<token_pos>& tokens, uint32_t len) > deeplima::segmentation::segmentation_callback_t

Definition at line 66 of file segmentation_decoder.h.

Enumeration Type Documentation

◆ segm_tag_t

Enumerator
X 
B 
I 
E 
S 
max_tok_tag 
E_EOS 
S_EOS 
max_segm_tag 
E_MWT 
S_MWT 
E_EOS_MWT 
S_EOS_MWT 
max_segm_mwt_tag 

Definition at line 68 of file segmentation_decoder.h.