deeplima::CoNLLU::Annotation::token_t Struct Reference

#include </home/runner/work/lima/lima/deeplima/libs/conllu/treebank.h>

Public Types
enum	token_flags_t : uint8_t {   none = 0x00 , sentence_brk = 0x01 , paragraph_brk = 0x02 , multiword = 0x04 ,   max_flags }

Public Member Functions
	token_t ()
	token_t (size_t line_idx, size_t pos, uint16_t len=0)
bool	eos () const
bool	is_multiword () const

Public Attributes
size_t	m_line_idx
size_t	m_pos
uint16_t	m_len
token_flags_t	m_flags

Detailed Description

Definition at line 87 of file treebank.h.

Member Enumeration Documentation

token_flags_t

enum deeplima::CoNLLU::Annotation::token_t::token_flags_t : uint8_t

Enumerator
none
sentence_brk
paragraph_brk
multiword
max_flags

Definition at line 89 of file treebank.h.

Constructor & Destructor Documentation

token_t() [1/2]

deeplima::CoNLLU::Annotation::token_t::token_t ( )

inline

Definition at line 98 of file treebank.h.

token_t() [2/2]

deeplima::CoNLLU::Annotation::token_t::token_t ( size_t  line_idx, size_t  pos, uint16_t  len = 0  )

inline

Definition at line 100 of file treebank.h.

Member Function Documentation

eos()

bool deeplima::CoNLLU::Annotation::token_t::eos ( ) const

inline

Definition at line 103 of file treebank.h.

is_multiword()

bool deeplima::CoNLLU::Annotation::token_t::is_multiword ( ) const

inline

Definition at line 108 of file treebank.h.

Member Data Documentation

m_flags

token_flags_t deeplima::CoNLLU::Annotation::token_t::m_flags

Definition at line 116 of file treebank.h.

m_len

uint16_t deeplima::CoNLLU::Annotation::token_t::m_len

Definition at line 115 of file treebank.h.

m_line_idx

size_t deeplima::CoNLLU::Annotation::token_t::m_line_idx

Definition at line 113 of file treebank.h.

m_pos

size_t deeplima::CoNLLU::Annotation::token_t::m_pos

Definition at line 114 of file treebank.h.

---

The documentation for this struct was generated from the following file:

• deeplima/libs/conllu/treebank.h