LIMA
Libre Multilingual Analyzer — C++ API
Loading...
Searching...
No Matches
deeplima::WordDictBuilderImpl< DataSet, FeatExtractor > Class Template Reference

#include </home/runner/work/lima/lima/deeplima/libs/tasks/common/word_dict_builder.h>

Public Member Functions

FeatExtractor preprocess (const DataSet &src, const std::string &feat_extractor_init="")
 
DictsHolder process (const DataSet &src, int32_t min_ipm, const std::string unk_str="<<UNK>>")
 
DictsHolder process (const DataSet &src, const FeatExtractor &fe, int32_t min_ipm, const std::string unk_str="<<UNK>>")
 

Static Protected Member Functions

static float ipm (uint64_t count, uint64_t total)
 

Detailed Description

template<class DataSet, class FeatExtractor>
class deeplima::WordDictBuilderImpl< DataSet, FeatExtractor >

Definition at line 19 of file word_dict_builder.h.

Member Function Documentation

◆ ipm()

template<class DataSet , class FeatExtractor >
static float deeplima::WordDictBuilderImpl< DataSet, FeatExtractor >::ipm ( uint64_t  count,
uint64_t  total 
)
inlinestaticprotected

Definition at line 106 of file word_dict_builder.h.

◆ preprocess()

template<class DataSet , class FeatExtractor >
FeatExtractor deeplima::WordDictBuilderImpl< DataSet, FeatExtractor >::preprocess ( const DataSet &  src,
const std::string &  feat_extractor_init = "" 
)
inline

Definition at line 23 of file word_dict_builder.h.

◆ process() [1/2]

template<class DataSet , class FeatExtractor >
DictsHolder deeplima::WordDictBuilderImpl< DataSet, FeatExtractor >::process ( const DataSet &  src,
const FeatExtractor &  fe,
int32_t  min_ipm,
const std::string  unk_str = "<<UNK>>" 
)
inline

Definition at line 49 of file word_dict_builder.h.

◆ process() [2/2]

template<class DataSet , class FeatExtractor >
DictsHolder deeplima::WordDictBuilderImpl< DataSet, FeatExtractor >::process ( const DataSet &  src,
int32_t  min_ipm,
const std::string  unk_str = "<<UNK>>" 
)
inline

Definition at line 41 of file word_dict_builder.h.


The documentation for this class was generated from the following file: