ngramperplexity − Apply n-gram model to input fst archive.
Apply n−gram model to input fst archive.
ngramperplexity [−−options] ngram.fst [in.far [out.txt]]
−−OOV_class_size: type = double, default = 10000 |
Number of members of OOV class
−−OOV_probability: type = double, default = 0 |
Unigram probability for OOVs
−−OOV_symbol: type = string, default = "" |
Existing symbol for OOV class
−−context_pattern: type = string, default = "" |
Restrict perplexity computation to contexts defined by pattern (default: no restriction)
−−use_phimatcher: type = bool, default = false |
Use phi matcher and composition
−−help: type = bool, default = false |
show usage information
−−helpshort: type = bool, default = false |
show brief usage information
−−tmpdir: type = string, default = "/tmp" |
temporary directory
−−v: type = int32, default = 0 |
verbose level
−−fst_align: type = bool, default = false |
Write FST data aligned where appropriate
−−fst_default_cache_gc: type = bool, default = true |
Enable garbage collection of cache
−−fst_default_cache_gc_limit: type = int64, default = 1048576 |
Cache byte size that triggers garbage collection
−−fst_read_mode: type = string, default = "read" |
Default file reading mode for mappable files
−−fst_verify_properties: type = bool, default = false |
Verify fst properties queried by TestProperties
−−fst_weight_parentheses: type = string, default = "" |
Characters enclosing the first weight of a printed composite weight (e.g. pair weight, tuple weight and derived classes) to ensure proper I/O of nested composite weights; must have size 0 (none) or 2 (open and close parenthesis)
−−fst_weight_separator: type = string, default = "," |
Character separator between printed composite weights; must be a single character
−−save_relabel_ipairs: type = string, default = "" |
Save input relabel pairs to file
−−save_relabel_opairs: type = string, default = "" |
Save output relabel pairs to file
−−end_symbol: type = string, default = "</s>" |
Class label for sentence start
−−start_symbol: type = string, default = "<s>" |
Class label for sentence start
−−fst_compat_symbols: type = bool, default = true |
Require symbol tables to match when appropriate
−−fst_field_separator: type = string, default = " " |
Set of characters used as a separator between printed fields
−−fst_error_fatal: type = bool, default = true |
FST errors are fatal; o.w. return objects flagged as bad:
e.g., FSTs − kError prop. true, FST weights − not a Member()
−−ngram_error_fatal: type = bool, default = true |
NGram errors are fatal; o.w. return objects flagged as bad:
e.g., NGramModel::Error() returns true.