NGRAMMERGE

NAME

ngrammerge − Merge ngram models.

DESCRIPTION

Merge ngram models.

SYNOPSIS

ngrammerge [−−options] −ofile=out.fst in1.fst in2.fst [in3.fst ...]

OPTIONS

−−alpha: type = double, default = 1

Weight for first FST

−−backoff_label: type = int64, default = 0

Backoff label

−−beta: type = double, default = 1

Weight for second (and subsequent) FST(s)

−−check_consistency: type = bool, default = false

Check model consistency

−−complete: type = bool, default = false

Complete partial models

−−context_pattern: type = string, default = ""

Context pattern for second FST

−−contexts: type = string, default = ""

Context patterns file (all FSTs)

−−method: type = string, default = "count_merge"

One of: "context_merge", "count_merge", "model_merge" "bayes_model_merge", "histogram_merge"

−−norm_eps: type = double, default = 0.001

Normalization check epsilon

−−normalize: type = bool, default = false

Normalize resulting model

−−ofile: type = string, default = ""

Output file

−−round_to_int: type = bool, default = false

Round all merged counts to integers

−−help: type = bool, default = false

show usage information

−−helpshort: type = bool, default = false

show brief usage information

−−tmpdir: type = string, default = "/tmp"

temporary directory

−−v: type = int32, default = 0

verbose level

−−fst_align: type = bool, default = false

Write FST data aligned where appropriate

−−fst_default_cache_gc: type = bool, default = true

Enable garbage collection of cache

−−fst_default_cache_gc_limit: type = int64, default = 1048576

Cache byte size that triggers garbage collection

−−fst_read_mode: type = string, default = "read"

Default file reading mode for mappable files

−−fst_verify_properties: type = bool, default = false

Verify fst properties queried by TestProperties

−−fst_weight_parentheses: type = string, default = ""

Characters enclosing the first weight of a printed composite weight (e.g. pair weight, tuple weight and derived classes) to ensure proper I/O of nested composite weights; must have size 0 (none) or 2 (open and close parenthesis)

−−fst_weight_separator: type = string, default = ","

Character separator between printed composite weights; must be a single character

−−save_relabel_ipairs: type = string, default = ""

Save input relabel pairs to file

−−save_relabel_opairs: type = string, default = ""

Save output relabel pairs to file

−−end_symbol: type = string, default = "</s>"

Class label for sentence start

−−start_symbol: type = string, default = "<s>"

Class label for sentence start

−−fst_compat_symbols: type = bool, default = true

Require symbol tables to match when appropriate

−−fst_field_separator: type = string, default = " "

Set of characters used as a separator between printed fields

−−fst_error_fatal: type = bool, default = true

FST errors are fatal; o.w. return objects flagged as bad:

e.g., FSTs − kError prop. true, FST weights − not a Member()

−−ngram_error_fatal: type = bool, default = true

NGram errors are fatal; o.w. return objects flagged as bad:

e.g., NGramModel::Error() returns true.