MARKOV SOURCE MODELING OF TEXT GENERATION.

Abstract

This paper is an attempt to direct a hypothesis search in a language model for a sentence that was spoken. It can provide the statistical basis for efficient encoding and text storage during transmission. Here an algorithm is presented which leads to the discovery of word string equivalence classes and for the automatic extraction of statistics for the production of rules in ambiguous context-free grammars.