On the Foundations of Multinomial Sequence Based Estimation
This paper deals with the relatively new field of sequence-based estimation which involves utilizing both the information in the observations and in their sequence of appearance. Our intention is to obtain Maximum Likelihood estimates by “extracting” the information contained in the observations when perceived as a sequence rather than as a set. The results of  introduced the concepts of Sequence Based Estimation (SBE) for the Binomial distribution. This current paper generalizes these results for the multinomial “two-at-a-time” scenario. We invoke a novel phenomenon called “Occlusion” that can be described as follows: By “concealing” certain observations, we map the estimation problem onto a lower-dimensional binomial space. Once these occluded SBEs have been computed, we demonstrate how the overall Multinomial SBE (MSBE) can be obtained by mapping several lower-dimensional estimates onto the original higher-dimensional space. We formally prove and experimentally demonstrate the convergence of the corresponding estimates.
KeywordsEstimation using sequential information Sequence Based Estimation Estimation of multinomials Fused estimation methods Sequential information
- 8.Goldberg, S.: Probability: An Introduction. Prentice-Hall, Englewood Cliffs (1960)Google Scholar
- 9.Herbrich, R.: Learning Kernel Classifiers: Theory and Algorithms. MIT Press, Cambridge (2001)Google Scholar
- 16.Oommen, B.J., Kim, S-W.: Occlusion-based estimation of independent multinomial random variables using occurrence and sequential information. To be submitted for PublicationGoogle Scholar
- 17.Ross, S.: Introduction to Probability Models, 2nd edn. Academic Press, Orlando (2002)Google Scholar
- 19.Sprinthall, R.: Basic Statistical Analysis. Allyn and Bacon, Boston (2002)Google Scholar