Jeffreys versus Shtarkov distributions associated with some natural exponential families

Shaul K. Bar-Lev, Daoud Bshouty, Peter Grünwald, Peter Harremoës

Research output: Contribution to journalArticlepeer-review

Abstract

Jeffreys and Shtarkov distributions play an important role in universal coding and minimum description length (MDL) inference, two central areas within the field of information theory. It was recently discovered that in some situations Shtarkov distributions exist while Jeffreys distributions do not. To demonstrate some of these situations we consider in this note the class of natural exponential families (NEF's) and present a general result which enables us to construct numerous classes of infinitely divisible NEF's for which Shtarkov distributions exist and Jeffreys distributions do not. The method used to obtain our general results is based on the variance functions of such NEF's. We first present two classes of parametric NEF's demonstrating our general results and then generalize them to obtain numerous multiparameter classes of the same type.

Original languageEnglish
Pages (from-to)638-643
Number of pages6
JournalStatistical Methodology
Volume7
Issue number6
DOIs
StatePublished - Nov 2010

Keywords

  • Jeffreys prior
  • Natural exponential family
  • Regret
  • Shtarkov distribution
  • Variance function

ASJC Scopus subject areas

  • Statistics and Probability

Fingerprint

Dive into the research topics of 'Jeffreys versus Shtarkov distributions associated with some natural exponential families'. Together they form a unique fingerprint.

Cite this