 |
Article dans une revue
Escort Distributions Minimizing the Kullback-Leibler Divergence for a Large Deviations Principle and Tests of Entropy Level
Abstract : Kullback–Leibler divergence is minimized among finite distributions with finite state spaces under various constraints of Shannon entropy. Minimization is closely linked to escort distributions whose main properties related to entropy are proven. This allows a large deviations principle to be stated for the sequence of plug-in empirical estimators of Shannon entropy of any finite distributions. Since no closed-form expression of the rate function can be obtained, an explicit approximating function is constructed. This approximation is accurate enough to provide good results in all applications. Tests of entropy level, using both the large deviations principle and the minimization results, are constructed and shown to have a good behavior in terms of errors.
https://hal-normandie-univ.archives-ouvertes.fr/hal-02299551
Contributeur : Valerie Girardin <>
Soumis le : vendredi 27 septembre 2019 - 18:12:59
Dernière modification le : lundi 27 avril 2020 - 16:14:03
Contributeur : Valerie Girardin <>
Soumis le : vendredi 27 septembre 2019 - 18:12:59
Dernière modification le : lundi 27 avril 2020 - 16:14:03
