An Experimental Study of Advice in Sequential Decision-Making under Uncertainty

Abstract : We consider sequential decision making problems under uncertainty , in which a user has a general idea of the task to achieve, and gives advice to an agent in charge of computing an optimal policy. Many different notions of advice have been proposed in somewhat different settings, especially in the field of inverse reinforcement learning and for resolution of Markov Decision Problems with Imprecise Rewards. Two key questions are whether the advice required by a specific method is natural for the user to give, and how much advice is needed for the agent to compute a good policy, as evaluated by the user. We give a unified view of a number of proposals made in the literature, and propose a new notion of advice, which corresponds to a user telling why she would take a given action in a given state. For all these notions, we discuss their naturalness for a user and the integration of advice. We then report on an experimental study of the amount of advice needed for the agent to compute a good policy. Our study shows in particular that continual interaction between the user and the agent is worthwhile, and sheds light on the pros and cons of each type of advice.
Type de document :
Communication dans un congrès
32nd AAAI Conference on Artificial Intelligence, Feb 2018, New Orleans, United States
Liste complète des métadonnées

Littérature citée [22 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01646200
Contributeur : Bruno Zanuttini <>
Soumis le : mercredi 6 décembre 2017 - 00:21:26
Dernière modification le : mardi 5 juin 2018 - 10:14:42

Fichier

Florian-Benavent-pour-HAL.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01646200, version 1

Citation

Florian Benavent, Bruno Zanuttini. An Experimental Study of Advice in Sequential Decision-Making under Uncertainty. 32nd AAAI Conference on Artificial Intelligence, Feb 2018, New Orleans, United States. 〈hal-01646200〉

Partager

Métriques

Consultations de la notice

191

Téléchargements de fichiers

179