E. E. Alvarez, Estimation in stationary Markov renewal processes, with application to earthquake forecasting in Turkey, Methodology and Computing in Applied Probability, vol.7, issue.1, pp.119-130, 2005.

V. S. Barbu, A. Karagrigoriou, and A. Makrides, Semi-Markov modelling for multi-state systems, Methodology and Computing in Applied Probability, vol.19, pp.1011-1028, 2016.

V. S. Barbu and N. Limnios, Parametric and semiparametric models with applications to reliability, survival analysis and quality of life, Collection Statistics for Industry and Technology, pp.487-502, 2004.

V. S. Barbu and N. Limnios, Nonparametric estimation for failure rate functions of discrete time semi-Markov processes, pp.53-72, 2006.

V. S. Barbu and N. Limnios, Reliability of semi-Markov systems in discrete time: modeling and estimation, pp.369-380, 2008.
URL : https://hal.archives-ouvertes.fr/hal-00530335

V. S. Barbu and N. Limnios, Semi-Markov chains and hidden semi-Markov models toward applications-their use in reliability and DNA analysis, Lecture Notes in Statistics, vol.191, 2008.
URL : https://hal.archives-ouvertes.fr/hal-00530330

V. S. Barbu and N. Limnios, Some algebraic methods in semi-Markov processes, Algebraic methods in statistics and probability, vol.2, pp.19-35, 2010.
URL : https://hal.archives-ouvertes.fr/hal-00530333

R. E. Barlow, A. W. Marshall, and F. Prochan, Properties of probability distributions with monotone hazard rate, Ann Math Statist, vol.34, pp.375-389, 1963.

O. Cappé, E. Moulines, and T. Ryden, Inference in hidden Markov models, 2005.

J. Chiquet and N. Limnios, Estimating stochastic dynamical systems driven by a continuous-time jump Markov process, Methodology and Computing in Applied Probability, vol.8, issue.4, pp.431-447, 2006.
URL : https://hal.archives-ouvertes.fr/hal-00260731

O. Chryssaphinou, N. Limnios, and S. Malefaki, Multi-state reliability systems under discrete time semi-Markovian hypothesis, IEEE Transactions on Reliability, vol.60, issue.1, pp.80-87, 2011.

G. D'amico, F. Gismondi, J. Janssen, and R. Manca, Discrete time homogeneous Markov processes for the study of the basic risk processes, Methodology and Computing in Applied Probability, vol.17, issue.4, pp.983-998, 2015.

G. D'amico, F. Petroni, and F. Prattico, Performance analysis of second order semi-Markov chains: an application to wind energy production, Methodology and Computing in Applied Probability, vol.17, issue.3, pp.781-794, 2015.

Y. Hou, N. Limnios, and W. Schön, On the existence and uniqueness of solution of MRE and applications, Methodology and Computing in Applied Probability, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01273596

J. G. Kemeny, J. L. Snell, and A. W. Knapp, Denumerable Markov chains, vol.40, 1976.

V. P. Koutras, S. Malefaki, and A. N. Platis, Optimization of the dependability and performance measures of a generic model for multistate deteriorating systems under maintenance, Reliability Engineering and System Safety, vol.166, pp.73-86, 2017.

G. Levitin, The universal generating function in reliability analysis and optimization, 2005.

N. Limnios and G. Opri?an, Semi-Markov processes and reliability, 2001.

N. Limnios and B. Ouhbi, Empirical estimators of reliability and related functions for semi-Markov systems, Mathematical and statistical methods in reliability, vol.7, pp.469-484, 2003.

N. Limnios and B. Ouhbi, Nonparametric estimation of some important indicators in reliability for semi-Markov processes, Stat Methodol, vol.3, pp.341-350, 2006.

N. Limnios, Reliability measures of semi-Markov systems with general state space, Methodology and Computing in Applied Probability, vol.14, issue.4, pp.895-917, 2012.

A. Lisnianski, Estimation of boundary points for continuum-state system reliability measures, Reliability Engineering and System Safety, vol.74, pp.81-88, 2001.

A. Lisnianski, I. Frenkel, and Y. Ding, Multi-state system reliability analysis and optimization for engineers and industrial managers, 2010.

. Springer,

A. Lisnianski, D. Elmakias, D. Laredo, B. Haim, and H. , A multi-state Markov model for a short-term reliability analysis of a power generating unit, Reliability Engineering and System Safety, vol.98, issue.1, pp.1-6, 2012.

A. Lisnianski and G. Levitin, Multi-state system reliability: assessment, optimization and applications, 2003.

I. L. Macdonald and W. Zucchini, Hidden Markov and other models for discrete-valued time series, 1997.

E. Mathieu, Y. Foucher, P. Dellamonica, and J. P. Daures, Parametric and non homogeneous semi-Markov process for HIV control, Methodology and Computing in Applied Probability, vol.9, issue.3, pp.389-397, 2007.

B. Natvig, Multistate systems reliability. Theory with applications, 2011.

B. Ouhbi and N. Limnios, Non-parametric estimation for semi-Markov processes based on its hazard rate functions, Statist Infer Stoch Processes, vol.2, issue.2, pp.151-173, 1999.

D. Roy and R. Gupta, Classification of discrete lives, Microelectron Reliabil, vol.32, issue.10, pp.1459-1473, 1992.

J. E. Ruiz-castro, Markov counting and reward processes for analysing the performance of a complex system subject to random inspections, Reliability Engineering and System Safety, vol.145, pp.155-168, 2016.

A. Sadek and N. Limnios, Asymptotic properties for maximum likelihood estimators for reliability and failure rates of Markov chains, Comm Statist Theory Methods, vol.31, issue.10, pp.1837-1861, 2002.

A. Sadek and N. Limnios, Nonparametric estimation of reliability and survival function for continuous-time finite Markov processes, J Statistical Planning and Inference, vol.133, issue.1, pp.1-21, 2005.

D. Silvestrov and R. Manca, Reward algorithms for semi-Markov processes, Methodology and Computing in Applied Probability, 2017.

G. Vasiliadis and G. Tsaklidis, On the distributions of the state sizes of closed continuous time homogeneous Markov systems, Methodology and Computing in Applied Probability, vol.11, issue.4, pp.561-582, 2008.

P. Vassiliou and T. P. Moysiadis, G-inhomogeneous Markov systems of high order, Methodology and Computing in Applied Probability, vol.12, issue.2, pp.271-292, 2010.

N. Vergne, Drifting Markov models with polynomial drift and applications to DNA sequences, Statistical Applications in Genetics Molecular Biology, vol.7, issue.1, 2008.
URL : https://hal.archives-ouvertes.fr/hal-02337190

I. Votsi, N. Limnios, G. Tsaklidis, and E. Papadimitriou, Estimation of the expected number of earthquake occurrences based on semi-Markov models, Methodology and Computing in Applied Probability, vol.14, issue.3, pp.685-703, 2012.
URL : https://hal.archives-ouvertes.fr/hal-01635178

M. Xie, O. Gaudoin, and C. Bracquemond, Redefining failure rate function for discrete distributions, Int J Reliabil, Qual, Safety Eng, vol.9, issue.3, pp.275-285, 2002.