Author: Carlos Polanco

Markov Chain Process (Theory and Cases)

eBook: US $59 Special Offer (PDF + Printed Copy): US $101
Printed Copy: US $71
Library License: US $236
ISBN: 978-981-5080-48-3 (Print)
ISBN: 978-981-5080-47-6 (Online)
Year of Publication: 2023
DOI: 10.2174/9789815080476123010001

Introduction

Markov Chain Process: Theory and Cases is designed for students of natural and formal sciences. It explains the fundamentals related to a stochastic process that satisfies the Markov property. It presents 10 structured chapters that provide a comprehensive insight into the complexity of this subject by presenting many examples and case studies that will help readers to deepen their acquired knowledge and relate learned theory to practice.

This book is divided into four parts. The first part thoroughly examines the definitions of probability, independent events, mutually (and not mutually) exclusive events, conditional probability, and Bayes’ theorem, which are essential elements in Markov’s theory. The second part examines the elements of probability vectors, stochastic matrices, regular stochastic matrices, and fixed points. The third part presents multiple cases in various disciplines: Predictive computational science, Urban complex systems, Computational finance, Computational biology, Complex systems theory, and Computational Science in Engineering. The last part introduces learners to Fortran 90 programs and Linux scripts.

To make the comprehension of Markov Chain concepts easier, all the examples, exercises, and case studies presented in this book are completely solved and given in a separate section.

This book serves as a textbook (either primary or auxiliary) for students required to understand Markov Chains in their courses, and as a reference book for researchers who want to learn about methods that involve Markov Processes.

Audience: Students of mathematics, advanced life sciences and formal science, researchers.

Foreword I

- Pp. i
Vladimir N. Uversky*
Download Free

Foreword II

- Pp. ii
Thomas Buhse*
Download Free

Preface

- Pp. iii-iv (2)
Carlos Polanco*
Download Free

Dedication

- Pp. v
Carlos Polanco*
Download Free

List of Symbols

- Pp. vi
Carlos Polanco*
Download Free

Probability

- Pp. 1-7 (7)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Matrix Models

- Pp. 8-21 (14)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Random Walks

- Pp. 22-27 (6)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Markov Chain Process

- Pp. 28-36 (9)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Discrete-Time Markov Chain Process

- Pp. 37-50 (14)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Continuous-Time Markov Chain Process

- Pp. 51-62 (12)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Computational Urban Issues

- Pp. 63-70 (8)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Computational Biology Issues

- Pp. 71-77 (7)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Computational Financial Issues

- Pp. 78-86 (9)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Computational Science Issues

- Pp. 87-92 (6)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Computational Medicine Issues

- Pp. 93-99 (7)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Computational Social Sciences Issues

- Pp. 100-105 (6)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Computational Operations Research Issues

- Pp. 106-111 (6)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Computational Information System Issues

- Pp. 112-117 (6)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Future Uses

- Pp. 118-120 (3)
Carlos Polanco*

PDF Price: $15

View Abstract Purchase Chapter

Solutions

- Pp. 121-140 (20)
Carlos Polanco*

PDF Price: $15

Purchase Chapter

Appendices

- Pp. 141-178 (38)
Carlos Polanco*
Download Free

References

- Pp. 179-181 (3)
Carlos Polanco*
Download Free

Subject Index

- Pp. 182-183 (2)
Carlos Polanco*
Download Free