Applied Probability and Stochastic Processes

This book is a result of teaching stochastic processes to junior and senior undergr- uates and beginning graduate students over many years. In teaching such a course, we have realized a need to furnish students with material that gives a mathematical presentation while at the same time providing proper foundations to allow students to build an intuitive feel for probabilistic reasoning. We have tried to maintain a b- ance in presenting advanced but understandable material that sparks an interest and challenges students, without the discouragement that often comes as a consequence of not understanding the material. Our intent in this text is to develop stochastic p- cesses in an elementary but mathematically precise style and to provide suf?cient examples and homework exercises that will permit students to understand the range of application areas for stochastic processes. We also practice active learning in the classroom. In other words, we believe that the traditional practice of lecturing continuously for 50 to 75 minutes is not a very effective method for teaching. Students should somehow engage in the subject m- ter during the teaching session. One effective method for active learning is, after at most 20 minutes of lecture, to assign a small example problem for the students to work and one important tool that the instructor can utilize is the computer. So- times we are fortunate to lecture students in a classroom containing computers with a spreadsheet program, usually Microsoft¿s Excel.

Gives the reader an intuitive understanding of probabilistic reasoning as well as an understanding of mathematical concepts

Basic Probability Review.- Basics of Monte Carlo Simulation.- Basic Statistical Review.- Poisson Processes.- Markov Chains.- Markov Processes.- Queueing Processes.- Queueing Networks.- Event-Driven Simulation and Output Analyses.- Inventory Theory.- Replacement Theory.- Markov Decision Processes.- Advanced Queues.