Home › Hardcover Books › Introduction to Stochastic Processes

Introduction to Stochastic Processes

by Chen Mu-Fa Publisher: WORLD SCIENTIFIC PUB CO INC

From Markov chains to stochastic analysis

Regular price $82.28 USD
Regular price $91.43 USD Sale price $82.28 USD
Save 10%

Hardcover New English

In stock · Dispatches in 1–2 business days
Delivery to your door
In stock·Dispatches in 1–2 business days
Standard shipping* from $4.35
Standard shipping transit* 5–8 business days after dispatch

Faster options are available.

Rates and delivery estimates depend on your destination and item quantity. Estimates are informational only; the final shipping method and rate are selected at checkout.

Secure checkout
American Express Apple Pay DiscoverGoogle Pay Mastercard PayPalVisa
30-day eligible returns Returns & refunds policy

AlbakiReads Editorial

From Markov chains to stochastic analysis

Chen Mu-Fa’s introduction brings together two major areas of probability: Markov chains and stochastic analysis. The Markov-chain section develops recurrence and ergodicity across finite and countable state spaces, in both discrete and continuous time, and discusses methods including coupling and duality. The second section ranges from martingales and Brownian motion to stochastic integrals and differential equations, with attention to the Feynman–Kac formula and change-of-measure techniques. Connections to MCMC, convex geometry, and number theory broaden the book’s reach beyond a single branch of probability. Exercises provide a route to further study alongside the concise treatment of the main topics.

Good fit for readers who enjoy

  • Students seeking an introduction that connects Markov chains with stochastic analysis.
  • Readers studying recurrence, ergodicity, martingales, Brownian motion, or stochastic differential equations.
  • Those interested in probability’s connections to MCMC, convex geometry, and number theory.

Themes

Markov chains and ergodicityStochastic analysisProbability methods and applicationsConnections to convex geometry and number theory

Based on publisher information and book metadata.

Book overview

The objective of this book is to introduce the elements of stochastic processes in a rather concise manner where we present the two most important parts - Markov chains and stochastic analysis. The readers are led directly to the core of the main topics to be treated in the context. Further details and additional materials are left to a section containing abundant exercises for further reading and studying.

 

In the part on Markov chains, the focus is on the ergodicity. By using the minimal nonnegative solution method, we deal with the recurrence and various types of ergodicity. This is done step by step, from finite state spaces to denumerable state spaces, and from discrete time to continuous time. The methods of proofs adopt modern techniques, such as coupling and duality methods. Some very new results are included, such as the estimate of the spectral gap. The structure and proofs in the first part are rather different from other existing textbooks on Markov chains.

 

In the part on stochastic analysis, we cover the martingale theory and Brownian motions, the stochastic integral and stochastic differential equations with emphasis on one dimension, and the multidimensional stochastic integral and stochastic equation based on semimartingales. We introduce three important topics here: the Feynman-Kac formula, random time transform and Girsanov transform. As an essential application of the probability theory in classical mathematics, we also deal with the famous Brunn-Minkowski inequality in convex geometry.

 

This book also features modern probability theory that is used in different fields, such as MCMC, or even deterministic areas: convex geometry and number theory. It provides a new and direct routine for students going through the classical Markov chains to the modern stochastic analysis.

Shipping & returnsShipping options, delivery timing, and our return policy.

In-stock items normally dispatch within 1–2 business days. The ZIP-code estimator on this page is informational only; the final shipping method, price, and availability are confirmed at checkout for your full order.

For the initial delivery estimate we use these transit windows after dispatch: Standard 5–8 business days, Expedited 2–4 business days, and Priority 1–2 business days. Holiday delays are not included.

Eligible items can be returned within 30 days in accordance with our return policy.

Customer reviews

M
AlbakiReads
Malaika Taylor

I highly recommend to for anyone looking for inner clarity

T
AlbakiReads
Thomas DiMassa

Great service and fast service

Great shopping experience! The book arrived quickly, was well packaged, and matched the description perfectly. I would definitely shop with you again

O
AlbakiReads
Olivia

Smooth.