1
of
1
Markov Decision Processes
Discrete Stochastic Dynamic Programming
Ratings/reviews counts are updated frequently.
Check link for latest rating. ( 17 ratings, 1 reviews)
Book Hero Magic crafted this summary to help describe this book. While it's new and still
learning, it may not be perfect - your
feedback is welcome!
Summary
Read More
Format: Paperback / softback
$32999
Unit price
/
Unavailable
AVAILABLE WITH SUPPLIER
Ships from our Auckland warehouse within 3-4 weeks
Found a better price? Request a price match
Markov Decision Processes
$32999
Unit price
/
Unavailable
Book Hero Magic created this recommendation. While it's new and still learning, it may not be perfect - your feedback is welcome! IS THIS YOUR NEXT READ?
This book is ideal for advanced-level students, researchers, and professional practitioners in statistics, mathematics, and related sciences seeking an in-depth, unified treatment of Markov decision processes and dynamic programming techniques.
Latest News
Sci-Fi and Fantasy Reads for the Spooky Season
We asked our Sci-Fi and Fantasy reader, Edd, to share his recs for Spooky Season...
Review: In the Room
An emotional and authentic retelling of an extraordinary chapter in our countryβs history. Andrew Campbellβs...
An Evening with Ryan Holiday: Ancient Wisdom for Modern Life
I was lucky enough to see Ryan Holiday speak in Auckland on Tuesday night. I've...
Emma Galloway visits Book Hero
We we delighted to have chef and author, Emma Galloway, visit Hero HQ to promote...
The Play to Screen Report - 15/10/2026
Sacha has rounded up all the latest news from the world of toys, games, movies...
See moreThis book is an up-to-date, unified and rigorous treatment of theoretical, computational and applied research on Markov decision process models. The concentration of the book is on infinite-horizon discrete-time models, and it also discusses arbitrary state spaces, finite-horizon and continuous-time discrete-state models.
Book Hero Magic formatted this description to make it easier to read. While it's new and
still learning, it may not be perfect - your
feedback is welcome!
Description
The Wiley-Interscience Paperback Series consists of selected books that have been made more accessible to consumers in an effort to increase global appeal and general circulation. With these new unabridged softcover volumes, Wiley hopes to extend the lives of these works by making them available to future generations of statisticians, mathematicians, and scientists.
This text is unique in bringing together so many results hitherto found only in part in other texts and papers...The text is fairly self-contained, inclusive of some basic mathematical results needed, and provides a rich diet of examples, applications, and exercises. The bibliographical material at the end of each chapter is excellent, not only from a historical perspective, but because it is valuable for researchers in acquiring a good perspective of the MDP research potential. - Zentralblatt fur Mathematik
...it is of great value to advanced-level students, researchers, and professional practitioners of this field to have now a complete volume (with more than 600 pages) devoted to this topic...
Markov Decision Processes: Discrete Stochastic Dynamic Programming represents an up-to-date, unified, and rigorous treatment of theoretical and computational aspects of discrete-time Markov decision processes.
- Journal of the American Statistical Association
Series: Wiley Series in Probability and Statistics
View all-
Analysis of Ordinal Categorical Data
Statistical scienceβs first coordinated manual of methods for analyzing ordered categorical data, now fully revised and updated, continues to present applications and case studies in fields as diverse as sociology, public health, ecology, marketing, and pharmacy. Analysis of Ordinal Categorical Data, Second Edition provides an introduction to basic descriptive and inferential methods for categorical data, giving thorough coverage of new...Hardback$31899Unit price /UnavailableAvailableShips in 3-4 weeks -
An Introduction to Probability Theory and Its Applications, Volume 1
A complete guide to the theory and practical applications of probability theory An Introduction to Probability Theory and Its Applications uniquely blends a comprehensive overview of probability theory with the real-world application of that theory. Beginning with the background and very nature of probability theory, the book then proceeds through sample spaces, combinatorial analysis, fluctuations in coin tossing and random...Hardback$25299Unit price /UnavailableAvailableShips in 3-4 weeks -
An Introduction to Probability Theory and Its Applications, Volume 2
The classic text for understanding complex statistical probability An Introduction to Probability Theory and Its Applications offers comprehensive explanations to complex statistical problems. Delving deep into densities and distributions while relating critical formulas, processes, and approaches, this rigorous text provides a solid grounding in probability with practice problems throughout. Heavy on application without sacrificing theory, the discussion takes the time...Paperback$57599Unit price /UnavailableAvailableShips in 3-4 weeks -
Applied Logistic Regression
A new edition of the definitive guide to logistic regression modelling for health science and other applications This thoroughly expanded Third Edition provides an easily accessible introduction to the logistic regression (LR) model and highlights the power of this model by examining the relationship between a dichotomous outcome and a set of covariables. Applied Logistic Regression, Third Edition, emphasises applications...Hardback$30499Unit price /UnavailableAvailableShips in 3-4 weeks -
Applied Longitudinal Analysis
Praise for the First Edition ". . . [this book] should be on the shelf of everyone interested in . . . longitudinal data analysis." βJournal of the American Statistical Association Features newly developed topics and applications of the analysis of longitudinal data Applied Longitudinal Analysis, Second Edition presents modern methods for analyzing data from longitudinal studies and now features...Hardback$38300Unit price /UnavailableAvailableShips in 2-3 weeks -
Approximation Theorems of Mathematical Statistics
Approximation Theorems of Mathematical Statistics This convenient paperback edition makes a seminal text in statistics accessible to a new generation of students and practitioners. Approximation Theorems of Mathematical Statistics covers a broad range of limit theorems useful in mathematical statistics, along with methods of proof and techniques of application. The manipulation of "probability" theorems to obtain "statistical" theorems is emphasized....Paperback$35699Unit price /UnavailableAvailableShips in 3-4 weeks -
Bayesian Statistics and Marketing
Fine-tune your marketing research with this cutting-edge statistical toolkit Bayesian Statistics and Marketing illustrates the potential for applying a Bayesian approach to some of the most challenging and important problems in marketing. Analysing household and consumer data, predicting product performance, and custom-targeting campaigns are only a few of the areas in which Bayesian approaches promise revolutionary results. This book provides...Hardback$22199Unit price /UnavailableAvailableShips in 3-4 weeks -
Design of Experiments for Reliability Achievement
ENHANCES READERS' UNDERSTANDING OF EXPERIMENTAL DESIGN METHODS FOR SUCCESSFUL LIFE TESTING AND PRODUCT RELIABILITY IMPROVEMENT Design of Experiments for Reliability Achievement illustrates how experimental design and life testing can be employed to grasp product reliability, thereby facilitating reliability enhancements. The book is structured into four sections. The first section centres on statistical distributions and methods for modelling reliability data. The...Hardback$24599Unit price /UnavailableAvailableShips in 3-4 weeks -
Geostatistical Functional Data Analysis
Geostatistical Functional Data Analysis Explore the intersection between geostatistics and functional data analysis with this insightful new reference Geostatistical Functional Data Analysis presents a unified approach to modelling functional data when spatial and spatio-temporal correlations are present. The Editors link together the wide research areas of geostatistics and functional data analysis to provide the reader with a new area called...Hardback$37600Unit price /UnavailableAvailableShips in 2-3 weeks -
Improving Almost Anything
The chapters of this book are from the recent writings of George E. P. Box, an acknowledged world leader in the application and theory of quality methodology to management, process improvement, process design, and discovery. Box's unique ability to explain complex ideas simply and appealingly with wit and cogent illustration is well known. It draws on profound knowledge and extensive...Paperback$29500Unit price /UnavailableAvailableShips in 2-3 weeks -
Introduction to Probability
Discover practical models and real-world applications of multivariate models useful in engineering, business, and related disciplines In Introduction to Probability: Multivariate Models and Applications, a team of distinguished researchers delivers a comprehensive exploration of the concepts, methods, and results in multivariate distributions and models. Intended for use in a second course in probability, the material is largely self-contained, with some...Hardback$28799Unit price /UnavailableAvailableShips in 3-4 weeks -
Linear Models
Provides an easy-to-understand guide to statistical linear models and its uses in data analysis This book defines a broad spectrum of statistical linear models that is useful in the analysis of data. Considerable rewriting was done to make the book more reader-friendly than the first edition. Linear Models, Second Edition is written in such a way as to be self-contained...Hardback$52300Unit price /UnavailableAvailableShips in 2-3 weeks
Book Details
INFORMATION
ISBN: 9780471727828
Publisher: John Wiley & Sons Inc
Format: Paperback / softback
Date Published: 25 February 2005
Country: United States
Imprint: Wiley-Interscience
Audience: Professional and scholarly
DIMENSIONS
Spine width: 36.0mm
Width: 155.0mm
Height: 234.0mm
Weight: 948g
Pages: 684
About the Author
Martin L. Puterman, PhD, is Advisory Board Professor of Operations and Director of the Centre for Operations Excellence at The University of British Columbia in Vancouver, Canada.
More from Education & Reference
View all-
Revenge of the Tipping Point
Twenty-five years after the publication of his groundbreaking first book, Malcolm Gladwell returns with a brand new volume that reframes the lessons of The Tipping Point in a startling and revealing light. What does the heartbreaking fate of the cheetah tell us about the way we raise our children? Why do elite universities care so much about sports? What is...Paperback$2999Elsewhere:$3999Unit price /UnavailableAvailableShips in 4-6 weeks -
The Body Keeps the Score
The Body Keeps the Score by Dr Bessel van der Kolk is a compelling and compassionate exploration of the deep-seated impact of trauma on the human body and mind. This groundbreaking work delves into the complex causes of trauma and paints a vivid picture of the revolutionary treatments that are enabling countless individuals to reclaim their lives filled with purpose...Paperback$2400Elsewhere:$3000Unit price /UnavailableIn StockShips tomorrow -
New ReleaseSong of the Birds
A stunning and panoramic history of native birds in Aotearoa, from the bestselling author of The Meaning of Trees For millions of years, the song of the birds echoed throughout Aotearoa, with no one around to hear it. While the arrival of humans would transform their story forever - birds may have changed us even more. In this beautiful and...Hardback$4499Elsewhere:$5500Unit price /UnavailableIn StockShips tomorrow -
New ReleaseLucky You're Tough
Lucky You're Tough chronicles the early life of helicopter pilot and NZSAS soldier Mark Law, from growing up in the rural wilds of WhangamΕmona through to surviving a series of life-threatening events that would shape his life and career. After a career as a badged soldier in the NZSAS that led to an intriguing stint with the British SAS and...Paperback$3199Elsewhere:$3999Unit price /UnavailableIn StockShips tomorrow -
The Age Code
What if the food you eat could rewind your biological clock? 'Clear and compelling' β Chris van Tulleken 'Really interesting and insightful' β Joe Wicks 'Fascinating' β Tim Spector From the rising incidence of cancer in the under-50s to increased infertility rates, there are signs everywhere that growing numbers of us are ageing too quickly. Why? Many believe thereβs one...Paperback$2999Elsewhere:$3799Unit price /UnavailableIn StockShips tomorrow -
One Last Question, Prime Minister
From Muldoon to Luxon, untold stories from the House of Parliament Barry Soper has spent close to five decades questioning New Zealand's prime ministers.From the imposing, larger-than-life characters of Rob Muldoon and David Lange, to the golden age of Helen Clark and John Key, and the post-Covid era of Jacinda Ardern and the 'Chrises', Soper's insight and nose for a...Paperback$3199Elsewhere:$3999Unit price /UnavailableIn StockShips tomorrow -
Fungi of Aotearoa
The complete introduction to finding, identifying and using mushrooms and other fungi in New Zealand. Enter and explore the fascinating world of fungi. In this practical and up-to-date guide, forager and fungus enthusiast Liv Sisson shares her top tips and takes the reader on a journey to discover the unique and diverse fungi Aotearoa has to offer. Discover how to...Paperback$3200Elsewhere:$4500Unit price /UnavailableIn StockShips tomorrow -
Suicidal Empathy
The bestselling author of The Parasitic Mind shows why empathy in politics leads to civilizational collapse. What happens when a society elevates victimhood to a virtue and decides that punishment is cruel? You get the disease Dr. Gad Saad calls suicidal empathy. And the West may be terminally infected. In his new book, Suicidal Empathy, Saad unleashes a blistering critique...Paperback$3099Elsewhere:$3799Unit price /UnavailableIn StockShips tomorrow -
Maori Made Easy Workbook 1/Kete 1
Maori Made Easy Workbook 1/Kete 1 by Scotty Morrison is the ultimate companion for anyone eager to learn the beautiful and complex Maori language. Whether you're starting from scratch or looking to brush up on your skills, this workbook offers a structured and engaging way to immerse yourself in te reo Maori. Designed to be accessible regardless of your starting...Paperback$2000Elsewhere:$2500Unit price /UnavailableIn StockShips tomorrow -
New Release
Hormone Health is Mental Health
Hormone Health is Mental Health is a lifechanging guide to understanding perimenopause and midlife women's mental health - and how understanding your hormones is the first step to feeling like yourself again. This book is for women in their thirties, forties, and fifties who feel like they're falling apart. Women who feel like their brains and bodies are betraying them,...Paperback$3299Elsewhere:$4000Unit price /UnavailableIn StockShips tomorrow -
Kitchen Confidential
The classic bestseller from the star of Parts Unknown and No Reservations: 25th Anniversary edition, with a new introduction by Irvine Welsh. BEFORE THERE WAS THE BEAR, THERE WAS BOURDAIN. βElizabeth David written by Quentin Tarantinoβ β A.A. Gill βFantastic: as lip-smackingly seductive as a bowl of fat chips and pungent aioliβ β Daily Telegraph After twenty-five years of sex,...Paperback$2500Elsewhere:$2799Unit price /UnavailableIn StockShips tomorrow -
Aroha
Aroha by Dr Hinemoa Elder is an enlightening exploration of timeless Maori wisdom, intricately woven into a contemporary context. This top-selling non-fiction title from New Zealand in 2021 introduces readers to 52 traditional Maori proverbs, known as whakataukΔ«, each offering a profound lesson for every week of the year. Dr Elder, a respected Maori psychiatrist, delves into these powerful sayings...Hardback$2400Elsewhere:$3000Unit price /UnavailableIn StockShips tomorrow
Why buy from us?
Book Hero is not a chain store or big box retailer. We're an independent 100% NZ-owned business on a mission to help more Kiwis rediscover a love of books and reading!
Service & Delivery
Our warehouse in Auckland holds over 100,000 books, toys, board games and puzzles in-stock so you're not waiting for your order to arrive from overseas.
Auckland Bookstore
We're primarily an online store, but for your convenience you can pick up your order for free from our bookstore, which is right next door to our warehouse in Hobsonville.
Our Gifting Service
Books make wonderful thoughtful gifts and we're here to help with gift-wrapping and cards. We can even send your gift directly to your loved one.
