MARC details
| 000 -LEADER |
|---|
| fixed length control field |
06002cam a2200589Mu 4500 |
| 001 - CONTROL NUMBER |
|---|
| control field |
ocn830162389 |
| 003 - CONTROL NUMBER IDENTIFIER |
|---|
| control field |
OCoLC |
| 005 - DATE AND TIME OF LATEST TRANSACTION |
|---|
| control field |
20240925133907.0 |
| 006 - FIXED-LENGTH DATA ELEMENTS--ADDITIONAL MATERIAL CHARACTERISTICS |
|---|
| fixed length control field |
m d |
| 007 - PHYSICAL DESCRIPTION FIXED FIELD--GENERAL INFORMATION |
|---|
| fixed length control field |
cr cnu---unuuu |
| 008 - FIXED-LENGTH DATA ELEMENTS--GENERAL INFORMATION |
|---|
| fixed length control field |
130316s2012 si o 000 0 eng d |
| 040 ## - CATALOGING SOURCE |
|---|
| Original cataloging agency |
EBLCP |
| Language of cataloging |
eng |
| Description conventions |
pn |
| Transcribing agency |
EBLCP |
| Modifying agency |
OCLCO |
| -- |
YDXCP |
| -- |
N$T |
| -- |
DEBSZ |
| -- |
OCLCQ |
| -- |
OCLCF |
| -- |
OCLCQ |
| -- |
AGLDB |
| -- |
MERUC |
| -- |
ZCU |
| -- |
OCLCQ |
| -- |
VTS |
| -- |
ICG |
| -- |
OCLCQ |
| -- |
STF |
| -- |
DKC |
| -- |
OCLCQ |
| -- |
M8D |
| -- |
UKAHL |
| -- |
OCLCQ |
| -- |
AJS |
| -- |
OCLCO |
| -- |
OCLCQ |
| -- |
OCLCO |
| -- |
OCLCL |
| 019 ## - |
|---|
| -- |
1086964971 |
| -- |
1264885637 |
| -- |
1264926938 |
| -- |
1297132851 |
| -- |
1297267500 |
| 020 ## - INTERNATIONAL STANDARD BOOK NUMBER |
|---|
| International Standard Book Number |
9781848167940 |
| Qualifying information |
(electronic bk.) |
| 020 ## - INTERNATIONAL STANDARD BOOK NUMBER |
|---|
| International Standard Book Number |
1848167946 |
| Qualifying information |
(electronic bk.) |
| 035 ## - SYSTEM CONTROL NUMBER |
|---|
| System control number |
545467 |
| -- |
(N$T) |
| 035 ## - SYSTEM CONTROL NUMBER |
|---|
| System control number |
(OCoLC)830162389 |
| Canceled/invalid control number |
(OCoLC)1086964971 |
| -- |
(OCoLC)1264885637 |
| -- |
(OCoLC)1264926938 |
| -- |
(OCoLC)1297132851 |
| -- |
(OCoLC)1297267500 |
| 050 #4 - LIBRARY OF CONGRESS CALL NUMBER |
|---|
| Classification number |
QA274.7 |
| 072 #7 - SUBJECT CATEGORY CODE |
|---|
| Subject category code |
MAT |
| Subject category code subdivision |
029040 |
| Source |
bisacsh |
| 082 04 - DEWEY DECIMAL CLASSIFICATION NUMBER |
|---|
| Classification number |
519.233 |
| 049 ## - LOCAL HOLDINGS (OCLC) |
|---|
| Holding library |
MAIN |
| 100 1# - MAIN ENTRY--PERSONAL NAME |
|---|
| Personal name |
Piunovskiy, A. B. |
| 9 (RLIN) |
678571 |
| 245 10 - TITLE STATEMENT |
|---|
| Title |
Examples in Markov Decision Processes. |
| 260 ## - PUBLICATION, DISTRIBUTION, ETC. (IMPRINT) |
|---|
| Place of publication, distribution, etc. |
Singapore : |
| Name of publisher, distributor, etc. |
World Scientific Publishing Company, |
| Date of publication, distribution, etc. |
2012. |
| 300 ## - PHYSICAL DESCRIPTION |
|---|
| Extent |
1 online resource (308 pages) |
| 336 ## - CONTENT TYPE |
|---|
| Content type term |
text |
| Content type code |
txt |
| Source |
rdacontent |
| 337 ## - MEDIA TYPE |
|---|
| Media type term |
computer |
| Media type code |
c |
| Source |
rdamedia |
| 338 ## - CARRIER TYPE |
|---|
| Carrier type term |
online resource |
| Carrier type code |
cr |
| Source |
rdacarrier |
| 490 1# - SERIES STATEMENT |
|---|
| Series statement |
Imperial College Press Optimization Series ; |
| Volume/sequential designation |
v. 2 |
| 588 0# - SOURCE OF DESCRIPTION NOTE |
|---|
| Source of description note |
Print version record. |
| 505 0# - FORMATTED CONTENTS NOTE |
|---|
| Formatted contents note |
Preface; 1. Finite-Horizon Models; 1.1 Preliminaries; 1.2 Model Description; 1.3 Dynamic Programming Approach; 1.4 Examples; 1.4.1 Non-transitivity of the correlation; 1.4.2 The more frequently used control is not better; 1.4.3 Voting; 1.4.4 The secretary problem; 1.4.5 Constrained optimization; 1.4.6 Equivalent Markov selectors in non-atomic MDPs; 1.4.7 Strongly equivalent Markov selectors in nonatomic MDPs; 1.4.8 Stock exchange; 1.4.9 Markov or non-Markov strategy? Randomized or not? When is the Bellman principle violated?; 1.4.10 Uniformly optimal, but not optimal strategy. |
| 505 8# - FORMATTED CONTENTS NOTE |
|---|
| Formatted contents note |
1.4.11 Martingales and the Bellman principle1.4.12 Conventions on expectation and infinities; 1.4.13 Nowhere-differentiable function vt(x); discontinuous function vt(x); 1.4.14 The non-measurable Bellman function; 1.4.15 No one strategy is uniformly -optimal; 1.4.16 Semi-continuous model; 2. Homogeneous Infinite-Horizon Models: Expected Total Loss; 2.1 Homogeneous Non-discounted Model; 2.2 Examples; 2.2.1 Mixed Strategies; 2.2.2 Multiple solutions to the optimality equation; 2.2.3 Finite model: multiple solutions to the optimality equation; conserving but not equalizing strategy. |
| 505 8# - FORMATTED CONTENTS NOTE |
|---|
| Formatted contents note |
2.2.4 The single conserving strategy is not equalizing and not optimal2.2.5 When strategy iteration is not successful; 2.2.6 When value iteration is not successful; 2.2.7 When value iteration is not successful: positive model I; 2.2.8 When value iteration is not successful: positive model II; 2.2.9 Value iteration and stability in optimal stopping problems; 2.2.10 A non-equalizing strategy is uniformly optimal; 2.2.11 A stationary uniformly -optimal selector does not exist (positive model); 2.2.12 A stationary uniformly -optimal selector does not exist (negative model). |
| 505 8# - FORMATTED CONTENTS NOTE |
|---|
| Formatted contents note |
2.2.13 Finite-action negative model where a stationary uniformly -optimal selector does not exist2.2.14 Nearly uniformly optimal selectors in negative models; 2.2.15 Semi-continuous models and the blackmailer's dilemma; 2.2.16 Not a semi-continuous model; 2.2.17 The Bellman function is non-measurable and no one strategy is uniformly -optimal; 2.2.18 A randomized strategy is better than any selector (finite action space); 2.2.19 The fluid approximation does not work; 2.2.20 The fluid approximation: refined model; 2.2.21 Occupation measures: phantom solutions. |
| 505 8# - FORMATTED CONTENTS NOTE |
|---|
| Formatted contents note |
2.2.22 Occupation measures in transient models2.2.23 Occupation measures and duality; 2.2.24 Occupation measures: compactness; 2.2.25 The bold strategy in gambling is not optimal (house limit); 2.2.26 The bold strategy in gambling is not optimal (inflation); 2.2.27 Search strategy for a moving target; 2.2.28 The three-way duel ("Truel"); 3. Homogeneous Infinite-Horizon Models: Discounted Loss; 3.1 Preliminaries; 3.2 Examples; 3.2.1 Phantom solutions of the optimality equation; 3.2.2 When value iteration is not successful: positive model. |
| 500 ## - GENERAL NOTE |
|---|
| General note |
3.2.3 A non-optimal strategy for which v x solves the optimality equation. |
| 520 ## - SUMMARY, ETC. |
|---|
| Summary, etc. |
This invaluable book provides approximately eighty examples illustrating the theory of controlled discrete-time Markov processes. Except for applications of the theory to real-life problems like stock exchange, queues, gambling, optimal search etc, the main attention is paid to counter-intuitive, unexpected properties of optimization problems. Such examples illustrate the importance of conditions imposed in the theorems on Markov Decision Processes. Many of the examples are based upon examples published earlier in journal articles or textbooks while several other examples are new. The aim was. |
| 590 ## - LOCAL NOTE (RLIN) |
|---|
| Local note |
Added to collection customer.56279.3 |
| 650 #0 - SUBJECT ADDED ENTRY--TOPICAL TERM |
|---|
| Topical term or geographic name as entry element |
Markov processes. |
| 9 (RLIN) |
4962 |
| 650 #6 - SUBJECT ADDED ENTRY--TOPICAL TERM |
|---|
| Topical term or geographic name as entry element |
Processus de Markov. |
| 9 (RLIN) |
78421 |
| 650 #7 - SUBJECT ADDED ENTRY--TOPICAL TERM |
|---|
| Topical term or geographic name as entry element |
MATHEMATICS |
| General subdivision |
Probability & Statistics |
| -- |
Stochastic Processes. |
| Source of heading or term |
bisacsh |
| 9 (RLIN) |
4361 |
| 650 #7 - SUBJECT ADDED ENTRY--TOPICAL TERM |
|---|
| Topical term or geographic name as entry element |
Markov processes |
| Source of heading or term |
fast |
| 9 (RLIN) |
4962 |
| 758 ## - |
|---|
| -- |
has work: |
| -- |
Examples in Markov decision processes (Text) |
| -- |
https://id.oclc.org/worldcat/entity/E39PD36JPqF83j9v37dcp6YMRq |
| -- |
https://id.oclc.org/worldcat/ontology/hasWork |
| 776 08 - ADDITIONAL PHYSICAL FORM ENTRY |
|---|
| Relationship information |
Print version: |
| Main entry heading |
Piunovskiy, A.B. |
| Title |
Examples in Markov Decision Processes. |
| Place, publisher, and date of publication |
Singapore : World Scientific Publishing Company, ©2012 |
| International Standard Book Number |
9781848167933 |
| 830 #0 - SERIES ADDED ENTRY--UNIFORM TITLE |
|---|
| Uniform title |
Imperial College Press optimization series. |
| 9 (RLIN) |
510592 |
| 856 40 - ELECTRONIC LOCATION AND ACCESS |
|---|
| Materials specified |
EBSCOhost |
| Uniform Resource Identifier |
<a href="https://search.ebscohost.com/login.aspx?direct=true&scope=site&db=nlebk&db=nlabk&AN=545467">https://search.ebscohost.com/login.aspx?direct=true&scope=site&db=nlebk&db=nlabk&AN=545467</a> |
| 938 ## - |
|---|
| -- |
Askews and Holts Library Services |
| -- |
ASKH |
| -- |
AH25007156 |
| 938 ## - |
|---|
| -- |
EBL - Ebook Library |
| -- |
EBLB |
| -- |
EBL1143323 |
| 938 ## - |
|---|
| -- |
EBSCOhost |
| -- |
EBSC |
| -- |
545467 |
| 938 ## - |
|---|
| -- |
YBP Library Services |
| -- |
YANK |
| -- |
10258426 |
| 994 ## - |
|---|
| -- |
92 |
| -- |
N$T |