Classify an individual’s wealth as low (L), medium (M), or high (H). In state L, the individual…

Classify an individual’s wealth as low (L), medium (M), or high (H). In state L, the individual has insufficient wealth to invest, so each period he consumes all earned income and as a consequence receives one unit of utility and remains in state L. In state M, three consumption options are available. Consuming at a high rate yields a utility of three units; at a moderate level, a utility of two units, and at a low level a utility of 1.5 units. If an individual in state M consumes at a low rate, with probability 0.95 he remains in state M, and with probability 0.05 his wealth rises to level H at the next period; if he consumes at a moderate rate, with probability 0.7 his wealth remains at a medium level, with probability 0.01 it rises to a high level, and with probability 0.29 it falls to a low level; and, finally, if he consumes at a high level, with probability 0.9 his wealth falls to a low level in the subsequent period and otherwise remains at a medium level. If an individual’s wealth is high, he may consume at a moderate level or a high level. If he consumes at a moderate level, he receives two units of utility per period, and if he consumes at a high level, he receives three units of utility. By consuming at a moderate level, his wealth remains at a high level with probability 0.9, and falls to a moderate level with probability 0.1. Consuming at a high level, his wealth remains at a high level with probability 0.5, and falls to a moderate level with probability 0.5.

a. Formulate the individual’s consumption level choice problem as a Markov decision process.

b. Verify that the model is neither unichain nor communicating.

c. Find a policy that maximizes the individual’s expected average utility using multichain policy iteration and linear programming.

d. Suppose the individual discounts utility at rate A, and uses the expected total discounted utility optimality criterion. Investigate the effect of the discount rate on the optimal consumption policy.

Place your order
(550 words)

Approximate price: $22

Calculate the price of your order

550 words
We'll send you the first draft for approval by September 11, 2018 at 10:52 AM
Total price:
$26
The price is based on these factors:
Academic level
Number of pages
Urgency
Basic features
  • Free title page and bibliography
  • Unlimited revisions
  • Plagiarism-free guarantee
  • Money-back guarantee
  • 24/7 support
On-demand options
  • Writer’s samples
  • Part-by-part delivery
  • Overnight delivery
  • Copies of used sources
  • Expert Proofreading
Paper format
  • 275 words per page
  • 12 pt Arial/Times New Roman
  • Double line spacing
  • Any citation style (APA, MLA, Chicago/Turabian, Harvard)

Our guarantees

Delivering a high-quality product at a reasonable price is not enough anymore.
That’s why we have developed 5 beneficial guarantees that will make your experience with our service enjoyable, easy, and safe.

Money-back guarantee

You have to be 100% sure of the quality of your product to give a money-back guarantee. This describes us perfectly. Make sure that this guarantee is totally transparent.

Read more

Zero-plagiarism guarantee

Each paper is composed from scratch, according to your instructions. It is then checked by our plagiarism-detection software. There is no gap where plagiarism could squeeze in.

Read more

Free-revision policy

Thanks to our free revisions, there is no way for you to be unsatisfied. We will work on your paper until you are completely happy with the result.

Read more

Privacy policy

Your email is safe, as we store it according to international data protection rules. Your bank details are secure, as we use only reliable payment systems.

Read more

Fair-cooperation guarantee

By sending us your money, you buy the service we provide. Check out our terms and conditions if you prefer business talks to be laid out in official language.

Read more
error: Content is protected !!