Each quarter the marketing manager of a retail store divides customers into two classes based on…

Each quarter the marketing manager of a retail store divides customers into two classes based on their purchase behavior in the previous quarter. Denote the classes as L for low and H for high. The manager wishes to determine to which classes of customers he should send quarterly catalogs. The cost of sending a catalog is $15 per customer and the expected purchase depends on the customer’s class and the manager’s action. If a customer is in class L and receives a catalog, then the expected purchase in the current quarter is $20, and if a class L customer does not receive a catalog his expected purchase is S 10. If a customer is in class H and receives a catalog, then his expected purchase is $50, and if a class H customer does not receive a catalog his expected purchase is $25.

The decision whether or not to send a catalog to a customer also affects the customer's classification in the subsequent quarter. If a customer is class L at the start of the present quarter, then the probability he is in class L at the subsequent quarter is 0.3 if he receives a catalog and 0.5 if he does not. If a customer is class H in the current period, then the probability that he remains in class H in the subsequent period is 0.8 if he receives a catalog and 0.4 if he does not. Assume a discount rate of 0.9 and an objective of maximizing expected total discounted reward.

a. Formulate this as an infinite-horizon discounted Markov decision problem.

b. Find an optimal policy using policy iteration starting with the stationary policy which has greatest one-step reward.

c. For E = 0.1, find an &-optimal policy using ordinary value iteration, GaussSeidel value iteration, and relative value iteration starting with 00' = (0,O). In each, compare the number of iterations required under the supremum norm (6.3.3) and span seminorm (6.6.1 1) stopping criteria.

d. For E = 0.1, find an &-optimal policy using modified policy iteration and Gauss-Seidel modified policy iteration. Be sure to choose an appropriate starting value.

e. Formulate the problem as a linear program, giving its primal and dual. Solve both and interpret the solutions.

f. Find an optimal policy under the constraint that the total expected discounted cost of sending catalogs cannot exceed 99.

g. Apply the action elimination algorithm of Sec. 6.7.3. Record the total number of actions eliminated at each iteration.

h. What is the turnpike horizon for this problem? Compare it with the bounds in (6.8.1) and (6.8.5).

Place your order
(550 words)

Approximate price: $22

Calculate the price of your order

550 words
We'll send you the first draft for approval by September 11, 2018 at 10:52 AM
Total price:
The price is based on these factors:
Academic level
Number of pages
Basic features
  • Free title page and bibliography
  • Unlimited revisions
  • Plagiarism-free guarantee
  • Money-back guarantee
  • 24/7 support
On-demand options
  • Writer’s samples
  • Part-by-part delivery
  • Overnight delivery
  • Copies of used sources
  • Expert Proofreading
Paper format
  • 275 words per page
  • 12 pt Arial/Times New Roman
  • Double line spacing
  • Any citation style (APA, MLA, Chicago/Turabian, Harvard)

Our guarantees

Delivering a high-quality product at a reasonable price is not enough anymore.
That’s why we have developed 5 beneficial guarantees that will make your experience with our service enjoyable, easy, and safe.

Money-back guarantee

You have to be 100% sure of the quality of your product to give a money-back guarantee. This describes us perfectly. Make sure that this guarantee is totally transparent.

Read more

Zero-plagiarism guarantee

Each paper is composed from scratch, according to your instructions. It is then checked by our plagiarism-detection software. There is no gap where plagiarism could squeeze in.

Read more

Free-revision policy

Thanks to our free revisions, there is no way for you to be unsatisfied. We will work on your paper until you are completely happy with the result.

Read more

Privacy policy

Your email is safe, as we store it according to international data protection rules. Your bank details are secure, as we use only reliable payment systems.

Read more

Fair-cooperation guarantee

By sending us your money, you buy the service we provide. Check out our terms and conditions if you prefer business talks to be laid out in official language.

Read more
error: Content is protected !!