Mathematics
Mathematics, 24.03.2021 16:50, Hcalhoun21

During any period, a potential customer arrives at a certain facility with probability 1/2. If there aretwo people in the facility (including the one being served) the potential customer leaves the facilityimmediately and never returns. However, if there is one or fewer people, he enters the facility andbecomes an actual customer. The manager of the facility has two types of service rates available. Ifshe uses her slow service rate at a cost of $3 during a period, a customer will be served and leave thefacility with probability 3/5. If she uses her fast service rate at a cost of $9 during a period, a customerwill be served and leave the facility with probability 4/5. Note that the probability of more than onecustomer arriving or more than one customer being served in a period is 0. A profit of $50 is earnedwhen a customer is served. The manager wants to minimize the expected discounted cost of service over an infinite horizon β=0.9). Required:
a. Formulate the problem as a Markov decision process (e. g. specify the state space, decision set, transition probabilities, expected rewards) Hint: In computing the costs for services, do not forget the opportunity cost of losing a potential customer – e. g. 50$ is lost.
b. Formulate the problem as a linear program to determine the optimal stationary policy.
c. Implement the policy iteration algorithm starting with the stationary policy that always uses slow service. Iterate either until you find the optimal policy or implement 3 iterations.
d. Implement the value iteration algorithm for 3 iterations.
e. In the value iteration algorithm, what is the number of iterations necessary to achieve a desired precision of ε=0.1?

answer
Answers: 2

Other questions on the subject: Mathematics

image
Mathematics, 21.06.2019 14:30, jorgefrom584
Cass decided to sell game programs for the hockey game. the printing cost was over 20 cents per program with a selling price of 50 cents each. cass sold all but 50 of the programs, and made a profit of $65. how many programs were printed? letting p represent the number of programs printed, set up an equation that describes this situation. then solve your equation for p.
Answers: 1
image
Mathematics, 21.06.2019 17:10, Halessoftball
Jessica and martha each have a bag of cookies with unequal quantities. they have 30 cookies total between the two of them. each of them ate 6 cookies from their bag. the product of the number of cookies left in each bag is not more than 80. how many more cookies will jessica have martha? if x represents the number of cookies jessica started with, complete the statements below. the inequality that describes the relationship between the number of cookies each one of them has is x^2 - x +224 > = 0.jessica has at least cookies more than martha.
Answers: 3
image
Mathematics, 21.06.2019 19:00, masonsee4ytube
Daniel expanded the expression as shown below -2(-8x-4y+3/4)=-10x-8y-11/4 what errors did he make? check all that apply
Answers: 3
image
Mathematics, 21.06.2019 23:00, TeenageKicks9800
Which expression is equal to (f+g)(x)?
Answers: 2
Do you know the correct answer?
During any period, a potential customer arrives at a certain facility with probability 1/2. If there...

Questions in other subjects:

Konu
Mathematics, 11.01.2021 21:00