Mathematics
Mathematics, 24.03.2021 16:50, Hcalhoun21

During any period, a potential customer arrives at a certain facility with probability 1/2. If there aretwo people in the facility (including the one being served) the potential customer leaves the facilityimmediately and never returns. However, if there is one or fewer people, he enters the facility andbecomes an actual customer. The manager of the facility has two types of service rates available. Ifshe uses her slow service rate at a cost of $3 during a period, a customer will be served and leave thefacility with probability 3/5. If she uses her fast service rate at a cost of $9 during a period, a customerwill be served and leave the facility with probability 4/5. Note that the probability of more than onecustomer arriving or more than one customer being served in a period is 0. A profit of $50 is earnedwhen a customer is served. The manager wants to minimize the expected discounted cost of service over an infinite horizon β=0.9). Required:
a. Formulate the problem as a Markov decision process (e. g. specify the state space, decision set, transition probabilities, expected rewards) Hint: In computing the costs for services, do not forget the opportunity cost of losing a potential customer – e. g. 50$ is lost.
b. Formulate the problem as a linear program to determine the optimal stationary policy.
c. Implement the policy iteration algorithm starting with the stationary policy that always uses slow service. Iterate either until you find the optimal policy or implement 3 iterations.
d. Implement the value iteration algorithm for 3 iterations.
e. In the value iteration algorithm, what is the number of iterations necessary to achieve a desired precision of ε=0.1?

answer
Answers: 2

Other questions on the subject: Mathematics

image
Mathematics, 21.06.2019 19:00, Keekee9847
What is the equation of the line in point-slope form? y+ 4 = 1/2(x+4) y-4 = 1/2(x + 4) y-0 = 2(x - 4) y-4 = 2(8-0)
Answers: 2
image
Mathematics, 21.06.2019 20:00, codyshs160
The boiling point of water at an elevation of 0 feet is 212 degrees fahrenheit (°f). for every 1,000 feet of increase in elevation, the boiling point of water decreases by about 2°f. which of the following represents this relationship if b is the boiling point of water at an elevation of e thousand feet? a) e = 2b - 212 b) b = 2e - 212 c) e = -2b + 212 d) b = -2e + 212
Answers: 1
image
Mathematics, 21.06.2019 21:00, kmassarotti
Apiling for a high-rise building is pushed by two bulldozers at exactly the same time. one bulldozer exerts a force of 1250 pounds in a westerly direction. the other bulldozer pushes the piling with a force of 2650 pounds in a northerly direction. what is the direction of the resulting force upon the piling, to the nearest degree? a. 65 n of w b. 25 n of w c. 45 n of w d. 35 n of w
Answers: 1
image
Mathematics, 22.06.2019 02:00, 791197
Will make ! for correct answer the dot plot below shows the number of toys 21 shops sold in an hour. is the median or the mean a better center for this data and why? a. median; because the data is not symmetric and there are outliersb. median; because the data is symmetric and there are no outliersc. mean; because the data is symmetric and there are no outliersd. mean; because the data is skewed and there are outliers
Answers: 2
Do you know the correct answer?
During any period, a potential customer arrives at a certain facility with probability 1/2. If there...

Questions in other subjects:

Konu
Mathematics, 23.09.2020 14:01