Q2 Solving MDPs 6 Points Consider the gridworld MDP for which \text{Left}Left and \text{Right}Right actions are 100% successful. Specifically, the available actions in each state are to move to the neighboring grid squares. From state aa, there is also an exit action available, which results in going to the terminal state and collecting a reward of 10. Similarly, in state ee, the reward for the exit action is 1. Exit actions are successful 100% of the time.

Tom is having a problem with his washing machine. he notices that the machine vibrates violently at a frequency of 1500 rpm due to an unknown rotating unbalance. the machine is mounted on 4 springs each having a stiffness of 10 kn/m. tom wishes to add an undamped vibration absorber attached by a spring under the machine the machine working frequency ranges between 800 rpm to 2000 rpm and its total mass while loaded is assumed to be 80 kg. a) what should be the mass of the absorber added to the machine so that the natural frequency falls outside the working range? b) after a first trial of an absorber using a mass of 35 kg, the amplitude of the oscillation was found to be 10 cm. what is the value of the rotating unbalance? c) using me-3.5 kg. m, find the optimal absorber (by minimizing its mass). what would be the amplitude of the oscillation of the absorber?