Q2 Solving MDPs 6 Points Consider the gridworld MDP for which \text{Left}Left and \text{Right}Right actions are 100% successful. Specifically, the available actions in each state are to move to the neighboring grid squares. From state aa, there is also an exit action available, which results in going to the terminal state and collecting a reward of 10. Similarly, in state ee, the reward for the exit action is 1. Exit actions are successful 100% of the time.

Amass of m 1.5 kg of steam is contained in a closed rigid container. initially the pressure and temperature of the steam are: p 1.5 mpa and t 240°c (superheated state), respectively. then the temperature drops to t2= 100°c as the result of heat transfer to the surroundings. determine: a) quality of the steam at the end of the process, b) heat transfer with the surroundings. for: p1.5 mpa and t 240°c: enthalpy of superheated vapour is 2900 kj/kg, specific volume of superheated vapour is 0. 1483 m/kg, while for t 100°c: enthalpy of saturated liquid water is 419kj/kg, specific volume of saturated liquid water is 0.001043m/kg, enthalpy of saturated vapour is 2676 kj/kg, specific volume of saturated vapour is 1.672 m/kg and pressure is 0.1 mpa.

What difference(s) did you notice using a pneumatic circuit over hydraulic circuit. explain why the pneumatic piston stumbles when it hits an obstacle.

Draw the engineering stress-strain curve for (a) bcc; (b) fcc metals and mark important points.