Engineering, 24.04.2020 04:28, EricaCox1

Consider a Hadoop job that processes an input data file of size equal to 45 disk blocks (45 different blocks, you can assume that HDFS replication factor is set to 1). The mapper in this job requires 1 minute to read and fully process a single block of data. For the purposes of this assignment, you can assume that the reduce part of this job takes zero time.

a) Approximately how long will it take to process the file if you only had one Hadoop worker node? You can assume that that only one mapper is created on every node.
b) 20 Hadoop worker nodes?
c) 50 Hadoop worker nodes?
d) 75 Hadoop worker nodes?
e) Now suppose you were told that the replication factor has been changed to 3? That is, each block is stored in triplicate, but file size is still 45 blocks. Which of the answers (if any) in a)-c) above will have to change?

Answers: 2

Show answers

Other questions on the subject: Engineering

Engineering, 04.07.2019 18:10, niyawilliams23

Asingle-geared blanking press has a stroke of 200 mm and a rated capacity of 320 kn. a cam driven ram is assumed to be capable of delivering the full press load at constant force during the last 15 percent of a constant-velocity stroke. the camshaft has an average speed of 90 rev/min and is geared to the flywheel shaft at a 6: 1 ratio. the total work done is to include an allowance of 16 percent for friction a) estimate the maximum energy fluctuation b) find the rim weight for an effective diameter of 1.2 m and a coefficient of speed fluctuation of 0.10

Answers: 1

continue

Engineering, 04.07.2019 18:10, soreese02

An ideal otto cycle with air as the working fluid has a compression ratio of 8. the minimum and maximum temperatures in the cycle are 300 k and 1340 k. use constant specific heats at room temperature to determine (a) the amount of heat transferred to the air during the heat- addition kj/kg, (b) the thermal efficiency, and (c) the thermal efficiency of a carnot cycle ope limits. process, in rating between the same temperature

Answers: 2

continue

Engineering, 04.07.2019 19:20, dndndndnxmnc

The process in which the system pressure remain constant is called a)-isobaric b)-isochoric c)-isolated d)-isothermal

Answers: 3

continue

Engineering, 06.07.2019 03:10, lacourboud20005

An electrical kettle is made out of stainless steel, weighs two pounds (when empty) with a heating element that consumes 2 kw of electricity. assuming that the water and the kettle are at the same uniform temperature at any moment of time, calculate the shortest possible time to bring 2 quarts of water from room temperature to the onset of boiling.

Answers: 1

continue

Do you know the correct answer?

Consider a Hadoop job that processes an input data file of size equal to 45 disk blocks (45 differen...