- Tytuł:
- Influence of YARN schedulers on power consumption and processing time for various big data benchmarks
- Autorzy:
-
Drypczewski, Krzysztof
Proficz, Jerzy
Stepnowski, Andrzej - Powiązania:
- https://bibliotekanauki.pl/articles/1955269.pdf
- Data publikacji:
- 2018
- Wydawca:
- Politechnika Gdańska
- Tematy:
-
Apache Spark
YARN
big data
green computing
Sentinel
Tera Sort
word count
benchmarks
scheduler - Opis:
- Climate change caused by human activities can influence the lives of everybody on the planet. The environmental concerns must be taken into consideration by all fields of study includingICT. Green Computing aims to reduce negative effects of IT on the environment while, at the same time, maintaining all of the possible benefits it provides. Several Big Data platforms like Apache Spark or YARN have become widely used in analytics and High-Performance Computing systems due to the reliability and usability of Map Reduce implementations. The authors research the power consumption and energy efficiency of Hadoop YARN schedulers using Apache Spark under three different workloads. The test cases include: sorting large binary files,counting unique words in large text files and processing satellite imagery from the Sentinel-2mission. The presented results show small (2%–11%) but distinct differences in the power consumption of FIFO and FAIR schedulers.
- Źródło:
-
TASK Quarterly. Scientific Bulletin of Academic Computer Centre in Gdansk; 2018, 22, 4; 303--312
1428-6394 - Pojawia się w:
- TASK Quarterly. Scientific Bulletin of Academic Computer Centre in Gdansk
- Dostawca treści:
- Biblioteka Nauki
Artykuł