Orchestration Tools for Big Data

Recent advances in big data technologies such as Hadoop, Storm, Spark, and NoSql databases have ease the task of developing application solutions. However, having such a heterogeneity of tools for different data processing tasks also makes the process complex. Most big data solutions design, implementation, deployment, and management require expert knowledge in different technologies and tools, thus making orchestration process a challenging task. This challenge is aggravated by user’s quality of service requirements and variability of big data and underline cloud infrastructure. This chapter gives an overview of different operations in orchestration of big data solutions, orchestration challenges, and state of the art and details different open issues of big data orchestration.