eCite Digital Repository

Orchestrating BigData analysis workflows


Ranjan, R and Garg, S and Khoskbar, AR and Solaiman, E and James, P and Georgakopoulos, D, Orchestrating BigData analysis workflows, IEEE Cloud Computing, 4, (3) pp. 20-28. ISSN 2325-6095 (2017) [Refereed Article]

Restricted - Request a copy

Copyright Statement

2017 IEEE

DOI: doi:10.1109/MCC.2017.55


Data analytics has become not only an essential part of day-to-day decision making, but also reinforces long-term strategic decisions. Whether it is real-time fraud detection, resource management, tracking and prevention of disease outbreak, natural disaster management or intelligent traffic management, the extraction and exploitation of insightful information from unparalleled quantities of data (BigData) is now a fundamental part of all decision making processes. Success in making smart decisions by analyzing BigData is possible due to the availability of improved analytical capabilities, increased access to different data sources, and cheaper and improved computing power in the form of cloud computing. However, BigData analysis is far more complicated than the perception created by the recent publicity. For example, one of the myths is that BigData analysis is driven purely by the innovation of new data mining and machine learning algorithms. While innovation of new data mining and machine learning algorithms is critical, this is only one aspect of producing BigData analysis solutions. Just like many other software solutions, BigData analysis solutions are not monolithic pieces of software that are developed specifically for every application. Instead, they often combine and reuse existing trusted software components that perform necessary data analysis steps. Furthermore, in order to deal with the large variety, volume and velocity of BigData, they need to take advantage of the elasticity of cloud and edge datacenter computation and storage resources as needed to meet the requirements of their owners.

Item Details

Item Type:Refereed Article
Keywords:cloud computing, big data, workflows
Research Division:Information and Computing Sciences
Research Group:Distributed computing and systems software
Research Field:Distributed systems and algorithms
Objective Division:Information and Communication Services
Objective Group:Information systems, technologies and services
Objective Field:Information systems, technologies and services not elsewhere classified
UTAS Author:Garg, S (Dr Saurabh Garg)
ID Code:118050
Year Published:2017
Web of Science® Times Cited:22
Deposited By:Information and Communication Technology
Deposited On:2017-07-03
Last Modified:2018-08-02

Repository Staff Only: item control page