Mapping the big data landscape: technologies, platforms and paradigms for real-time analytics of data streams

Dubuc, T., Stahl, F. ORCID: https://orcid.org/0000-0002-4860-0203 and Roesch, E. B. ORCID: https://orcid.org/0000-0002-8913-4173 (2021) Mapping the big data landscape: technologies, platforms and paradigms for real-time analytics of data streams. IEEE Access, 9. pp. 15351-15374. ISSN 2169-3536 doi: 10.1109/ACCESS.2020.3046132

Abstract/Summary

The ‘Big Data’ of yesterday is the ‘data’ of today. As technology progresses, new challenges arise and new solutions are developed. Due to the emergence of Internet of Things applications within the last decade, the field of Data Mining has been faced with the challenge of processing and analysing data streams in real-time, and under high data throughput conditions. This is often referred to as the Velocity aspect of Big Data. Whereas there are numerous reviews on Data Stream Mining techniques and applications, there is very little work surveying Data Stream processing paradigms and associated technologies, from data collection through to pre-processing and feature processing, from the perspective of the user, not that of the service provider. In this paper, we evaluate a particular type of solution, which focuses on streaming data, and processing pipelines that permit online analysis of data streams that cannot be stored as-is on the computing platform. We review foundational computational concepts such as distributed computation, fault-tolerant computing, and computational paradigms/architectures. We then review the available technological solutions, and applications that pertain to data stream mining as case studies of these theoretical concepts. We conclude with a discussion of the field of data stream processing/analytics, future directions and research challenges.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/95419
Item Type	Article
Refereed	Yes
Divisions	Interdisciplinary Research Centres (IDRCs) > Centre for Integrative Neuroscience and Neurodynamics (CINN) Life Sciences > School of Psychology and Clinical Language Sciences > Department of Psychology Life Sciences > School of Psychology and Clinical Language Sciences > Neuroscience Life Sciences > School of Psychology and Clinical Language Sciences > Perception and Action
Publisher	IEEE
Download/View statistics	View download statistics for this item