A novel cloud based elastic framework for big data preprocessing

Download

[thumbnail of 2014 A_Novel_Cloud_Based_Elastic_Framework_fo.pdf]

Preview

Text - Accepted Version
· Please see our End User Agreement before downloading. | Preview

Advice

Please see our End User Agreement.

It is advisable to refer to the publisher's version if you intend to cite from this work. See Guidance on citing.

Tools

Lists

Dawelbeit, O. and McCrindle, R. (2014) A novel cloud based elastic framework for big data preprocessing. In: 6th Computer Science and Electronic Engineering Conference (CEEC), 2014, September 25-26, Essex, UK. doi: 10.1109/CEEC.2014.6958549

Abstract/Summary

A number of analytical big data services based on the cloud computing paradigm such as Amazon Redshift and Google Bigquery have recently emerged. These services are based on columnar databases rather than traditional Relational Database Management Systems (RDBMS) and are able to analyse massive datasets in mere seconds. This has led many organisations to retain and analyse their massive logs, sensory or marketing datasets, which were previously discarded due to the inability to either store or analyse them. Although these big data services have addressed the issue of big data analysis, the ability to efficiently de-normalise and prepare this data to a format that can be imported into these services remains a challenge. This paper describes and implements a novel, generic and scalable cloud based elastic framework for Big Data Preprocessing (BDP). Since the approach described by this paper is entirely based on cloud computing it is also possible to measure the overall cost incurred by these preprocessing activities.

Altmetric Badge

Item Type	Conference or Workshop Item (Paper)
URI	https://reading-clone.eprints-hosting.org/id/eprint/69738
Identification Number/DOI	10.1109/CEEC.2014.6958549
Refereed	Yes
Divisions	Life Sciences > School of Biological Sciences > Department of Bio-Engineering
Uncontrolled Keywords	Big data, Cloud computing, Program processors, Google, Runtime, Educational institutions, Computer science
Download/View statistics	View download statistics for this item

Download Statistics

Downloads

Downloads per month over past year

Deposit Details

Date Deposited:	23 Mar 2017 15:25	Date item deposited into CentAUR
Last Modified:	21 Oct 2021 17:48	Date item last modified

References

[1] S. Madden, “From Databases to Big Data,” IEEE Internet Computing, vol. 16, no. 3, pp. 4–6, May 2012. [Online]. Available: http: //ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6188576 [2] G. Inc., “Gartner’s 2013 hype cycle for emerging technologies maps out evolving relationship between humans and machines,” August 2013. [Online]. Available: http://www.gartner.com/newsroom/id/2575515 [3] P. Mell and T. Grance, “The NIST Deﬁnition of Cloud Computing, Recommendations of the National Institute of Standards and Technolog,” National Institute of Standards and Technology, 2011. [Online]. Available: http://csrc.nist.gov/publications/nistpubs/800-145/SP800-145.pdf [4] J. Varia, “Architecting for the cloud: Best practices,” Amazon Web Services, no. May, pp. 1–21, 2010. [Online]. Available: https: //jineshvaria.s3.amazonaws.com/public/cloudbestpractices-jvaria.pdf [5] S. Melnik, A. Gubarev, and J. Long, “Dremel: Interactive analysis of web-scale datasets,” Proceedings of the VLDB Endowment, vol. 3, no. 1-2, pp. 330–339, 2010. [6] D. Abadi, P. Boncz, and S. Harizopoulos, “Column-oriented database systems,” Proceedings of the VLDB Endowment, vol. 2, no. 2, pp. 1664– 1665, 2009. [7] A. Jacobs, “The Pathologies of Big Data,” Queue, vol. 7, no. 6, p. 10, Jul. 2009. [Online]. Available: http://portal.acm.org/citation.cfm?doid= 1563821.1563874 [8] P. Marshall, H. Tufo, and K. Keahey, “Architecting a Large-scale Elastic Environment-Recontextualization and Adaptive Cloud Services for Scientiﬁc Computing.” ICSOFT, 2012. [9] M. Beyer and D. Laney, “The importance of ’big data’: A deﬁnition,” June 2012. [Online]. Available: https://www.gartner.com/doc/2057415/ importance-big-data-deﬁnition [10] B. Martino, R. Aversa, and G. Cretella, “Big data (lost) in the cloud,” Int. J. Big Data Intelligence, vol. 1, 2014. [11] K. Grolinger, M. Hayes, and W. Higashino, “Challenges for MapReduce in Big Data,” IEEE 10th 2014 World Congress on Services, 2014. [12] E. G. J. Coffman, M. Garey, and D. S. Johnson, “Approximation Algorithms for Bin Packing: A Survey,” Approximation Algorithms, pp. 1–53, 1996. [13] P. Hayes, “RDF Semantics,” W3C Recommendation, vol. 10, pp. 1–45, 2004. [Online]. Available: http://www.w3.org/TR/2004/ REC-rdf-mt-20040210/

University Staff: Request a correction | Centaur Editors: Update this record

Search Google Scholar