Open Access Open Access  Restricted Access Subscription or Fee Access

Data and Program-flows in Data Analytics Framework and Cloud Environment

Suryakant Soni

Abstract


Data generates at various sources. Data also have various formats. Organizing and managing data are at the cloud. Cloud stores and hosts number of applications and services. Cloud usage ensures availability. The scaling up and scaling out are at minimum cost. Cloud manages user’s requests at large scale efficiently. Big data are large data sets above 10 M byte and extend to Peta Bytes. Storage and analysis of big data need unconventional data storage and processing approaches. Data analytics extract hidden information or patterns in existing data sets. The analysis improves understanding, improve decision making process and discover new knowledge. The present work describes the architecture layers for data and program flows in Data Analytics Framework and Cloud Environment.

Full Text:

PDF

References


Prema A., and A. Pethalakshmi. Novel approach in ETL. International Conference on Pattern Recognition, Informatics and Mobile Engineering; 2013 Feb 21-22; Salem, India, New york:IEEE; 2013.

Diouf Papa Senghane, Aliou Boly, and Samba Ndiaye. Variety of data in the ETL processes in the cloud: State of the art. 2018 IEEE International Conference on Innovative Research and Development (ICIRD); 2018 May 11-12; Bangkok, Thailand, New york: IEEE, 2018.

Rathore Muhammad Mazhar Ullah, Anand Paul, et al. Real-time big data analytical architecture for remote sensing application. IEEE journal of selected topics in applied earth observations and remote sensing. 2015; 8(10):4610-4621.

Ong In Lih, Pei Hwa Siew, and Siew Fan Wong. A five-layered business intelligence architecture. Communications of the IBIMA. 2011; 2011(2011):1-11.

Agrawal Rajeev, Ashiq Imran, et al. A layer based architecture for provenance in big data. 2014 IEEE International Conference on Big Data (Big Data); 2014 Oct. 27-30; Washington, DC, USA, New york: IEEE; 2015.

Pokorný Jaroslav. New database architectures: Steps towards big data processing. IADIS International Conference Intelligent Systems and Agents; 2013.

Sanjay Manjula, and B. H. Alamma. An insight into big data analytics—Methods and application. 2016 International Conference on Inventive Computation Technologies (ICICT); 2016 Aug. 26-27; Coimbatore, India, NY: IEEE; 2017.

Bansal Srividya K., and Sebastian Kagemann. Integrating big data: a semantic extract-transform-load framework. Computer. 2015; 48(3):42-50.

Fan Xiaojiang, Zheng Liwei and Liu Jianbin. Measurement for social network data currency and trustworthiness. 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA). 2017 Apr. 28-30; Chengdu, NY: IEEE; 2017.

Quan Zou. Research on cloud computing for disaster monitoring using massive remote sensing data. 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA); 2017 Apr. 28-30; Chengdu, China, NY: IEEE; 2017.

Yan Zhang and Dongfeng Yuan. Modeling and exploiting bibliographic Network for publication ranking, 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA); 2017 Apr. 28-30; Chengdu, New york:IEEE; 2017.

Xu Xiao-tao, Yang Chen, Dai Guang-hua and Ma Hua-long. Information service quality evaluation study of cloud computing environment based on big data. 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA); 2017 Apr. 28-30; Chengdu, China, New York: IEEE; 2017.

Jiangqi Chen, Ting Zhao, Yang Yang and Di Zhang. Feature extraction and evaluation of electricity load data with high precision. 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA); 2017 Apr. 28-30; Chengdu, China, New york: IEEE; 2017.

Yingxin She, Ruowei Su, et al. Big data analysis based private college teaching cost problem detection and improvement, 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA); 2017 Apr. 28-30; Chengdu, China, New york: IEEE; 2017.

Pier Paolo Ippolito, Towards Data Science. Big Data Analysis: Spark and Hadoop [Online]. Available from https://towardsdatascience.com/big-data-analysis-spark-and-hadoop-a11ba591c 057. [Accessed Jun.11, 2019].

Hindman Benjamin, Andy Konwinski, et al. Mesos: A platform for fine-grained resource sharing in the data center. NSDI'11. 2011;11:295–308.

Mayur R. Palankar, Adriana Iamnitchi, et al. Amazon S3 for science grids: a viable solution?. Proceedings of the 2008 international workshop on Data-aware distributed computing. 2008; 55-64.




DOI: https://doi.org/10.37628/ijods.v7i1.671

Refbacks

  • There are currently no refbacks.