Analysis and Design of Efficient HDFS Data Encryption Algorithm: A Review

Abstract

Large amounts of structured and unstructured data can be handled using big data. Companies utilize Big Data for a variety of purposes, including improving customer service and taking other profitable actions. Big Data gives benefits such as better customer insight, improved performance, more insight full market performance, agile supply chain management, data-driven innovation, smart recommendations, and targeting to the business. Hadoop is a well-built technology which mainly used for the distributed processing and storage of a large amount of data. Hadoop itself does not provide any security so the encryption zone is used for security purposes, but this is a weakness of this strategy from the attacker’s point of view. The primary objective of this research is to look into the different encryption techniques utilized in the Hadoop Distributed File System. In this paper, we have discussed ‘data at rest’ HDFS data encryption algorithm. We choose the efficient algorithm that gives better performance at the storage level, when working with big data on the cloud. Firstly, we have discussed the introduction part to explain the paper’s background, review of the literature to discuss the theory behind the research, research methodology, comparative analysis, and last conclusion and future work.