International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
|
Volume 185 - Issue 9 |
Published: May 2023 |
Authors: Kiran Peddireddy |
![]() |
Kiran Peddireddy . Kafka-based Architecture in Building Data Lakes for Real-time Data Streams. International Journal of Computer Applications. 185, 9 (May 2023), 1-3. DOI=10.5120/ijca2023922740
@article{ 10.5120/ijca2023922740, author = { Kiran Peddireddy }, title = { Kafka-based Architecture in Building Data Lakes for Real-time Data Streams }, journal = { International Journal of Computer Applications }, year = { 2023 }, volume = { 185 }, number = { 9 }, pages = { 1-3 }, doi = { 10.5120/ijca2023922740 }, publisher = { Foundation of Computer Science (FCS), NY, USA } }
%0 Journal Article %D 2023 %A Kiran Peddireddy %T Kafka-based Architecture in Building Data Lakes for Real-time Data Streams%T %J International Journal of Computer Applications %V 185 %N 9 %P 1-3 %R 10.5120/ijca2023922740 %I Foundation of Computer Science (FCS), NY, USA
The purpose of this paper is to investigate how Kafka can be used to construct data lakes for real-time data processing. Kafka has gained widespread popularity as a data ingestion and processing tool that offers scalability, fault tolerance, and flexibility. The benefits of utilizing Kafka in a data lake architecture are analyzed, as well as the procedures involved in utilizing Kafka in a data lake architecture. In addition, a case study is provided of a major financial institution that utilized Kafka to establish a data lake. The significance of Kafka in modern data processing is emphasized in this paper, as well as its worth in developing data lakes for real-time data processing.