Research Article

A Scalable IoT–Cloud Architecture with Deep Q-Learning for Air Quality Monitoring and Alerting

by  Benjamin Aidoo, Frederick Kwame Minta, Abdul-Aziz N-Yo, Derrick Attoh Tettey, Osbert Kasiimbura, Albert Essilfie
journal cover
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 187 - Issue 23
Published: July 2025
Authors: Benjamin Aidoo, Frederick Kwame Minta, Abdul-Aziz N-Yo, Derrick Attoh Tettey, Osbert Kasiimbura, Albert Essilfie
10.5120/ijca2025925461
PDF

Benjamin Aidoo, Frederick Kwame Minta, Abdul-Aziz N-Yo, Derrick Attoh Tettey, Osbert Kasiimbura, Albert Essilfie . A Scalable IoT–Cloud Architecture with Deep Q-Learning for Air Quality Monitoring and Alerting. International Journal of Computer Applications. 187, 23 (July 2025), 44-51. DOI=10.5120/ijca2025925461

                        @article{ 10.5120/ijca2025925461,
                        author  = { Benjamin Aidoo,Frederick Kwame Minta,Abdul-Aziz N-Yo,Derrick Attoh Tettey,Osbert Kasiimbura,Albert Essilfie },
                        title   = { A Scalable IoT–Cloud Architecture with Deep Q-Learning for Air Quality Monitoring and Alerting },
                        journal = { International Journal of Computer Applications },
                        year    = { 2025 },
                        volume  = { 187 },
                        number  = { 23 },
                        pages   = { 44-51 },
                        doi     = { 10.5120/ijca2025925461 },
                        publisher = { Foundation of Computer Science (FCS), NY, USA }
                        }
                        %0 Journal Article
                        %D 2025
                        %A Benjamin Aidoo
                        %A Frederick Kwame Minta
                        %A Abdul-Aziz N-Yo
                        %A Derrick Attoh Tettey
                        %A Osbert Kasiimbura
                        %A Albert Essilfie
                        %T A Scalable IoT–Cloud Architecture with Deep Q-Learning for Air Quality Monitoring and Alerting%T 
                        %J International Journal of Computer Applications
                        %V 187
                        %N 23
                        %P 44-51
                        %R 10.5120/ijca2025925461
                        %I Foundation of Computer Science (FCS), NY, USA
Abstract

Air pollution poses a growing threat to public health in rapidly urbanizing cities, particularly in Sub-Saharan Africa, where real-time monitoring infrastructure is limited. This paper presents the design and implementation of a scalable IoT and cloud-based architecture for air quality monitoring and intelligent alerting in Accra, Ghana. The system integrates low-cost ESP32-based sensor nodes with a Deep Q-Network (DQN) to classify pollution severity and issue adaptive, context-aware alerts. Eight key environmental parameters, including PM1.0, PM2.5, PM10, VOCs, CO, LPG, temperature, and humidity, are continuously monitored and analyzed using cloud-based processing. Real-time data is visualized through a web dashboard, while critical alerts are disseminated via SMS to ensure user accessibility. The DQN agent supports decision transparency through Q-values, feature importance, and temporal trend analysis. Experimental results demonstrate a training accuracy of 89% and a field test classification accuracy of 82.9%, confirming the system’s effectiveness for scalable, real-time, and interpretable environmental health monitoring in resource-constrained settings.

References
  • E. Matei et al., “Heavy Metals in Particulate Matter—Trends and Impacts on Environment,” Molecules, vol. 30, no. 7, p. 1455, 2025.
  • J. Yang, Q. Ju, S. Chen, C. Xu, and Y. Cao, “Spatiotemporal Evolution of Regional Air Pollution Exposure and Health Effects Assessment in Jiangsu Province, China,” Atmosphere, vol. 16, no. 4, p. 446, 2025.
  • G. S. Jenkins, “The Lack of Real-Time Air Pollution Monitoring in Africa Supports Environmental Injustice,” Environ. Justice, vol. 18, no. 2, pp. 85–89, Apr. 2025, doi: 10.1089/env.2023.0030.
  • S. Saleh, H. Jumaah, Z. Khalaf, and S. Jumaah, “Design of Multi-gas Monitoring Device for Indoor Air Quality,” J. Electron. Inf. Syst., vol. 5, Feb. 2023, doi: 10.30564/jeis.v5i1.5390.
  • C. Marche et al., “Secure and Trusted Crowdsensing for Outdoor Air Quality Monitoring: State of the Art and Perspectives,” Sensors, vol. 25, no. 12, Art. no. 12, Jan. 2025, doi: 10.3390/s25123573.
  • A. Kumar, M. Kumari, and H. Gupta, “Design and analysis of iot based air quality monitoring system,” in 2020 International Conference on Power Electronics & IoT Applications in Renewable Energy and its Control (PARC), IEEE, 2020, pp. 242–245. Accessed: May 23, 2025. [Online]. Available: https://ieeexplore.ieee.org/abstract/document/9087064/?casa_token=aNKTf6PzxmgAAAAA:LhIPewve8ISDu0jKpLm2MDsSPCNb0ZMorT6UpMaBlk9ZvaBdt6zDVi4HmOLkwRzAU2bO9WoiJalZuA
  • J. Duan, Y. Gong, J. Luo, and Z. Zhao, “Air-quality prediction based on the ARIMA-CNN-LSTM combination model optimized by dung beetle optimizer,” Sci. Rep., vol. 13, no. 1, p. 12127, Jul. 2023, doi: 10.1038/s41598-023-36620-4.
  • J. Zhang and S. Li, “Air quality index forecast in Beijing based on CNN-LSTM multi-model,” Chemosphere, vol. 308, p. 136180, Dec. 2022, doi: 10.1016/j.chemosphere.2022.136180.
  • A. Nguyen, P. Duy Hoang, B. Oo, Y. Ahn, and B. Lim, “Predicting air quality index using attention hybrid deep learning and quantum-inspired particle swarm optimization,” J. Big Data, vol. 11, May 2024, doi: 10.1186/s40537-024-00926-5.
  • P. C. Sheetal Bawane, “Forecasting of air quality index using Machine Learning and deep learning models,” J. Neonatal Surg., vol. 14, no. 18S, Art. no. 18S, Apr. 2025.
  • N. Bandara, S. Hettiarachchi, and P. Athukorala, “AirSPEC: An IoT-empowered Air Quality Monitoring System integrated with a Machine Learning Framework to Detect and Predict defined Air Quality parameters,” arXiv.org. Accessed: Jun. 15, 2025. [Online]. Available: https://arxiv.org/abs/2111.14125v1
  • M. E. Karar, A. M. Al-Masaad, and O. Reyad, “GASDUINO-Wireless Air Quality Monitoring System Using Internet of Things,” arXiv.org. Accessed: Jun. 15, 2025. [Online]. Available: https://arxiv.org/abs/2005.04126v1
Index Terms
Computer Science
Information Sciences
No index terms available.
Keywords

Air Quality Monitoring Deep Q-Network ESP32 IoT Reinforcement Learning Cloud Infrastructure Environmental Sensing Smart Cities.

Powered by PhDFocusTM