Deep Learning-based Decision Support System for classification of COVID-19 and Pneumonia patients

Misha Urooj Khan, Zubair Saeed, Ali Raza, Zeeshan Abbasi, Syeda Zuriat-e-Zehra Ali, Hareem Khan


The fast spread of Coronavirus (COVID-19) poses a huge risk to people all around the world. Recently, COVID-19 testing kits have been unavailable due to rise in effected people and large demand of tests. Keeping the urgency of the situation in mind, an automatic diagnosis method for early detection of COVID-19 is needed. The proposed deep learning decision support system (DSS) for COVID-19 employs MobileNet v2 Deep learning (DL) model for effective and accurate detection. Here we collected Cough auscultations through self-designed digital sensor. The primary experimental results show that the maximum accuracy for training is around 99.91%, and the maximum accuracy for validation is 98.61%, with 97.5% precision, 98.5%recall, and 98% F1-score. The Deep Learning-based model described here strives for similar performance to medical professionals and can help pulmonologist/radiologists increase their working productivity.

Full Text:



“COVID Live Update: 266,849,323 Cases and 5,281,054 Deaths from the Coronavirus - Worldometer.” (accessed Dec. 07, 2021).

“World Health Organization.” novel-coronavirus-2019/question-and-answers-hub/q-a-detail/q-acoronaviruses/ (accessed Dec. 07, 2021).

Sait, Unais, et al. "A deep-learning based multimodal system for Covid-19 diagnosis using breathing sounds and chest X-ray images." Applied Soft Computing (2021): 107522.

Ahmad, Shandar. "Potential of age distribution profiles for the prediction of COVID-19 infection origin in a patient group." Informatics in medicine unlocked 20 (2020): 100364.

Aziz, Sumair, et al. "An Automated System towards Diagnosis of Pneumonia using Pulmonary Auscultations." 2019 13th International Conference on Mathematics, Actuarial Science, Computer Science and Statistics (MACS). IEEE, 2019.

D. S. Morillo, A. L. Jiménez, and S. A. Moreno, “Computer-aided diagnosis of pneumonia in patients with chronic obstructive pulmonary disease,” J. Am. Med. Inform. Assoc., vol. 20, no. e1, 2013, doi: 10.1136/AMIAJNL-2012-001171.

Paraschiv, Elena-Anca, and Cătălina-Maria Rotaru. "Machine Learning Approaches based on Wearable Devices for Respiratory Diseases Diagnosis." 2020 International Conference on e-Health and Bioengineering (EHB). IEEE, 2020.

Sait, Unais, et al. "A deep-learning based multimodal system for Covid-19 diagnosis using breathing sounds and chest X-ray images." Applied Soft Computing (2021): 107522.

Chhikara, Prateek, et al. "Deep convolutional neural network with transfer learning for detecting pneumonia on chest X-rays." Advances in Bioinformatics, Multimedia, and Electronics Circuits and Signals. Springer, Singapore, 2020. 155-168.

Horry, Michael J., et al. "COVID-19 detection through transfer learning using multimodal imaging data." IEEE Access 8 (2020): 149808-149824.

Pal, Ankit, and Malaikannan Sankarasubbu. "Pay attention to the cough: Early diagnosis of COVID-19 using interpretable symptoms embeddings with cough sound signal processing." Proceedings of the 36th Annual ACM Symposium on Applied Computing. 2021.

H. P. Chan, R. K. Samala, L. M. Hadjiiski, and C. Zhou, “Deep Learning in Medical Image Analysis,” Adv. Exp. Med. Biol., vol. 1213, pp. 3–21, 2020, doi: 10.1007/978-3-030-33128-3_1.

H. Aygün and A. Apolskis, “The quality and reliability of the mechanical stethoscopes and Laser Doppler Vibrometer (LDV) to record tracheal sounds,” Appl. Acoust., vol. 161, p. 107159, Apr. 2020, doi: 10.1016/J.APACOUST.2019.107159.

Y. hui Huang, Ying, et al. "The respiratory sound features of COVID-19 patients fill gaps between clinical data and screening methods." medRxiv (2020).

C. Brown et al., “Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data,” Proc. ACM SIGKDD Int. Conf. Knowl. Discov. Data Min., pp. 3474–3484, Jun. 2020, doi: 10.1145/3394486.3412865.

Imran, Ali, et al. "AI4COVID-19: AI enabled preliminary diagnosis for COVID-19 from cough samples via an app." Informatics in Medicine Unlocked 20 (2020): 100378.

Li, Fangyu, et al. "Wi-COVID: A COVID-19 symptom detection and patient monitoring framework using WiFi." Smart Health 19 (2021): 100147.

Khan, Misha Urooj, et al. "A Novel Intelligent Model For COVID-19 Detection Using Cough Auscultations and Hjorth Descriptors." ICAME21, International Conference on Advances in Mechanical Engineering, Pakistan. 2021.

M. U. Khan, A. Farman, A. U. Rehman, N. Israr, M. Z. H. Ali and Z. A. Gulshan, "Automated System Design for Classification of Chronic Lung Viruses using Non-Linear Dynamic System Features and K-Nearest Neighbour," 2021 Mohammad Ali Jinnah University International Conference on Computing (MAJICC), 2021, pp. 1-8, doi: 10.1109/MAJICC53071.2021.9526272.

Khan, Misha Urooj, et al. "Embedded System Design for Real-time Detection of Asthmatic Diseases Using Lung Sounds in Cepstral Domain." 6th International Electrical Engineering Conference (IEEC 2021) April, 2021 at NEDUET. 2021.

L. Khriji, A. Ammari, S. Messaoud, S. Bouaafia, A. Maraoui and M. Machhout, "COVID-19 Recognition Based on Patient's Coughing and Breathing Patterns Analysis: Deep Learning Approach," 2021 29th Conference of Open Innovations Association (FRUCT), 2021, pp. 185-191, doi: 10.23919/FRUCT52173.2021.9435454.

Vijayakumar, D. Sudaroli, and Monica Sneha. "Low cost Covid-19 preliminary diagnosis utilizing cough samples and keenly intellective deep learning approaches." Alexandria Engineering Journal 60.1 (2021): 549-557.

Zhu, Ziwei, et al. "Classification of COVID-19 by compressed chest CT image through deep learning on a large patients cohort." Interdisciplinary Sciences: Computational Life Sciences 13.1 (2021): 73-82.

Zhou, Min, et al. "Deep learning for differentiating novel coronavirus pneumonia and influenza pneumonia." Annals of Translational Medicine 9.2 (2021).

Maghdid, Halgurd S., et al. "Diagnosing COVID-19 pneumonia from X-ray and CT images using deep learning and transfer learning algorithms." Multimodal Image Exploitation and Learning 2021. Vol. 11734. International Society for Optics and Photonics, 2021.

S. Z. H. Naqvi, M. Arooj, S. Aziz, M. U. Khan, M. A. Choudhary and M. N. ul. Hassan, "Spectral Analysis of Lungs sounds for Classification of Asthma and Pneumonia Wheezing," 2020 International Conference on Electrical, Communication, and Computer Engineering (ICECCE), 2020, pp. 1-6, doi: 10.1109/ICECCE49384.2020.9179417.

Zhang, Hai-tao, et al. "Automated detection and quantification of COVID-19 pneumonia: CT imaging analysis by a deep learning-based software." European journal of nuclear medicine and molecular imaging 47.11 (2020): 2525-2532.

A. Serener and S. Serte, "Deep learning for mycoplasma pneumonia discrimination from pneumonias like COVID-19," 2020 4th International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), 2020, pp. 1-5, doi: 10.1109/ISMSIT50672.2020.9254561.

El Asnaoui, Khalid, and Youness Chawki. "Using X-ray images and deep learning for automated detection of coronavirus disease." Journal of Biomolecular Structure and Dynamics (2020): 1-12.

Yildirim, Muhammed, and Ahmet Cevahir Cinar. "A Deep Learning Based Hybrid Approach for COVID-19 Disease Detections." Traitement du Signal 37.3 (2020): 461-468.

Zhou, Min, et al. "Improved deep learning model for differentiating novel coronavirus pneumonia and influenza pneumonia." medRxiv (2020).

Alazab, Moutaz, et al. "COVID-19 prediction and detection using deep learning." International Journal of Computer Information Systems and Industrial Management Applications 12 (2020): 168-181.

P. Mouawad, T. Dubnov, and S. Dubnov, “Robust Detection of COVID-19 in Cough Sounds: Using Recurrence Dynamics and Variable Markov Model,” SN Comput. Sci., vol. 2, no. 1, Feb. 2021, doi: 10.1007/S42979-020-00422-6.

M. Melek, “Diagnosis of COVID-19 and non-COVID-19 patients by classifying only a single cough sound,” Neural Comput. Appl., vol. 33, no. 24, pp. 17621–17632, Dec. 2021, doi: 10.1007/S00521-021-06346-3.

M. A. Kobat et al., “Automated COVID-19 and Heart Failure Detection Using DNA Pattern Technique with Cough Sounds,” Diagnostics, vol. 11, no. 11, p. 1962, Oct. 2021, doi: 10.3390/DIAGNOSTICS11111962.

“ImageNet.” (accessed Sep. 10, 2021).

F. Zhuang et al., “A Comprehensive Survey on Transfer Learning,” Proc. IEEE, vol. 109, no. 1, pp. 43–76, Jan. 2021, doi: 10.1109/JPROC.2020.3004555.

K. Dong, C. Zhou, Y. Ruan, and Y. Li, “MobileNetV2 Model for Image Classification,” Proc. - 2020 2nd Int. Conf. Inf. Technol. Comput. Appl. ITCA 2020, pp. 476–480, Dec. 2020, doi: 10.1109/ITCA52113.2020.00106.

M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L. C. Chen, “MobileNetV2: Inverted Residuals and Linear Bottlenecks,” Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 4510–4520, Dec. 2018, doi: 10.1109/CVPR.2018.00474.

Z. Zhang, “Improved Adam Optimizer for Deep Neural Networks,” 2018 IEEE/ACM 26th Int. Symp. Qual. Serv. IWQoS 2018, Jan. 2019, doi: 10.1109/IWQOS.2018.8624183.

D. Gong, Z. Zhang, Q. Shi, A. Van Den Hengel, C. Shen, and Y. Zhang, “Learning Deep Gradient Descent Optimization for Image Deconvolution,” IEEE Trans. Neural Networks Learn. Syst., vol. 31, no. 12, pp. 5468–5482, Dec. 2020, doi: 10.1109/TNNLS.2020.2968289.

M. U. Khan, S. Samer, A. Samer, A. Mobeen, A. Arshad, and H. Khan, “Classification of Phonocardiography based Heart Auscultations while Listening to Tilawat-e-Quran and Music Using Vibrational Mode Decomposition,” 2021 Int. Conf. Appl. Eng. Math., pp. 25–30, Aug. 2021, doi: 10.1109/ICAEM53552.2021.9547150.

M. U. Khan, H. Khan, M. Muneeb, Z. Abbasi, U. B. Abbasi, and N. K. Baloch, “Supervised Machine Learning based Fast Hand Gesture Recognition and Classification Using Electromyography (EMG) Signals,” 2021 Int. Conf. Appl. Eng. Math., pp. 81–86, Aug. 2021, doi: 10.1109/ICAEM53552.2021.9547148.

M. U. Khan, A. Mobeen, S. Samer, and A. Samer, “Embedded System Design for Real-time Detection of Asthmatic Diseases Using Lung Sounds in Cepstral Domain,” in 6th International Electrical Engineering Conference (IEEC 2021) April, 2021 at NEDUET, Karachi, Pakistan, 2021, pp. 1–6, [Online]. Available:



  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.