Muhammad Waqar Aziz,Maha Maqbool Sethi,Ali Sayyed,Kifayat Ullah,



Smart Mirror,Depression,Cognitive Behavior Therapy,Convolution Neural Network,Internet of Things ,


Health is a precious gift from God. Both physical and mental health is equally important for living a quality life. Negligence towards mental health creates a lot of serious health problems affecting both physical health and society. Mental health is associated with better performance, high efficiency, and lesser work environment mishaps. Internet of Things technologies can possibly create smart products that can react to human needs and improve the quality of life and can make traditional environments more favorable and intelligent. One such internet of things solution is the design and development of smart mirrors. The opportunity to apply smart technology to healthcare to foresee and to monitor aspects of mental health is a natural but mostly underdeveloped idea. Although several smart mirror solutions have been proposed for different purposes, it has not been developed for the treatment of depression. We believe that smart mirrors involving a combination of hardware and software could identify depression as well as offer feedback for corrective measures and remedial activities. This paper examines the potential use of a smart mirror in healthcare and examines how this technology might benefit users in resolving depression. We present the design and development of a smart mirror that can diagnose and provide digitized treatment to resolve depression. The developed mirror is tested on humans, and from the obtained results, it is concluded that the developed mirror is more accurate and inexpensive as compared to existing smart mirrors.


I. A. A. E. Hippocrate, E. T. Luhanga, T. Masashi, K. Watanabe, K. Yasumoto, Smart gyms need smart mirrors: design of a smart gym concept through contextual inquiry, in: Proceedings of the 2017 ACM International Joint Conference Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers, 2017, pp. 658-661.
II. A. Jhala, “emotions” (psychology) (01 2015).
III. A. Olowolayemo, S. Alenazi, F. A. S. Seri, Mirror that talks: A self-motivating personal vision assistant, in: Proceedings of the 2018 International Conference on Image and Graphics Processing, 2018, pp. 157-161.
IV. A. S. A. Mohamed, M. A. Wahab, S. Suhaily, D. B. L. Arasu, Smart mirror design powered by raspberry pi, in: Proceedings of the 2018 Artificial Intelligence and Cloud Computing Conference, 2018, pp. 161-171
V. A. Salgian, D. Vickerman, D. Vassallo, A smart mirror for music conducting exercises, in: Proceedings of the on Thematic Workshops of ACM Multimedia 2017, 2017, pp. 544-549.
VI. B. G. Shapero, J. Greenberg, P. Pedrelli, G. Desbordes, S. W. Lazar, Mindfulness-based cognitive therapy, in: The Massachusetts General Hospital Guide to Depression, Springer, 2019, pp. 167-177.
VII. C. Gold, Signal and noise in music therapy outcome studies (2014).
VIII. C. Sethukkarasi, V. S. Harikrishnan, R. Pitchiah, Design and development of in-teractive mirror for aware home, 2012.
IX. D. Besserer, J. Baurle, A. Nikic, F. Honold, F. Schussel, M. Weber, Fitmirror: a smart mirror for positive affect in everyday user morning routines, in: Proceedings of the Workshop on Multimodal Analyses enabling Arti cial Agents in Human-Machine Interaction, 2016, pp. 48-55.
X. D. O. Antonuccio, W. G. Danton, G. Y. DeNelsky, Psychotherapy versus medication for depression: challenging the conventional wisdom with data., Professional Psychology: Research and Practice 26 (6) (1995) 574
XI. E. Iwabuchi, M. Nakagawa, I. Siio, Smart makeup mirror: Computer-augmented mirror to aid makeup application, in: International Conference on Human-Computer Interaction Springer, 2009, pp. 495-503.
XII. J. Erkkila, M. Punkanen, J. Fachner, E. Ala-Ruona, I. Pontio, M. Tervaniemi, Vanhala, C. Gold, Individual music therapy for depression: randomised controlled trial, The British journal of psychiatry 199 (2) (2011) 132-139
XIII. J. LeMoult, I. H. Gotlib, Depression: A cognitive perspective, Clinical Psychology Review 69 (2019) 51-66.
XIV. K. Fujinami, F. Kawsar, T. Nakajima, Awaremirror: a personalized display using a mirror, in: International Conference on Pervasive Computing, Springer, 2005, pp. 315-332.
XV. K. Jin, X. Deng, Z. Huang, S. Chen, Design of the smart mirror based on raspberry pi, in: 2018 2nd IEEE Advanced Information Management, Communicates, Elec-tronic and Automation Control Conference (IMCEC), IEEE, 2018, pp. 1919-1923.
XVI. M. A. Hossain, P. K. Atrey, A. El Saddik, Smart mirror for ambient home environment (2007).
XVII. M. H. Jasim, M. M. Salih, Z. T. Abdulwahhab, M. L. Shouwandy, M. A. Ahmed, A. ALsalem, A. K. Hamzah, Emotion detection among Muslims and non-Muslims while listening to Quran recitation using EEG (2019).
XVIII. M. M. Khan, et al., Economic burden of mental illnesses in Pakistan., Journal of Mental Health Policy and Economics 19 (3) (2016) 155.
XIX. N. Alavi, M. Omrani, What is depression? what is anxiety?, in: Online Cognitive Behavioral Therapy, Springer, 2019, pp. 1731.
XX. O. Gomez-Carmona, D. Casado-Mansilla, Smiwork: An interactive smart mirror platform for workplace health promotion, in: 2017 2nd International Multidisciplinary Conference on Computer and Energy Science (SpliTech), IEEE, 2017, pp. 1-6
XXI. P. Burkert, F. Trier, M. Z. Afzal, A. Dengel, M. Liwicki, Dexpression: Deep convolutional neural network for expression recognition, arXiv preprint arXiv:1509.05371 (2015).
XXII. P. Deepan, L.R. Sudha, : Fusion of Deep Learning Models for Improving Classification Accuracy of Remote Sensing Images, J. Mech. Cont.& Math. Sci., Vol.-14, No.-5, September-October (2019) pp 189-201.
XXIII. P. Henriquez, B. J. Matuszewski, Y. Andreu-Cabedo, L. Bastiani, S. Colantonio, Coppini, M. D’Acunto, R. Favilla, D. Germanese, D. Giorgi, et al., Mirror mirror on the wall… an unobtrusive intelligent multisensory mirror for well-being status self-assessment and visualization, IEEE transactions on multimedia 19 (7) (2017) 1467-1481.
XXIV. R. Miotto, M. Danieletto, J. R. Scelza, B. A. Kidd, J. T. Dudley, Reflecting health: smart mirrors for personalized medicine, NPJ digital medicine 1 (1) (2018) 1-7.
XXV. R. Ra que, A. Anjum, S. S. Raheem, Efficacy of surah al-Rehman in managing depression in Muslim women, Journal of religion and health 58 (2) (2019) 516-526.
XXVI. R. Santhoshkumar, M. Kalaiselvi Geetha, : Deep Learning Approach: Emotion Recognition from Human Body Movements, J. Mech. Cont.& Math. Sci., Vol.-14, No.-3, May-June (2019) pp 182-195.
XXVII. R. Siripala, M. Nirosha, P. Jayaweera, N. Dananjaya, S. Fernando, Raspbian magic mirror-a smart mirror to monitor children by using raspberry pi technology, Inter-national Journal of Scientific and Research Publications 7 (12) (2017) 281-295.
XXVIII. S. Bianco, L. Celona, P. Napoletano, Visual-based sentiment logging in magic smart mirrors, in: 2018 IEEE 8th International Conference on Consumer Electronics-Berlin (ICCE-Berlin), IEEE, 2018, pp. 1-4.
XXIX. S. S. Rashid J, Fareed AM, Mental health system in Pakistan. (2009).
XXX. S. Tripathi, S. Acharya, R. D. Sharma, S. Mittal, S. Bhattacharya, Using deep and convolutional neural networks for accurate emotion classification on deep dataset, in: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, 2017, pp. 4746-4752.
XXXI. S. Xu, Y. Cheng, Q. Lin, J. Allebach, Emotion recognition using convolutional neural networks, Electronic Imaging 2019 (8) (2019) 402-1.
XXXII. WHO, Depression and other common mental disorders: global health estimates, Geneva: World Health Organization (2017) 1-24.
XXXIII. Y. B. Moon, S. W. Oh, H. J. Kang, H. S. Lee, S. J. Kim, H. C. Bang, Smart mirror health management services based on IoT platform, in: Proceedings of the 14th International Conference on Applications of Computer Engineering (ACE’15), 2015, pp. 87-89.
XXXIV. Y.-C. Yu, S. D. You, D.-R. Tsai, Magic mirror table for social-emotion alleviation in the smart home, IEEE Transactions on Consumer Electronics 58 (1) (2012) 126-131.

View Download