Empowering Diversity in Education: A Web-Based Tool for Real-Time Sign Language Detection

Authors

  • Shefqet Meda Canadian Institute of Technology, Albania International Balkan University, Skopje, North Macedonia
  • Oresti Leka Canadian Institute of Technology, Albania
  • Hiqmet Kamberaj International Balkan University, North Macedonia

Keywords:

Diversity in Education, Artificial Intelligence, Machine Learning, Sign Language Detection

Abstract

This study aims to give an overview of the disabilities faced by people around the world and, in particular, in Albania. It also highlights the primary concern of the deaf community, such as the expression. This study presents a solution to this problem through a real-time sign language detection web application. First, the structural and functional aspects of the application are described by the standard software specification requirements. Then, a description of the software architecture follows. The technological aspect of the application is entirely defined by expressing all the significant implementations of each programming language contained behind the software diagrams and architecture. The main goal is to provide the latest technologies in the market combined with a well-planned and developed image detection application that is scalable, portable, maintainable, and efficient in Empowering Diversity in Education. This technologically up-to-date application is delivered as a full-stack web application. The application produces results that waver between 85%-95% quality off detection; it consists of a bi-partite backend, one for creating and compiling models, namely Python, TensorFlow, and Jupyter Notebooks, and the other part held by Node.JS to power the front-end built with React and TensorFlow's JS. This study presents a fully developed web-based application that has the potential to impact and improve diversity in education significantly.

References

Rights, Canadian Museum for Human. Canadian Museum for Human Rights. https://humanrights.ca/story/language-rights-are-human-rights. [Online] September 2019. https://humanrights.ca/story/language-rights-are-human-rights.

WHO. Deafness and hearing loss. www.who.int. [Online] 2. February 2024. https://www.who.int/news-room/fact-sheets/detail/deafness-and-hearing-loss.

Collaborators, GBD 2019 Hearing Loss. Hearing loss prevalence and years lived with disability, 1990–2019: findings from the Global Burden of Disease Study 2019. www.ncbi.nlm.nih.gov. [Online] 13. March 2021. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7960691/#bib12.

Profili i Personave me Aftësi të kufizuar në Shqipëri. INSTAT. místo neznámé : INSTAT, 2019, Instat, str. https://www.instat.gov.al/media/3706/profili_i__personave_me_aft_si_t__kufizuar_n__shqip_ri.pdf.

Géron, Aurélien. Hands-On-Machine-Learning-with-Scikit-Learn-Keras-and-Tensorflow. místo neznámé : O'Reilly, 2019.

Ramalho, Luciano. Fluent Python. místo neznámé : O'Reilly Media, 2022.

Alex Banks, Eve Porcello. Learning React: Modern Patterns for Developing React Apps. místo neznámé : O'Reilly Media, 2020.

Mario Casciaro, Luciano Mammino. Node.js Design Patterns - Third edition: Design and implement production-grade Node.js applications using proven patterns and techniques. místo neznámé : Packt Publishing, 2020.

Osmani, Addy. Learning JavaScript Design Patterns: A JavaScript and React Developer's Guide. místo neznámé : O'Reilly Media, 2023.

WHO. https://www.who.int/news-room/facts-in-pictures/detail/deafness. https://www.who.int. [Online] 23. April 2024. [Citace: 23. April 2024.] https://www.who.int/.

Finnish Association of the Deaf. Deaf People in Albania in 2015. A survey study. [Editor] I. Lahtinen and P. Rainò. místo neznámé : Gent Grafik, 2016.

INSTAT. http://www.instat.gov.al/media/3706. http://www.instat.gov.al/. [Online] 2019. [Citace: 23. April 2024.] http://www.instat.gov.al/.

G, Eriglen, K, Alda a G, Bruno. A Real-Time Vision-Based System for Recognition of Static Dactyls of Albanian Alphabet. [autor knihy] Finish Association of the Deaf. Deaf People in Albania. 2015.

Convolution neural network-based automatic localisation of landmarks on lateral x-ray images. Rabie, A. R., a další. 2022, Multimed Tools Appl, Sv. 81, stránky 37403–37415.

Gates, B. AI is about to supercharge the innovation pipeline. AI is about to supercharge the innovation pipeline. místo neznámé : LinkedIn, 26. December 2023.

depositphotos.com. Set of deaf and dumb language. Set of deaf and dumb language. [Online] https://depositphotos.com/photo/set-deaf-dumb-language-tattooed-male-hands-latin-alphabet-isolated-231581414.html.

Chemistry, Royal Society of. 3D graphene adds dimension to deaf–mute communication. [Online] 23. August 2016. https://www.chemistryworld.com/news/3d-graphene-adds-dimension-to-deaf-mute-communication/1017315.article.

mozilla.org. MVC. [Online] 2024. https://developer.mozilla.org/en-US/docs/Glossary.

RedMonk. The RedMonk Programming Language Rankings: January 2024. [Online] 8. March 2024. https://redmonk.com/sogrady/2024/03/08/language-rankings-1-24/.

Trends, Google. Pytorch-TensorFlow. [Online] 28. January 2024. https://trends.google.com/trends/explore?geo=US&q=pytorch,tensorflow.

Yankiver, D. 5 Major Companies That Use Node.js and Why - Nerd For Tech - Medium. [Online] 31. May 2021. https://medium.com/nerd-for-tech/5-major-companies-that-use-node-js-and-why-211fb5cc267d.

With, Built. React Usage Statistics. [Online] February 2024. https://trends.builtwith.com/javascript/React.

Fitzpatrick, Dr Martin. Create GUI Applications with Python & Qt5: The hands-on guide to making apps with Python. místo neznámé : Kindle edition, 2022.

O. Leka, Sh.Meda, H.Kamberaj. Oresti9919 - SignLanguageApp. [Online] July 2023. https://github.com/Oresti9919/SignLanguageApp/tree/main.

Downloads

Published

2024-07-16

How to Cite

Meda, S., Leka, O., & Kamberaj, H. (2024). Empowering Diversity in Education: A Web-Based Tool for Real-Time Sign Language Detection. ESI Preprints, 31, 229. Retrieved from https://esipreprints.org/index.php/esipreprints/article/view/1189

Issue

Section

Preprints

Similar Articles

1 2 3 4 5 6 7 8 9 10 > >> 

You may also start an advanced similarity search for this article.