Tetra amelia • Visually Impaired • Speech/Hearing Impaired • Dementia • Voice Assistant Video Call
Ministry/Organization Name - Ministry of Rural Development
Problem Statement - Making websites meaningful for differently Abled citizens with open source tools.
-
Ministry of Rural Development is currently running several schemes and programs primarily focusing on the development of rural poor. It is important to note that as per census 2011 (2016 updated) – In India out of the 121 Cr population, 2.68 Cr persons are disabled and (69%) of the disabled population resided in rural areas (1.86 Cr). One more key concern is that around 51% of the total disabled population in rural areas is not literate.
-
It thus becomes important that websites be made compliant towards the requirements that cater to needs of the differently abled citizens to bridge the huge talent leakage it might be causing.
-
Features to be introduced in website that empathise and synchronize with the rural audience and how they can enjoy the benefits with even minimal Digital Literacy.
Implemented on local Rural.nic.in View Demo
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
We will be creating a Landing page which will distribute our audience and it will lead to different sections specific to a disability. We have identified and worked for some of the common disabilities possible in a person to make their Web experience more accessible, smoother and easier.
1. Tetra Amelia : View Demo
- Head tracking & Facial expression recognition using webGazer & bodyPix.
- Real smooth UI/UX for the people suffering from Tetra Amelia
- Speech to Command facility for the website traversal
- Speech synthesis for more accessible website experience.
- Voice-Assisted Video Chat
2. Visually Impaired : View Demo
- Speech to Command for easier website traversal.
- Graphics that support color blindness.
- Web scrapping for the content present on the page.
- Speech synthesis for narrating the content present throughout the website.
3. Speech impaired/Hearing Impaired : View Demo
- Creating an interactive model based on the HamBurg Notation and SiGML implementation.
- Sign language keyboard for sending and receiving messages [WIP}
- Sign language instruction / illustration helping in traversal of the Website.
- Communication with Government Officials.
- Using CNN & Keras model for developing sign to text.
4. Dementia :View Demo
- *AI Chatbot based on NLP Dialogflow.
- Sequencial reminder of the main purpose of visit of end-user.
- Visual Imagery for easier selection and traversal through website
- An extremely simple and easy to use website for easier synchronization with the brain.
5. Voice Assisted Video Call App View Demo
- Recent Developments in Indian Sign Language Recognition: An Analysis by Daleesha M Viswanathan , Sumam Mary Idicul ( (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 6 (1) , 2015, 289-293)
- A Vision Based Recognition of Indian Sign Language Alphabets and Numerals Using B-Spline Approximation by Geetha M (International Journal on Computer Science and Engineering (IJCSE))
- Handling Big Datasets for Machine Learning (Blog) by Matthew Stewart, PhD Researcher
- Indian Sign Language Research and Training Centre (ISLRTC) http://www.islrtc.nic.in/
- Twelfth International Multi-Conference on Information Processing-2016 (IMCIP-2016) HamNoSys to SiGML Conversion System for Sign Language Automation Khushdeep Kaur and Parteek Kumar
- WebGazer
- BodyPix
- PoseNet
- Handtrack.js
- Jeeliz FaceFilter
- TensorFlow.js
- HandsFree.js
- Peerjs