We saw that the new notes introduced after demonetisation were not disablility friendly. We wanted to try and make an app that made it easier for the visually disabled to be able to count money fast and efficiently.
The app is very simple to use, and designed with the visually impaired in mind. The GUI is extremely simple. All the user has to do is hold up the money and take a picture of the notes by tapping anywhere on the screen. The phone vibrates when the picture is taken, after which this picture is sent to our servers (Azure VM), which process the image and send the value back to the app. This value is then spoken aloud back to the user.
| Image Capture By Phone | Note Detection |
|---|---|
 |
 |
| Note Detection | Note Detection |
|---|---|
 |
 |
Since this app was concieved in a hackathon, we had to deal with a lot of time constraints. As a result, the this iteration supports few notes, Rs 500, Rs 2000, Rs 200 and Rs 50. Also, the note detection capability can be switched over to an R-CNN for improved note detection, which only gets better over time. Due to lack of a proper training corpus, and time, such a network could not be trained/implemented.
Originally we had envisioned this to be a virtual wallet of sorts, which keeps track of any and all currency notes and can integrate with third party services too. This way, the visually impaired would never have to fidget around with their wallets to count money.