Sparsh

🏆 Winner at RedBrickHacks 2023 at Ashoka University (iPad Air 5th Gen)

The inspiration came from simply looking around us and thinking about the things we use daily. A basic service like UPI for the new age India, whose use is so widespread and common, is still not accessible or easy to use, especially in the case of visually challenged (and some motor challenges) where the “point to scan” motion for a QR code makes user interaction with the app difficult. And unfortunately there seems to exist almost no complete solution for this target group of over a 40 million in an economy like India.

Notion image

The app essentially makes UPI more accessible for people who may be visually impaired by implementing technologies like tap to pay and universally accepted UX guidelines by providing special “modes”. This allows people who may find it troublesome to scan a QR code on their own, to be more independent and make their own payments, thus empowering them.

Visual disabilities take form in various ways, cataract, colour blindness, tunnel vision, partial blindness, and more. There are also certain motor impairments like cerebral palsy and Parkinson's that suffer from the same drawback of the “point to scan” motion. Our app makes sure we cater to as many forms as we can by using features like text to speech, voice recognition, and tap to pay.

The app has the same purpose as most UPI apps, except it uses the safer, more technologically advanced NFC tags to store the information of the user (such as bank details, phone number, account details etc.) It caters to all as it offers a specific accessibility mode that can be switched on to switch to a UI that is completely voice assisted, has bigger buttons, larger text and high contrast screens.

To operate it:

Post sign up (where you can choose to switch on the accessibility mode during onboarding), you can simply use the voice assistant to open the app or open it normally.

The user then just needs to tap the NFC tag to the reader. There are no additional steps of finding the right button or the right angle!

Pre-generated bills can be paid as is, or you can simply speak into the app to tell it the amount.

We built a cross platform app that works on both iOS and Android for it to be accessible to all.

Notion image

We worked on our project using our prior knowledge of the double diamond technique, which worked quite well for us!

Discover: We examined the everyday tasks we come across day to day and tried to narrow down to a specific chore which may have been made unnecessarily difficult for the wider audience.

Define: We looked into how we could fix certain issues by brainstorming and acting out User Journey Maps. This included targeting what parts we would be fixing: ui, colours, user journeys, etc.

Design: This solidified a lot of the ideas we had. We were able to build proper user flows to study what the experience would look like and how we can make it better. This also included making high fidelity mockups of the app to make sure we could put our point across effectively.

Deliver: We built the app with React Native and Expo. We implemented features like controlling the app through Siri or Google Assistant, Text to Speech and added some more features like Separate Colour Schemes, Voice commands, and more as shown in the demo.

Notion image

NFC: It was our team’s first time interacting with any sort of NFC Hardware. We learnt about a lot of different formats you can use on an NFC chip and their use cases. We initially ran into a bunch of bugs trying to figure this out, but eventually we got around to it and now use the NDEF Protocol to store data on the chips.

Finding standardised or universal web accessibility guidelines for building designs for visually impaired people: These are unfortunately not very well documented yet, so we gathered information from our own observations and multiple resources during our research.

It was some of our teammates' first hardware based project. Working with hardware posed some unexpected challenges (over purely software) for sure - presenting, figuring out the right protocols and APIs, taking care of your hardware, and being aware of the way users will interact with the hardware.

We’re quite proud of the way we’ve implemented the solution to reduce human error as much as possible using design and technical cues and constraints. We think we managed our time and division of work quite well! We were very collaborative, but we established boundaries and everyone was working on their own tasks, which increased our speed of building things.

Coming up with a realistic business model.

Notion image

The role colour schemes can play in making an app more accessible. We also learnt about how to make more practical and accessible apps in general - through both design and technology.

We learnt a lot about things on the technical side: NFC Chips (their protocols and APIs), Text to speech and Voice recognition libraries and their implementation, Voice assistant APIs to add voice control to our app.

We aim to become one of the first players providing Tap to Pay technologies in India. We’ve seen widespread use of this technology in countries like the US, Singapore, etc. Our vision is to use these technologies in as many places as possible like metros, community spaces, building smart homes etc. An Apple Watch app: The Apple Watch also supports NFC, this would have an added level of convenience when using the app to just tap and pay.

We plan on building two apps, a user friendly consumer app (B2C) and APIs to integrate with existing merchant’s billing systems, with NFC infrastructure (B2B)

B2C: Where we provide users an app that lets them interact with the NFC chip and make payments easily using a well thought out accessible UI.

B2B: We provide bigger companies like PayTM, PhonePE, etc. our chips to be integrated in their speakers and devices that announce payments for quick adoption. We can also make a small API that lets restaurants or shops integrate our tech with their billing system for pre - generated bills.