This project was about engineering the embedded software of the device, the backend to manage the fleet of devices, the API they connect to and the companion mobile app for the end user.

The device was running Linux, which spins up a Rails server on start. The Rails server acts as the brain of the device: it controls the I/O of the user, communications with the backend and the mobile app, and communication with other internal bricks (like the Python app that runs the Computer Vision algorithms).

The backend and the API - for both the devices and the mobiles app - are a standard Ruby on Rails 7 app. I used Tailwindcss for the frontend.

The mobile app was developed using React Native (with Typescript), and deployed using the wonderful Expo.

Of course, because our users are blind, accessibility was a key factor for the design of the mobile app.