We spoke to the SynthAccess team from NYU Tandon School of Engineering about SynthAccess, a set of accessibility tools for electronic instruments. Jason first ran us through MIDI-to-speech operation on a Novation Summit and a Groove Synthesis 3rd Wave/TO5-style synth setup, then Luke DuBois described how the system works.
SynthAccess listens to a synth's MIDI output and uses JSON mapping files to translate controls, patch names and parameter values into spoken feedback. The mappings cover controls such as filter cutoff, LFO rate, effects levels, envelopes, patch changes and waveform selection. The files are open source, and the team has a GitHub API for creating new instrument definitions.
We also saw Braille and tactile overlays for synth panels, plus modular jack identifiers. These use shape, colour and raised or flat surfaces to mark signal type and input/output status. A haptic prototype uses small vibration motors to represent LFO movement by touch. The team said support is available for manufacturers, studios and hobbyists working on accessible setups.
More Info: https://engineering.nyu.edu/