Skip to main content
Projects

The Orpheus System

Communication, expression and therapy through musical improvisation for adults living with Autism Spectrum Disorder
Being DigitalCommunicationPlayInclusivity

The Orpheus System aims to tackle two key challenges faced by adults with Autism Spectrum Disorder (ASD): the difficulties many individuals with ASD encounter in socialising and communication, and atypical sensitivity to sensory stimuli, which can severely impact mood, focus, and social interactions, sometimes leading to meltdowns. The Orpheus System strives to offer adults with ASD opportunities for deep social connection and creative expression while constructing positive sensory spaces on the move or at home.

Drawing inspiration from research on play and music therapies, as well as the benefits of sensory rooms, The Orpheus System is a collaborative, musical communication game designed for adults with severe ASD. In this game, 1-4 players take turns placing glyphic tiles on a magnetic playing board in a freeform arrangement. Each combination triggers a unique assemblage of ambient musical tones and textures. These compositions can be played through an attachable soundbar or through Bluetooth-connected sound devices. When the players have finished building their soundscape, they can have the final audio and visual patterns sent to their phone by pressing a “capture” button on the game board, creating a shareable external memory of this social experience. Through this gameplay structure, users will be able to have collaborative, creative, social experiences without the stress of verbal communication.

The modular design of the product allows for additional enhancements like audio-reactive light patterns and textural visualizations through a separately purchasable projector, bringing sensory room experiences to any setting. Individuals can also use the system independently for creative expression or to create calming sensory environments.

Researchers in this music improvisation class in Detroit have observed that group musical improvisation activates the same brain architecture in adults with severe ASD as verbal communication does in neurotypical adults. In addition, academic research also found that light-and-sound sensory rooms can improve mood, focus, and socialisation for autistic adults. We hope this product will provide users with a platform for fun, creativity, expression, social connection, and a positively stimulating sensory environment.

A collage of early design sketches for our products, including foldable "battleships" style gameboard, and synthesizer influence

Design Process

With the goal of devising an elegant, modular design for our product, Jiahuan and Anqi created a variety of product sketches, drawing inspiration from classic board game design and modem, digital modular synthesizers.

Two images of the visual language of the tile design, in black and white and colour.

Visual Language

For the tile glyph designs, Melanie created a language based on a system of colours and patterns. The tile colour signifies the tone of the musical element that will be triggered when the tile is played, while the pattern (waves, dots or emojis) signifies the texture – staccato or legato, melodic or percussive. The patterns are inscribed on the tiles in relief, adding a tactile reference for users to identify with the sounds.

Collage of a labelled technical image of the game board, close-ups of design features and a mockup of the phone app UI.
Top angle, close-up image of hands using tiles on a board

How will it work?

The game board has an array of magnetic Hall Effect sensors below the playing surface, which, thanks to a unique magnet within each playing piece, can identify each piece and where it is played. Each piece has an associated ambient musical element, from legato synth pad sounds to staccato arpeggios and light percussive elements, saved in interactive patches written in MAX MSP. These elements are triggered by an internal processing unit within the game board and played either from a small sound bar on the gameboard or through any Bluetooth-connected audio device. All of the music is written so that no combined elements are discordant, and the interactivity of the elements is programmed so that the order and arrangement of the pieces affect the whole too.

As the players take their turns, elements can be removed and added until the players are happy with their composition. They can then press the “record” button on the top of the board, which sends an mp3 snippet of the composition and a diagram of the tile arrangement to any Bluetooth-connected mobile device. A mini projector can also be purchased and attached to the board to play audio-reactive visualisations. 

A birds-eye 3D render of the game board, tiles and sound control bar.
A close-up 3D render of the game board.
An extreme close up of the 3D render of The Orpheus System gamboard, showing the tiles and sound control bar.

Final outcome

Orpheus is a hero in classical Greek mythology, most commonly associated with music and poetry. The Greek god Hermes might have invented the lyre, but Orpheus perfected it, and his music was said to move all living creatures to dance.

Orpheus represents both the beauty and the power of music and creative expression – gifts that this product aims to make more accessible for the ASD community, as tools for communication, expression and therapy.