The images displayed on the lumbar belt can come from both the 3D sensors located on the glasses and the screen of a computer (functionality used among other things for training). They are then adapted for tactile restitution, then conveyed as sensory information by the nerves to the visual cortex of the brain. They will then be treated in the same way as if they came from the eyes. This new source of information is naturally interpreted whether one is blind from birth or not. The system adapts to each user and their level of control of the device. It works both indoors and outdoors, whether you are in the middle of nature or in the corridors of the metro at peak times.
Proof of concept
Clinical trials using the first prototype allowed to validate the concept. In addition, the learning curve data retrieved allowed us to refine our training model in order to have a fast grip on the device.
January 2019
Wearable system
The second prototype, miniaturised and portable, allowed trials to be carried out in virtual environments (randomly generated labyrinths in the game Minecraft). It allowed to experiment movements and the sense of orientation.
October 2019
Outside testing
The third generation of the prototype allows the users to walk in the street, parks and indoors. Their movements are fluid thanks to a good perception of the world around them.
October 2020
Final product
The device will have a more discreet design and more accessible and modular software, all ready to be industrialised.
As with learning to read or ride a bike, a training phase is necessary to master the device. It will be done in complete safety and will teach the basics of vision through skin. Once these have been understood, the user will be autonomous and will continue to progress without realising it. The different learning phases are minimal perception (phase where the user becomes autonomous), then reduced mental load, very precise perception, almost zero mental load, and finally reflex perception. The learning starts in a virtual Minecraft world and continues in the real world.
Origins
Our work is based on Paul Bach Y Rita's research. He highligted the possibility to substitute the sense of sight by the sense of touch. Here is the device he used in the 80's for his experiment.
Our vision
To learn all about sense substitution, watch here our TEDx conference in Montansier theater in Versailles (France)
Rémi du
Chalard
Amaury
Buguet
Zacharie
Nataf
Francois
Outters
Alain
Salmon
Cosme
de Moucheron
Michel
Teyssedre
Roger
Pottlitzer
Raoul
Gilard
Smaël
Berahal
Alain
Ripart
Sylvie
Chokron
Hugues
de Montalembert
Malika
Auvray
