[email protected]

Therapy Room

Therapy Room

Vision sensors provide a noncontact, natural, unobstructed way of recording, monitoring and analysing everyday behaviours of people with ASD, e.g. by analysing facial-head movements of ASD individuals1 as well as eye gaze. These visual cues are important because children with ASD usually have a number of atypical visual behaviours and viewing strategies, such as reduced gaze towards the eyes and preference for the mouth2.

Given that placing sensors on children may impede therapy, DREAMwill use RGB-D sensors such as the Microsoft Kinect® rather than employing high precision wearable motion tracking devices, together with adaptive action and behaviour analysis software. These will be augmented by techniques for multi-sensor data fusion. Touch sensors and RFID will be optionally considered to capture environment-related information.


1 Madsen, M., El Kaliouby, R., Goodwin, M. & Picard, R. (2008), “Technology for just-in-time in-situ learning of facial affect for persons diagnosed with an autism spectrum disorder”, in: ‘Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility’, ACM, 19–26.

2 Bird, G., Catmur, C., Silani, G., Frith, C. & Frith, U. (2006), “Attention does not modulate neural responses to social stimuli in autism spectrum disorders”, Neuroimage 31(4), 1614–1624.