Assistive Technologies

The mobile application “Travel and Communication Assistant” supports the mobility and communication of people with Intellectual and Development Disabilities (IDD). This application provides the possibility to people with IDD to independently perform a known route (for example a route from home to the day care center, from home to the baker’s, etc.) under the remote supervision of their caregivers and to communicate with them using text, voice and pictogram messages.

geel2016.ppt | florence1.pptx

2016 (1)
  • Marina Kultsova, Roman Romanenko, Irina Zhukova, Andrey Usov, Nikita Penskoy, Tatiana Potapova (2016) Assistive Mobile Application for Support of Mobility and Communication of People with IDD. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. pp. 1073–1076. ACM. New York, NY, USA. doi web bibtex

The application that we develop alongside with the rehabilitation center called «Nadezhda» for their children who have all sorts of autistic disorders. The app will help children to visualize their every day activities, to see it whenever they need and to intuitively interact with it. Meanwhile the app will help the staff of the center to store all the children related data they need: their names, their hospital trips, diagnostics, etc.

The application will give us an ability to:

  • store children profiles
  • store children trips to the center
  • store children diagnostics and it’s progress
  • construct every day timetables for children
  • show multiple timetables for children
  • interact with a timetable by marking activities as done/not done and reaching motivation goals

interactive_timetable_for_autists.pdf | Android application (.apk) | Manual

Russian language extension for Text2Pico project

  • Translation Russian text into PECS (Sclera)
  • Integration with Text2Picto project
  • Working like a web-service using REST-API

The main prototype of a such service is a Text2Picto web-project KU Leuven for translation text into pictograms

  • Text2Picto is based on Cornetto and WordNet technologies which allow to process natural languages with their individual characteristics.
  • The service was written on Perl programming language which is best language for linguistic programs
  • Text2Picto provides considering interfaces and recommendations for extensions of languages and pictograms base

text2picto.pdf | 82.pptx

Rehabilitation center "Nadezhda" website integrated with Interactive Timetable and Diagnostics Services