Make Projects Tech

September 6, 2012 at 4:14 pm

Kinecticate: Kinect-powered Email

 

My mom has lived with aphasia ever since she suffered a serious stroke twelve years ago. In the meantime, there’s been a revolution in communication – powered by social media. Like a lot of people, I use the phone less. One of my areas of interest has been bridging the digital “keyboard gap” for people like my mom. I posted recently about my Arduino-powered assistive communication device. This is the same concept (emotions and amounts) “Kinectified”.

The first step was coming up with a visual “dashboard” to help her compose simple messages. Each icon is associated with a specific emotion, which can then be qualified by an amount. I used a Kinect with the SimpleOpenNI library for Processing along with some gesture recognition code from Matt Richardson to track the position of my mom’s hand. I then used a sample Processing sketch from Daniel Shiffman to generate and send the email by using the green arrow button. The red “X” resets the screen.

 

In the future, I plan to add other “boards” and “pages” later to allow for a greater variety of messaging, but maintaining a super simple interface for my mom. The “path” from the icon to the send button also needs to be clear. Mom too easily changes the message as she makes her way to the send button. The next version will have wider channels between emotions to avoid inadvertent selection. It would also be fun to snap and attach a jpeg from the RGB Kinect camera to the email. Still, its clear that mom is happy with the result. I might also send the emails to a Posterous account so that she can have her own blog.

Of course, someone else has to launch the program for her, so we’re not quite there yet in terms of totally independent messaging. But this was a fun start.

 

 

73 Comments

  1. Pingback: Son hacks Kinect to help his disabled mom send an email | techn4all.com Latest technology

  2. Pingback: Mulher vítima de derrame usa hack de Kinect para se comunicar | Por um internet melhor!

  3. Pingback: Kinect allows stroke victim to send email | More Games

  4. Pingback: Tilt – Aivoinfarktin saanut lähetti sähköpostia Kinectin avulla

  5. Pingback: Kinect Bisa Bantu Penderita Stroke untuk Mengirim Email

  6. Pingback: Arduino si Kinect ajuta bolnavii cu probleme motorii

  7. Pingback: Mulher vítima de derrame usa hack de Kinect para se comunicar » Jackal Gamer

  8. Pingback: Kinect permette agli individui affetti da afasia di mandare le e-mail | PowerBlog.it

  9. Pingback: Kinect permette agli individui affetti da afasia di mandare le e-mail » SeeYouLike

  10. Pingback: Kinect-Powered Email Helps Woman Communicate After Stroke - AppNewser

  11. Pingback: Kinect come finestra su Internet | infropy - information entropy

  12. Pingback: Un hacker installe un système Kinect au service de sa maman aphasique | golem13 |

  13. Pingback: khriss.com Kinect permette agli individui affetti da afasia di mandare le e-mail | khriss.com

  14. Pingback: Man hacks Kinect to assist stroke victim | SmartPlanet

  15. Pingback: Un chico hackea su Kinect para permitirle a su madre mandar correos | Atomix

  16. Pingback: Son hacks Kinect to help his disabled mom send an email | Stock Market News - Business & Tech News

  17. Pingback: The Midagedgamer Report for 9-14-2012 « midagedgamer

  18. Pingback: Kinect interface allows stroke victim to send emails | Connected Health

  19. Pingback: How an Xbox Kinect Can Assist a Stroke Victim | Equal Entry

  20. Pingback: Robert St. Amant: Science, Engineering, and Innovation (for everybody)

  21. Pingback: Mother’s stroke inspires the launch of new, easier to use, social messaging platform | Life Labs

  22. Pingback: Stroke victim envía correo electrónico a través de la interfaz Kinect | Online

  23. Pingback: Kinect Interface for Stroke Victim | Novel Interfaces