Aisen

Web-Based Gaze-Tracking Assistive Communication Interface

Company Official Website: https://aisen.com.tw/

Basic Information

  • Total Award Grant: ~US$20,000
  • Team Size: 2
  • Duration: 4-Year
  • My Role: Leader, Lead Developer

Problem Addressed

Aisen addresses the critical challenge of communication barriers faced by individuals with disabilities, specifically those who have lost their ability to speak or write due to conditions like Parkinson’s disease. This project focuses on developing an affordable and accessible communication aid using gaze-tracking technology.

Personal Contributions

My role in Aisen began during my undergraduate studies, inspired by my personal experience with my grandfather’s struggle with Parkinson’s disease. I contributed my programming skills and expertise in Natural Language Processing (NLP) to develop an initial Minimal-Viable-Product (MVP). This MVP utilized a modified hardware gaming eye-tracker combined with PowerPoint. Over time, I evolved this into a sophisticated, web-based solution using webcam-driven, LLM-enhanced technologies, highlighting my commitment to continuous improvement and innovation. I contributed 50% of the development work in total and 100% of the paper writing.

Solutions Developed & Impact

Aisen evolved from a traditional eye-tracker with a basic web interface to a sophisticated, purely web-based application using the WebGazer.js library. This transition significantly enhanced the affordability and ease of software distribution. The “word card” system, specifically designed for Chinese character input, further tailored the solution to the complexities of different languages. The first trial’s success, where Aisen helped my grandfather express a physical sensation accurately, underscored the project’s potential and impact. This solution offers a cost-effective, accessible alternative to traditional assistive devices, empowering individuals with communication impairments to articulate their thoughts effectively.

Learning Outcomes & Reflections

Working on Aisen has been a transformative experience, reinforcing my passion for accessibility and technology’s power to make a tangible difference in people’s lives. This project honed my technical skills in programming, NLP, and web development, and also deepened my understanding of user-centered design and empathy in technology. The journey from an MVP to a refined product taught me the value of iterative development, user feedback, and the importance of making technology accessible and affordable. Aisen’s success has been a testament to the idea that technological innovations can significantly improve quality of life, especially for those with special needs.

Video: Prototype Demo (Please turn on the CC for English subtitles)

Recognition


🏅 Finalist  Student Innovation Contest
The ACM Symposium on User Interface Software and Technology (UIST)
Oct 2023

🏆 14,000 USD Grant  Public Welfare Innovation Case 100
Ministry of Digital Affairs, Taiwan
Aug 2023

:3rd_place_medal: 3rd Place Award & Industrial Special Award (1,200 USD) 
National Compassionate Science and Technology Innovation Competition
Tzu Chi Foundation, Taiwan
Oct 2022

🏅 Distinguished Award 
International University Innovation and Entrepreneurship Competition
National Chung Cheng University
Oct 2021

:1st_place_medal: Champion (Best Team Award) 
Startup Garage, National Tsing Hua University
Oct 2021

🏆 3,500 USD Grant  Company Simulation Operation Plan
Ministry of Education, Taiwan
Feb 2020

:2nd_place_medal: Silver Award 
Shanghai Jiao Tong University Entrepreneurship Competition
Shanghai Jiao Tong University, China
Jul 2019

:1st_place_medal: Champion (Best Potential Award) 
AppUniverz Campus Entrepreneurship Incubation Platform
AppUniverz, Taiwan
Jul 2019

:2nd_place_medal: Silver Award 
Tsinghua Entrepreneurship Day AI Group
National Tsing Hua University, Taiwan
May 2019

🏆 3,500 USD Grant  University Crowdfunding Platform
Ministry of Education, Taiwan
Mar 2019

:1st_place_medal: Champion 
Tsinghua Crowdfunding Demo Day
National Tsing Hua University, Taiwan
Dec 2019

:1st_place_medal: Champion (News
Startup, Starts Now! New Southbound Entrepreneurship Camp
Ministry of Education, Taiwan
Aug 2018

References

2023

  1. Aisen - Web-Based Gaze-Tracking Assistive Communication Interface with Word Cards Generated by LLMs
    Wei-En Tsai, and Yi-Chun Liu
    In Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 2023