How can we use artificial intelligence (AI) to improve the lives of marginalised communities, particularly people with disabilities? This question was at the forefront during AWS re:Invent 2024 in Las Vegas earlier this month, where innovative solutions for inclusivity were spotlighted.

At the event, e27 witnessed product demonstrations from two global startups dedicated to empowering people with disabilities. The first, Romania-based .lumen, has developed an AI-powered device to enhance mobility for blind individuals.

The second, US-based Sign-Speak, is working to bridge communication gaps for American Sign Language (ASL) speakers. Their AI tool provides live translations, enabling ASL users to interact seamlessly with a broader audience.

These startups exemplify how AI can be leveraged to address challenges marginalised communities face. Through groundbreaking technology, they aim to foster greater independence and inclusion.

Check out their stories to learn more about the transformative potential of AI in creating a more accessible world.

Guide dogs for the AI age

Cornel Amariei, the CEO of Lumen, has embarked on an ambitious journey to transform mobility for visually impaired individuals. Drawing from his personal experiences growing up in a family where everyone but himself had a disability, Amariei sought to leverage cutting-edge technology to fill the longstanding gaps in assistive tools for the visually impaired.

Also Read: What this digital shift means for people with disabilities in SEA

“If you think of visual impairment right now, over 300 million people worldwide are affected, and this number is expected to reach half a billion by 2050,” Amariei stated in an interview with e27.

Yet, the solutions available have remained static for centuries, limited to guide dogs and white canes. “Last year, we spent over US$500 million training just 2,000 guide dogs globally,” he noted.

With only 28,000 guide dogs available worldwide for over 300 million visually impaired individuals, Amariei recognised the need for scalable alternatives.

In 2020, amidst the challenges of the pandemic, Amariei founded .lumen, aiming to bring the sophistication of autonomous driving technology to pedestrian navigation. The result is a wearable device resembling a virtual reality headset.

“It’s a self-driving car for pedestrians,” he explained. The glasses employ AI-powered haptic feedback to guide users, effectively mimicking the functions of a guide dog without requiring internet connectivity. “If a guide dog pulls your hand to direct you, our device pulls your head,” Amariei said, underscoring the innovation’s intuitive design.

.lumen’s development journey has involved over 300,000 hours of research and testing with more than 400 visually impaired individuals. The device is slated for a European launch in early 2024 and will enter the US market by year-end.

Affordability and accessibility are central to .lumen’s strategy. In Europe, many countries offer reimbursement or subsidies for assistive technologies. Amariei highlighted a recent initiative in Romania where the glasses could be free to eligible individuals. “We’re working to ensure that the end user pays little to nothing,” he said.

Also Read: Inclusion matters: How GitHub enhances accessibility for individuals with disabilities

Similar efforts are underway in the US and Japan, where .lumen has partnered with the Toyota Mobility Foundation to bring the product to market.

Amariei emphasised that Lumen’s goal is not to replace guide dogs but to complement them. “We aim to provide the same features as a guide dog to the tens of millions of people who cannot access one,” he said.

Looking ahead, Amariei envisions significant improvements in subsequent device iterations, including reduced size and weight. Reflecting on .lumen’s journey, Amariei described founding the company as the “best and worst decision” of his life.

“Quitting a well-paid corporate job to launch a startup during a pandemic was a gamble, but it’s paying off,” he said. The company’s recent milestone includes becoming the first Romanian startup to join the European Union’s deep tech accelerator programme, coupled with the closure of a substantial investment round.

Connecting ASL speakers to the world

In a panel discussion at AWS re:Invent 2024, Nikolas Kelly, Chief Product Officer of Sign-Speak and a member of the deaf community, demonstrated the groundbreaking potential of his company’s AI-powered sign language interpretation technology.

Using the very tool his team developed, Kelly shared the inspiration and mission behind Sign-Speak, highlighting its dual focus on addressing everyday communication challenges and providing scalable solutions for organisations.

“I had everyday frustrations in my communication that led to miscommunications, breakdowns, and awkward social experiences,” Kelly explained. “So my team got together and started Sign-Speak.”

Also Read: Rayo: Transforming web accessibility worries into confidence for people with disabilities

Sign-Speak’s core innovation is its automated sign language recognition technology, which combines AI-generated avatars with human interpreters. This hybrid approach offers deaf individuals the autonomy to choose between machine-generated translations and human assistance. Kelly emphasised this flexibility as a critical aspect of the platform, particularly in the US, where interpreter shortages persist.

During the presentation, Kelly showcased the platform’s capabilities using a laptop featuring an AI-generated image of a young man, representing his virtual “translator.”

As Kelly communicated in American Sign Language (ASL), the system translated his signs into spoken words in real time, supported by closed captioning for accessibility. “Deafness comes in a spectrum,” Kelly noted, underscoring the platform’s inclusive design.

Sign-Speak’s application extends beyond individual users. The company has developed an API enabling organisations to integrate technology into various industries, from retail to banking. “We wanted to build something for the enterprise level,” Yami Payano, CEO of Sign-Speak, explained at the same event. “In the US market, accessibility is typically provided by organisations, not the deaf consumer.”

Already, the technology is being piloted in settings such as banks and smart TVs, where deaf customers can interact seamlessly with tellers or access digital interfaces. Payano saw this as a step toward broader adoption: “We’ve created B2C products to help deaf consumers get comfortable with the technology at home.”

—

Image Credit: .lumen, Sign-Speak

The post These startups are using AI to help improve the lives of people with disabilities appeared first on e27.