AI Is Reshaping Assistive Technology for Blind Users
Screen reader technology is undergoing its most significant transformation since JAWS introduced scripting in the 1990s. AI is augmenting traditional screen readers with computer vision, natural language understanding, and real-time environmental awareness that go far beyond reading DOM text aloud.
Microsoft Seeing AI: The Benchmark for AI Visual Assistance
Microsoft Seeing AI, available on iOS and Android, offers channel-based interfaces for short text, documents, products, people, scenes, and currency. The 2025 update integrated GPT-4 Vision into the Scenes channel, dramatically improving environmental descriptions. Most tasks process on-device for privacy, falling back to cloud inference only for complex scenes.
Be My Eyes and AI: Scaling Human Sighted Assistance
Be My AI — deployed by Be My Eyes using GPT-4 Vision — handles the majority of visual assistance requests without routing to volunteers. By 2025 it was handling more requests globally than the human volunteer network, while volunteers remained available for complex or emotionally sensitive tasks. This hybrid model demonstrates how AI and human collaboration can scale accessibility services.
AI-Powered Captioning: Otter.ai, Google Live Captions, and Beyond
- Google Live Captions: on-device processing, 18 languages as of 2026, available on Chrome, ChromeOS, and Android 10+
- Otter.ai: cloud-based with highest accuracy for standard English, strongest speaker identification, best enterprise meeting integration
- Microsoft Azure AI Speech: the underlying engine for Teams live captions, documented accuracy above 90% for clear English audio
- Apple Live Captions: on-device, integrated into iOS 17+ and macOS Sonoma+
- Verbit: purpose-built for education and legal sectors, combining AI with human transcriptionist review
Predictions for AI Accessibility Technology Through 2028
- Screen readers will incorporate multimodal AI as a core feature — JAWS and NVDA both investing in AI capabilities shipping by 2027
- Real-time AI audio description will become a standard OS-level feature on iOS and Android
- AI-powered cognitive accessibility tools will emerge as a recognized AT category
- EU AI Act and proposed US AI accessibility legislation will require AT compatibility testing documentation
- AI agents that navigate digital interfaces on behalf of users will abstract away accessibility barriers at the interaction layer
James Okafor
WCAG Lead Auditor
A certified accessibility consultant at BuildWithAccess helping organizations achieve WCAG compliance and build more inclusive digital experiences.
Need help making your site accessible?
We offer free consultations to assess your current accessibility posture and recommend a path forward.
Get a Free Consultation