Eamon McErlean & Joe Devon - AIMAC: The AI Model Accessibility Checker

OUTLINE:

00:00 Opening Teaser
00:50 Introduction
02:23 The Importance and Goals of AIMAC
06:03 Service Now's Priority for Accessibility
12:09 Challenges of Developing AIMAC
17:25 What is AIMAC and how does it function?
21:41 Part of What Inspired AIMAC
24:50 Using OpenRouter - The Unified Interface for LLMs
29:08 AIMAC's Leaderboard of AI Models and How They Ranked
37:03 Examples of System & User Prompts and the Generated HTML Pages
39:56 Using AIMAC For Your Own LLM
40:54 What Surprised Joe The Most (The Results)
43:32 Webpage Previews Generated By All Models For Multiple Categories
44:56 How To Provide Feedback or Contact Joe re: AIMAC
48:56 Pareto Frontier Chart Measures Quality & Cost
51:35 Demonstration of How AIMAC Benefits Screen Readers For People Who Are Visually Impaired
01:06:07 Results of Using MoonshotAI: Kimi K2.5
01:09:57 Top 6 Accessibility Issues Caused By AI Models
01:11:58 How Em Dashes Generated by AI Model Affects Accessibility
01:14:13 Wrap Up

--

EPISODE LINKS:

AIMAC: The AI Model Accessibility Checker
https://aimac.ai

ServiceNow Accessibility Statement
https://www.servicenow.com/accessibility-statement.html

GAAD Foundation
https://gaad.foundation

Accessibility at ServiceNow
https://www.youtube.com/playlist?list=PLCOmiTb5WX3q5qCG_QqYip2IZrvao7Bwp

Webpage Sample:
https://aimac.ai/output/reports/current/assets/html/gemini-3-pro-preview/sports-1408

Axe-core - Accessibility engine for automated Web UI testing
https://github.com/dequelabs/axe-core

A11y LLM Eval
https://microsoft.github.io/a11y-llm-eval-report/

CodeGen Model Eval and Refine Tools
https://github.com/aarongustafson/CodeGen-Model-Eval-and-Refine-Tools

Evinced
https://www.evinced.com

WebAIM Million - The 2025 report on the accessibility of the top 1,000,000 home pages
https://webaim.org/projects/million/

ArcTouch - The State of Mobile App Accessibility Report
https://arctouch.com/state-of-mobile-app-accessibility

OpenRouter
https://openrouter.ai

Moonshot AI
https://www.moonshot.ai

Github - AI Model Accessibility Checker
https://github.com/GAAD-Foundation/AIMAC

MiniMax-M1 - The world's first open-weight, large-scale hybrid-attention reasoning model.
https://github.com/MiniMax-AI/MiniMax-M1

The Pareto Frontier For AI Agents
https://cobusgreyling.substack.com/p/the-pareto-frontier-for-ai-agents

Em Dash, En Dash and Hyphen: The Guide I Needed
https://hrot.substack.com/p/em-dash-en-dash-and-hyphen-the-guide

Eamon McErlean on LinkedIn
https://www.linkedin.com/in/emcerlean/

Joe Devon on LinkedIn
https://www.linkedin.com/in/joedevon/

Jennison Asuncion on LinkedIn
https://www.linkedin.com/in/jennison/