Why It's Important: For math and science to be accessible non-visually, equations in digital or print content must be translated into precise, meaningful non-visual formats. Without this translation, the combination of graphical symbols and text in equations and formulas creates syntax issues that prevent screen readers, which read from left to right, from accurately delivering the information. Creating accessible STEM documents typically requires labor-intensive alt-text generation by a specialist familiar with the concepts, symbols, and syntax (i.e., Alt-media Specialist). Meanwhile, using optical character recognition to translate complex notation often produces results that lack the contextual or symbolic understanding needed for accurate translation.
Our Approach: This project benchmarks existing Generative AI tools for translating STEM equations and formulas, aiming to improve efficiency and accuracy for alt-media specialists and enhance STEM content accessibility for blind or low-vision students. We develop evaluation metrics based on contemporary research and user-centered findings and assess the feasibility of integrating these Generative AI tools into workflows at the Center for Inclusive Design and Innovation (CIDI) at Georgia Tech. CIDI supports accessible media at a national and international scale, including resources for post-secondary students with disabilities, the U.S. National Library Service, and the United Nations. This project advances Georgia Tech’s commitment to cutting-edge Generative AI research while ensuring equitable STEM access for students with disabilities nationwide.