Title: A11yShape: AI-Assisted 3-D Modeling for Blind and Low-Vision Programmers Show Chinese title

Title: A11yShape：为盲人和低视力程序员提供的AI辅助三维建模

Abstract: Building 3-D models is challenging for blind and low-vision (BLV) users due to the inherent complexity of 3-D models and the lack of support for non-visual interaction in existing tools. To address this issue, we introduce A11yShape, a novel system designed to help BLV users who possess basic programming skills understand, modify, and iterate on 3-D models. A11yShape leverages LLMs and integrates with OpenSCAD, a popular open-source editor that generates 3-D models from code. Key functionalities of A11yShape include accessible descriptions of 3-D models, version control to track changes in models and code, and a hierarchical representation of model components. Most importantly, A11yShape employs a cross-representation highlighting mechanism to synchronize semantic selections across all model representations -- code, semantic hierarchy, AI description, and 3-D rendering. We conducted a multi-session user study with four BLV programmers, where, after an initial tutorial session, participants independently completed 12 distinct models across two testing sessions, achieving results that aligned with their own satisfaction. The result demonstrates that participants were able to comprehend provided 3-D models, as well as independently create and modify 3-D models -- tasks that were previously impossible without assistance from sighted individuals. Show Chinese abstract

Abstract: 构建三维模型对盲人和低视力（BLV）用户来说具有挑战性，这是由于三维模型的固有复杂性，以及现有工具缺乏对非视觉交互的支持。 为了解决这个问题，我们引入了A11yShape，这是一个新系统，旨在帮助具备基本编程技能的BLV用户理解和修改三维模型并进行迭代。 A11yShape利用大型语言模型，并与OpenSCAD集成，OpenSCAD是一个流行的开源编辑器，可以从代码生成三维模型。 A11yShape的关键功能包括三维模型的可访问描述、版本控制以跟踪模型和代码的变化，以及模型组件的分层表示。 最重要的是， A11yShape采用跨表示突出显示机制，在所有模型表示——代码、语义层次结构、AI描述和三维渲染之间同步语义选择。 我们与四位BLV程序员进行了多阶段用户研究，在初始教程会话后，参与者在两个测试会话中独立完成了12个不同的模型，结果与其自身满意度一致。 结果表明，参与者能够理解提供的三维模型，并独立创建和修改三维模型——这些任务在没有视力人士协助的情况下以前是不可能完成的。