标题： 过于缓慢而无用？ 在智能音箱的循环中融入人类 显示英文标题

标题： Too Slow to Be Useful? On Incorporating Humans in the Loop of Smart Speakers

摘要： 实时人群驱动系统，如Chorus/Evorus、VizWiz和Apparition，展示了将人类纳入自动化系统如何补充自动解决方案的不足。 然而，将此类架构应用于更多场景的一个未明说的瓶颈是将人类纳入自动化系统循环中的较长延迟。 对于有严格周转时间约束的应用，人工操作组件的较长延迟和较大的速度变化似乎成为明显的障碍。 本文通过使用基于文本的人工后端与用户通过仅支持语音的智能音箱进行对话，阐明并量化了这些限制。 智能音箱必须在几秒内响应用户的请求，因此幕后工作人员只有几秒钟的时间来撰写答案。 我们通过八对参与者测量了端到端系统延迟和对话质量，展示了这类系统的挑战和优势。 显示英文摘要

摘要： Real-time crowd-powered systems, such as Chorus/Evorus, VizWiz, and Apparition, have shown how incorporating humans into automated systems could supplement where the automatic solutions fall short. However, one unspoken bottleneck of applying such architectures to more scenarios is the longer latency of including humans in the loop of automated systems. For the applications that have hard constraints in turnaround times, human-operated components' longer latency and large speed variation seem to be apparent deal breakers. This paper explicates and quantifies these limitations by using a human-powered text-based backend to hold conversations with users through a voice-only smart speaker. Smart speakers must respond to users' requests within seconds, so the workers behind the scenes only have a few seconds to compose answers. We measured the end-to-end system latency and the conversation quality with eight pairs of participants, showing the challenges and superiority of such systems.