Title: psifx -- Psychological and Social Interactions Feature Extraction Package Show Chinese title

Title: psifx -- 心理和社会交互特征提取包

Abstract: psifx is a plug-and-play multi-modal feature extraction toolkit, aiming to facilitate and democratize the use of state-of-the-art machine learning techniques for human sciences research. It is motivated by a need (a) to automate and standardize data annotation processes that typically require expensive, lengthy, and inconsistent human labour; (b) to develop and distribute open-source community-driven psychology research software; and (c) to enable large-scale access and ease of use for non-expert users. The framework contains an array of tools for tasks such as speaker diarization, closed-caption transcription and translation from audio; body, hand, and facial pose estimation and gaze tracking with multi-person tracking from video; and interactive textual feature extraction supported by large language models. The package has been designed with a modular and task-oriented approach, enabling the community to add or update new tools easily. This combination creates new opportunities for in-depth study of real-time behavioral phenomena in psychological and social science research. Show Chinese abstract

Abstract: psifx是一个即插即用的多模态特征提取工具包，旨在促进并使人类科学研究中最新机器学习技术的使用更加普及。 它的动机源于以下需求：(a) 自动化和标准化通常需要昂贵、耗时且不一致的人工劳动的数据标注过程；(b) 开发和分发开源社区驱动的心理学研究软件；以及(c) 为非专业用户提供大规模访问和易于使用的体验。 该框架包含一系列用于任务的工具，例如从音频中进行说话人辨识、闭路字幕的转录和翻译；从视频中进行多人跟踪的身体、手部和面部姿态估计以及注视跟踪；以及由大型语言模型支持的交互式文本特征提取。 该软件包采用模块化和任务导向的方法设计，使社区能够轻松添加或更新新工具。 这种组合为心理学和社会科学研究中对实时行为现象的深入研究创造了新的机会。