Skip to main content
CenXiv.org
This website is in trial operation, support us!
We gratefully acknowledge support from all contributors.
Contribute
Donate
cenxiv logo > cs > arXiv:2403.19001v4

Help | Advanced Search

Computer Science > Computer Vision and Pattern Recognition

arXiv:2403.19001v4 (cs)
[Submitted on 27 Mar 2024 (v1) , last revised 21 Apr 2025 (this version, v4)]

Title: Cross-domain Fiber Cluster Shape Analysis for Language Performance Cognitive Score Prediction

Title: 跨域纤维集群形状分析用于语言表现认知评分预测

Authors:Yui Lo, Yuqian Chen, Dongnan Liu, Wan Liu, Leo Zekelman, Fan Zhang, Yogesh Rathi, Nikos Makris, Alexandra J. Golby, Weidong Cai, Lauren J. O'Donnell
Abstract: Shape plays an important role in computer graphics, offering informative features to convey an object's morphology and functionality. Shape analysis in brain imaging can help interpret structural and functionality correlations of the human brain. In this work, we investigate the shape of the brain's 3D white matter connections and its potential predictive relationship to human cognitive function. We reconstruct brain connections as sequences of 3D points using diffusion magnetic resonance imaging (dMRI) tractography. To describe each connection, we extract 12 shape descriptors in addition to traditional dMRI connectivity and tissue microstructure features. We introduce a novel framework, Shape--fused Fiber Cluster Transformer (SFFormer), that leverages a multi-head cross-attention feature fusion module to predict subject-specific language performance based on dMRI tractography. We assess the performance of the method on a large dataset including 1065 healthy young adults. The results demonstrate that both the transformer-based SFFormer model and its inter/intra feature fusion with shape, microstructure, and connectivity are informative, and together, they improve the prediction of subject-specific language performance scores. Overall, our results indicate that the shape of the brain's connections is predictive of human language function.
Abstract: 形状在计算机图形学中扮演着重要的角色,提供了传达物体形态和功能的有用特征。在脑成像中的形状分析可以帮助解释人脑的结构与功能之间的相关性。 在这项工作中,我们研究了大脑三维白质连接的形状及其与人类认知功能潜在预测关系。 我们使用扩散磁共振成像(dMRI)纤维束成像技术重建大脑连接为三维点序列。 为了描述每条连接,除了传统的dMRI连通性和组织微结构特征外,我们还提取了12种形状描述符。 我们引入了一种新的框架,即形状融合纤维束聚类变换器(SFFormer),该框架利用多头交叉注意力特征融合模块,基于dMRI纤维束成像预测特定受试者的语言表现。 我们在一个包含1065名健康年轻成年人的大数据集上评估了该方法的性能。 结果显示,基于变压器的SFFormer模型以及与形状、微结构和连通性的特征融合都是信息丰富的,并且它们共同提高了特定受试者语言表现评分的预测。 总体而言,我们的结果表明,大脑连接的形状可以预测人类的语言功能。
Comments: This paper has been accepted for presentation at The 27th Intl. Conf. on Medical Image Computing and Computer Assisted Intervention (MICCAI 2024) Workshop on Computational Diffusion MRI (CDMRI). 11 pages, 2 figures
Subjects: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI); Image and Video Processing (eess.IV); Neurons and Cognition (q-bio.NC)
Cite as: arXiv:2403.19001 [cs.CV]
  (or arXiv:2403.19001v4 [cs.CV] for this version)
  https://doi.org/10.48550/arXiv.2403.19001
arXiv-issued DOI via DataCite
Related DOI: https://doi.org/10.1007/978-3-031-86920-4_8
DOI(s) linking to related resources

Submission history

From: Yui Lo [view email]
[v1] Wed, 27 Mar 2024 20:51:02 UTC (445 KB)
[v2] Sat, 30 Mar 2024 02:42:08 UTC (445 KB)
[v3] Wed, 18 Sep 2024 21:21:12 UTC (2,117 KB)
[v4] Mon, 21 Apr 2025 22:16:59 UTC (2,117 KB)
Full-text links:

Access Paper:

    View a PDF of the paper titled
  • View Chinese PDF
  • View PDF
  • HTML (experimental)
  • TeX Source
view license
Current browse context:
cs.CV
< prev   |   next >
new | recent | 2024-03
Change to browse by:
cs
cs.AI
eess
eess.IV
q-bio
q-bio.NC

References & Citations

  • NASA ADS
  • Google Scholar
  • Semantic Scholar
a export BibTeX citation Loading...

BibTeX formatted citation

×
Data provided by:

Bookmark

BibSonomy logo Reddit logo

Bibliographic and Citation Tools

Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)

Code, Data and Media Associated with this Article

alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)

Demos

Replicate (What is Replicate?)
Hugging Face Spaces (What is Spaces?)
TXYZ.AI (What is TXYZ.AI?)

Recommenders and Search Tools

Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)
IArxiv Recommender (What is IArxiv?)
  • Author
  • Venue
  • Institution
  • Topic

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)
  • About
  • Help
  • contact arXivClick here to contact arXiv Contact
  • subscribe to arXiv mailingsClick here to subscribe Subscribe
  • Copyright
  • Privacy Policy
  • Web Accessibility Assistance
  • arXiv Operational Status
    Get status notifications via email or slack

京ICP备2025123034号