标题： 令牌通信：跨模态上下文感知语义通信的统一框架 显示英文标题

标题： Token Communications: A Unified Framework for Cross-modal Context-aware Semantic Communications

摘要： 本文中，我们引入了 Token 通信（TokCom），这是一种以大型模型驱动的框架，用于利用生成语义通信（GenSC）中的跨模态上下文信息。 TokCom 是一种新范式，受生成基础模型和多模态大型语言模型（GFM/MLLMs）最近成功的启发，其中通信单元是令牌，在发送方和接收方通过高效的基于 Transformer 的令牌处理实现。 本文介绍了利用 GenSC 中上下文的潜在机会与挑战，探索如何将基于 GFM/MLLMs 的令牌处理集成到语义通信系统中，以在可承受的复杂度下有效利用跨模态上下文，提出未来无线网络中各层高效 TokCom 的关键原则。 在一个典型的图像语义通信设置中，我们展示了 TokCom 通过利用令牌之间的上下文信息所实现的带宽效率显著提升。 最后，确定了潜在的研究方向，以促进 TokCom 在未来无线网络中的应用。 显示英文摘要

摘要： In this paper, we introduce token communications (TokCom), a large model-driven framework to leverage cross-modal context information in generative semantic communications (GenSC). TokCom is a new paradigm, motivated by the recent success of generative foundation models and multimodal large language models (GFM/MLLMs), where the communication units are tokens, enabling efficient transformer-based token processing at the transmitter and receiver. In this paper, we introduce the potential opportunities and challenges of leveraging context in GenSC, explore how to integrate GFM/MLLMs-based token processing into semantic communication systems to leverage cross-modal context effectively at affordable complexity, present the key principles for efficient TokCom at various layers in future wireless networks. In a typical image semantic communication setup, we demonstrate a significant improvement of the bandwidth efficiency, achieved by TokCom by leveraging the context information among tokens. Finally, the potential research directions are identified to facilitate adoption of TokCom in future wireless networks.