标题： 任何I2V：使用运动控制动画任意条件图像 显示英文标题

标题： AnyI2V: Animating Any Conditional Image with Motion Control

摘要： 最近在视频生成方面的进展，特别是扩散模型的发展，推动了文本到视频（T2V）和图像到视频（I2V）合成的显著进步。 然而，在有效整合动态运动信号和灵活的空间约束方面仍存在挑战。 现有的T2V方法通常依赖于文本提示，这本质上缺乏对生成内容空间布局的精确控制。 相比之下，I2V方法受其对真实图像的依赖限制，这限制了合成内容的可编辑性。 尽管一些方法结合了ControlNet以引入基于图像的条件，但它们通常缺乏明确的运动控制，并且需要计算成本高昂的训练。 为了解决这些限制，我们提出了AnyI2V，这是一种无需训练的框架，可以使用用户定义的运动轨迹为任何条件图像生成动画。 AnyI2V支持更广泛的模态作为条件图像，包括ControlNet不支持的数据类型，如网格和点云，从而实现更灵活和多用途的视频生成。 此外，它支持混合条件输入，并通过LoRA和文本提示实现风格迁移和编辑。 大量实验表明，所提出的AnyI2V表现出优越的性能，并在空间和运动控制的视频生成中提供了新的视角。 代码可在https://henghuiding.com/AnyI2V/ 获取。 显示英文摘要

摘要： Recent advancements in video generation, particularly in diffusion models, have driven notable progress in text-to-video (T2V) and image-to-video (I2V) synthesis. However, challenges remain in effectively integrating dynamic motion signals and flexible spatial constraints. Existing T2V methods typically rely on text prompts, which inherently lack precise control over the spatial layout of generated content. In contrast, I2V methods are limited by their dependence on real images, which restricts the editability of the synthesized content. Although some methods incorporate ControlNet to introduce image-based conditioning, they often lack explicit motion control and require computationally expensive training. To address these limitations, we propose AnyI2V, a training-free framework that animates any conditional images with user-defined motion trajectories. AnyI2V supports a broader range of modalities as the conditional image, including data types such as meshes and point clouds that are not supported by ControlNet, enabling more flexible and versatile video generation. Additionally, it supports mixed conditional inputs and enables style transfer and editing via LoRA and text prompts. Extensive experiments demonstrate that the proposed AnyI2V achieves superior performance and provides a new perspective in spatial- and motion-controlled video generation. Code is available at https://henghuiding.com/AnyI2V/.