Title: S3Mirror: Making Genomic Data Transfers Fast, Reliable, and Observable with DBOS Show Chinese title

Title: S3Mirror：利用DBOS实现基因组数据传输的快速、可靠和可观察性

Abstract: To meet the needs of a large pharmaceutical organization, we set out to create S3Mirror - an application for transferring large genomic sequencing datasets between S3 buckets quickly, reliably, and observably. We used the DBOS Transact durable execution framework to achieve these goals and benchmarked the performance and cost of the application. S3Mirror is an open source DBOS Python application that can run in a variety of environments, including DBOS Cloud Pro, where it runs as much as 40x faster than AWS DataSync at a fraction of the cost. Moreover, S3Mirror is resilient to failures and allows for real-time filewise observability of ongoing and past transfers. Show Chinese abstract

Abstract: 为了满足一家大型制药组织的需求，我们着手创建了 S3Mirror——一个用于在 S3 存储桶之间快速、可靠且可观察地传输大规模基因组测序数据集的应用程序。 我们使用了 DBOS Transact 持久化执行框架来实现这些目标，并对该应用程序的性能和成本进行了基准测试。 S3Mirror 是一个开源的 DBOS Python 应用程序，可以在多种环境中运行，包括 DBOS Cloud Pro，在该平台上它的运行速度可以比 AWS DataSync 快达 40 倍，而成本仅为后者的很小一部分。 此外，S3Mirror 对故障具有弹性，并允许对正在进行和已完成的传输进行实时的文件级可观察性。