Field-Programmable Gate Arrays (FPGAs) have become essential in cloud computing due to their reconfigurability, energy efficiency, and ability to accelerate domain-specific workloads. As FPGA adoption grows, research into task scheduling and preemption techniques has intensified. However, the field lacks a standardized benchmarking framework for consistent and reproducible evaluation. Many existing studies propose innovative scheduling or preemption mechanisms but often rely on proprietary or synthetic benchmarks, limiting generalizability and making comparison difficult. This methodical fragmentation hinders effective evaluation of scheduling strategies and preemption in multi-tenant FPGA environments. This paper presents the first open-source preemption-enabled benchmark suite for evaluating FPGA preemption strategies and testing new scheduling algorithms, without requiring users to create preemption workloads from scratch. The suite includes 27 diverse applications spanning cryptography, AI/ML, computation-intensive workloads, communication systems, and multimedia processing. Each benchmark integrates comprehensive context-saving and restoration mechanisms, facilitating reproducible research and consistent comparisons. Our suite not only simplifies testing FPGA scheduling policies but also benefits OS research by enabling the evaluation of scheduling fairness, resource allocation efficiency, and context-switching performance in multi-tenant FPGA systems, ultimately supporting the development of better operating systems and scheduling policies for FPGA-based environments. We also provide guidelines for adding new benchmarks, enabling future research to expand and refine FPGA preemption and scheduling evaluation.

翻译：现场可编程门阵列（FPGA）因其可重构性、高能效及对特定领域工作负载的加速能力，已成为云计算中的关键组件。随着FPGA的广泛应用，针对任务调度与抢占技术的研究日益深入。然而，该领域缺乏标准化的基准测试框架，难以实现一致且可复现的评估。现有研究虽常提出创新的调度或抢占机制，但多依赖于专有或合成基准，限制了普适性并导致比较困难。这种系统性碎片化阻碍了多租户FPGA环境中调度策略与抢占机制的有效评估。本文提出了首个开源的、支持抢占的基准测试套件，用于评估FPGA抢占策略并测试新调度算法，用户无需从头创建抢占工作负载。该套件包含27个多样化应用，涵盖密码学、人工智能/机器学习、计算密集型任务、通信系统及多媒体处理等领域。每个基准均集成全面的上下文保存与恢复机制，以促进可复现的研究和一致的比较。本套件不仅简化了FPGA调度策略的测试，还可通过评估多租户FPGA系统中的调度公平性、资源分配效率及上下文切换性能，助力操作系统研究，最终支持为基于FPGA的环境开发更优的操作系统与调度策略。我们还提供了新增基准的指导原则，以便未来研究能够扩展和完善FPGA抢占与调度评估体系。