In Remote Sensing (RS), Parameter-Efficient Fine-Tuning (PEFT) has emerged as a key approach to activate the generalizable representation ability of foundation models for downstream tasks. However, existing specialized PEFT methods often fail when applied to large-scale Earth observation tasks, as they are unable to fully handle the multifaceted and unpredictable domain gaps (\eg, spatial, semantic, and frequency shifts) inherent in RS data. To overcome this, we propose CrossEarth-Gate, which introduces two primary contributions. First, we establish a comprehensive RS module toolbox to address multifaceted domain gaps, comprising spatial, semantic, and frequency modules. Second, we develop a Fisher-guided adaptive selection mechanism that operates on this toolbox. This selection is guided by Fisher Information to quantify each module's importance by measuring its contribution to the task-specific gradient flow. It dynamically activates only the most critical modules at the appropriate layers, guiding the gradient flow to maximize adaptation effectiveness and efficiency. Comprehensive experiments validate the efficacy and generalizability of our method, where CrossEarth-Gate achieves state-of-the-art performance across 16 cross-domain benchmarks for RS semantic segmentation. The code of the work will be released.
翻译:在遥感领域,参数高效微调已成为激活基础模型在下游任务中泛化表征能力的关键方法。然而,现有专用PEFT方法在应用于大规模地球观测任务时往往失效,因其无法充分处理遥感数据固有的多面性及不可预测的域差异(如空间、语义及频域偏移)。为克服此局限,本文提出CrossEarth-Gate方法,其贡献主要体现在两方面:首先,我们构建了涵盖空间、语义与频域模块的综合性遥感模块工具箱,以应对多维度域差异;其次,我们开发了基于该工具箱的Fisher引导自适应选择机制。该机制通过Fisher信息量化各模块对任务特定梯度流的贡献度,从而动态激活关键层中最核心的模块,引导梯度流向以最大化自适应效能与效率。综合实验验证了本方法的有效性与泛化能力:CrossEarth-Gate在16个跨域遥感语义分割基准测试中均达到最先进性能。本工作的代码将公开释放。