标题： 大型语言模型的模型来源测试 显示英文标题

标题： Model Provenance Testing for Large Language Models

摘要： 大型语言模型通过微调和其他适应方式越来越被定制，这给执行许可条款和管理下游影响带来了挑战。 追踪模型来源对于保护知识产权以及在基础模型中发现偏差或漏洞时识别衍生模型至关重要。 我们通过开发一种测试模型来源的框架来解决这一挑战：判断一个模型是否源自另一个模型。 我们的方法基于一个关键观察，即现实世界中的模型衍生会在模型输出中保留显著的相似性，这些相似性可以通过统计分析检测到。 我们仅使用对模型的黑盒访问，通过多重假设检验将模型相似性与由不相关模型建立的基线进行比较。 在两个涵盖从30M到4B参数的模型且包含超过600个模型的全面现实基准测试中，我们的测试器在识别衍生模型方面实现了90-95%的精确率和80-90%的召回率。 这些结果表明，即使只有API访问权限，在生产环境中系统性的来源验证也是可行的。 显示英文摘要

摘要： Large language models are increasingly customized through fine-tuning and other adaptations, creating challenges in enforcing licensing terms and managing downstream impacts. Tracking model origins is crucial both for protecting intellectual property and for identifying derived models when biases or vulnerabilities are discovered in foundation models. We address this challenge by developing a framework for testing model provenance: Whether one model is derived from another. Our approach is based on the key observation that real-world model derivations preserve significant similarities in model outputs that can be detected through statistical analysis. Using only black-box access to models, we employ multiple hypothesis testing to compare model similarities against a baseline established by unrelated models. On two comprehensive real-world benchmarks spanning models from 30M to 4B parameters and comprising over 600 models, our tester achieves 90-95% precision and 80-90% recall in identifying derived models. These results demonstrate the viability of systematic provenance verification in production environments even when only API access is available.