Skip to main content
CenXiv.org
This website is in trial operation, support us!
We gratefully acknowledge support from all contributors.
Contribute
Donate
cenxiv logo > stat > arXiv:2506.06243v3

Help | Advanced Search

Statistics > Computation

arXiv:2506.06243v3 (stat)
[Submitted on 6 Jun 2025 (v1) , last revised 22 Aug 2025 (this version, v3)]

Title: Fairmetrics: An R package for group fairness evaluation

Title: Fairmetrics:一个用于群体公平性评估的R包

Authors:Benjamin Smith, Jianhui Gao, Jessica Gronsbell
Abstract: Fairness is a growing area of machine learning (ML) that focuses on ensuring models do not produce systematically biased outcomes for specific groups, particularly those defined by protected attributes such as race, gender, or age. Evaluating fairness is a critical aspect of ML model development, as biased models can perpetuate structural inequalities. The {fairmetrics} R package offers a user-friendly framework for rigorously evaluating numerous group-based fairness criteria, including metrics based on independence (e.g., statistical parity), separation (e.g., equalized odds), and sufficiency (e.g., predictive parity). Group-based fairness criteria assess whether a model is equally accurate or well-calibrated across a set of predefined groups so that appropriate bias mitigation strategies can be implemented. {fairmetrics} provides both point and interval estimates for multiple metrics through a convenient wrapper function and includes an example dataset derived from the Medical Information Mart for Intensive Care, version II (MIMIC-II) database (Goldberger et al., 2000; Raffa, 2016).
Abstract: 公平性是机器学习(ML)的一个日益重要的领域,其重点是确保模型不会对特定群体产生系统性的偏差结果,尤其是那些由受保护属性(如种族、性别或年龄)定义的群体。 评估公平性是机器学习模型开发中的一个关键方面,因为有偏的模型可能会加剧结构性不平等。 {公平度量}R 包提供了一个用户友好的框架,用于严格评估多种基于群体的公平性标准,包括基于独立性(例如,统计公平性)、分离性(例如,等化几率)和充分性(例如,预测公平性)的指标。 基于群体的公平性标准评估模型在一组预定义群体中是否具有同等的准确性或校准度,以便可以实施适当的偏差缓解策略。 {公平度量}通过一个方便的包装函数提供了多个指标的点估计和区间估计,并包含了一个从重症监护医学信息库,第二版(MIMIC-II)数据库(Goldberger 等,2000;Raffa,2016)中得出的示例数据集。
Comments: 6 pages, 1 figure, 1 table
Subjects: Computation (stat.CO) ; Machine Learning (cs.LG); Machine Learning (stat.ML)
ACM classes: G.3; G.4
Cite as: arXiv:2506.06243 [stat.CO]
  (or arXiv:2506.06243v3 [stat.CO] for this version)
  https://doi.org/10.48550/arXiv.2506.06243
arXiv-issued DOI via DataCite
Related DOI: https://doi.org/10.21105/joss.08497
DOI(s) linking to related resources

Submission history

From: Benjamin Smith [view email]
[v1] Fri, 6 Jun 2025 17:07:41 UTC (577 KB)
[v2] Thu, 19 Jun 2025 00:00:46 UTC (577 KB)
[v3] Fri, 22 Aug 2025 22:48:30 UTC (574 KB)
Full-text links:

Access Paper:

    View a PDF of the paper titled
  • View Chinese PDF
  • View PDF
  • HTML (experimental)
  • TeX Source
license icon view license
Current browse context:
stat.CO
< prev   |   next >
new | recent | 2025-06
Change to browse by:
cs
cs.LG
stat
stat.ML

References & Citations

  • NASA ADS
  • Google Scholar
  • Semantic Scholar
a export BibTeX citation Loading...

BibTeX formatted citation

×
Data provided by:

Bookmark

BibSonomy logo Reddit logo

Bibliographic and Citation Tools

Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)

Code, Data and Media Associated with this Article

alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)

Demos

Replicate (What is Replicate?)
Hugging Face Spaces (What is Spaces?)
TXYZ.AI (What is TXYZ.AI?)

Recommenders and Search Tools

Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)
IArxiv Recommender (What is IArxiv?)
  • Author
  • Venue
  • Institution
  • Topic

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)
  • About
  • Help
  • contact arXivClick here to contact arXiv Contact
  • subscribe to arXiv mailingsClick here to subscribe Subscribe
  • Copyright
  • Privacy Policy
  • Web Accessibility Assistance
  • arXiv Operational Status
    Get status notifications via email or slack

京ICP备2025123034号