Bayesian Inference Forgetting

AI-generated keywords: Bayesian Inference Forgetting Right to be Forgotten Machine Learning BIF Framework Generalizability

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • The paper addresses the issue of enforcing the right to be forgotten in machine learning
  • Existing approaches propose removing the influence of requested data points on learned models using influence functions
  • Bayesian Inference Forgetting (BIF) framework extends forgetting algorithms to Bayesian inference
  • BIF includes forgetting algorithms for variational inference and Markov chain Monte Carlo
  • The proposed algorithms effectively remove the influence of individual data points on learned models
  • Theoretical analysis demonstrates guaranteed generalizability of the proposed algorithms
  • Experiments validate feasibility using Gaussian mixture models and Bayesian neural networks
  • BIF framework offers effective forgetting algorithms for Bayesian inference, allowing compliance with individual requests without deleting entire models trained on massive resources.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Shaopeng Fu, Fengxiang He, Yue Xu, Dacheng Tao

Abstract: The right to be forgotten has been legislated in many countries but the enforcement in machine learning would cause unbearable costs: companies may need to delete whole models trained from massive resources because of single individual requests. Existing works propose to remove the influence of the requested datums on the learned models via its influence function which is no longer naturally well-defined in Bayesian inference. To address this problem, this paper proposes a {\it Bayesian inference forgetting} (BIF) framework to extend the applicable domain to Bayesian inference. In the BIF framework, we develop forgetting algorithms for variational inference and Markov chain Monte Carlo. We show that our algorithms can provably remove the influence of single datums on the learned models. Theoretical analysis demonstrates that our algorithms have guaranteed generalizability. Experiments of Gaussian mixture models on the synthetic dataset and Bayesian neural networks on the Fashion-MNIST dataset verify the feasibility of our methods. The source code package is available at \url{https://github.com/fshp971/BIF}.

Submitted to arXiv on 16 Jan. 2021

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2101.06417v1

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

The paper titled "Bayesian Inference Forgetting" addresses the issue of enforcing the right to be forgotten in machine learning. This can lead to significant costs for companies. The right to be forgotten allows individuals to request the deletion of their personal data from models trained on massive datasets. Existing approaches propose removing the influence of requested data points on learned models using influence functions. However, these methods are not naturally well-defined in Bayesian inference. To overcome this limitation, the authors propose a framework called Bayesian Inference Forgetting (BIF) that extends the applicability of forgetting algorithms to Bayesian inference. The BIF framework includes forgetting algorithms for variational inference and Markov chain Monte Carlo. These algorithms can effectively remove the influence of individual data points on learned models. The paper provides theoretical analysis demonstrating that the proposed algorithms have guaranteed generalizability. Additionally, experiments conducted on Gaussian mixture models using synthetic datasets and Bayesian neural networks using the Fashion-MNIST dataset validate the feasibility of the proposed methods. Overall, this paper introduces a novel approach to address the challenges associated with enforcing the right to be forgotten in machine learning. The BIF framework offers effective forgetting algorithms for Bayesian inference, allowing companies to comply with individual requests without deleting entire models trained on massive resources.
Created on 27 Jan. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.