Differentially Private Next-Token Prediction of Large Language Models
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 4390-4404
Abstract
James Flemings, Meisam Razaviyayn, Murali Annavaram. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2024.Keywords
This publication has 7 references indexed in Scilit:
- Chapter 3 Composition of Differential Privacy & Privacy Amplification by Subsampling2025
- Ethos: Rectifying Language Models in Orthogonal Parameter Space2024
- How to DP-fy ML: A Practical Guide to Machine Learning with Differential PrivacyJournal of Artificial Intelligence Research, 2023
- Transformer-XL: Attentive Language Models beyond a Fixed-Length Context2019
- Hierarchical Neural Story Generation2018
- One billion word benchmark for measuring progress in statistical language modeling2014
- The Algorithmic Foundations of Differential Privacy2013