Release Strategies and the Social Impacts of Language Models
Authors:
Irene Solaiman,
Miles Brundage,
Jack Clark,
Amanda Askell,
Ariel Herbert-Voss,
Jeff Wu,
Alec Radford,
Gretchen Krueger,
Jong Wook Kim,
Sarah Kreps,
Miles McCain,
Alex Newhouse,
Jason Blazakis,
Kris McGuffie,
Jasmine Wang
Abstract:
Large language models have a range of beneficial uses: they can assist in prose, poetry, and programming; analyze dataset biases; and more. However, their flexibility and generative capabilities also raise misuse concerns. This report discusses OpenAI's work related to the release of its GPT-2 language model. It discusses staged release, which allows time between model releases to conduct risk and…
▽ More
Large language models have a range of beneficial uses: they can assist in prose, poetry, and programming; analyze dataset biases; and more. However, their flexibility and generative capabilities also raise misuse concerns. This report discusses OpenAI's work related to the release of its GPT-2 language model. It discusses staged release, which allows time between model releases to conduct risk and benefit analyses as model sizes increased. It also discusses ongoing partnership-based research and provides recommendations for better coordination and responsible publication in AI.
△ Less
Submitted 12 November, 2019; v1 submitted 24 August, 2019;
originally announced August 2019.
