Historical role
What the organisation contributed
OpenAI's 2018 work trained a Transformer language model on broad text and fine-tuned it across tasks.
Why it mattered
Reduces the need to hand-author, hand-code or pre-store every linguistic response a machine may produce.
Connected topics
Where this fits in ITEM
Evidence
Sources and further reading
- Improving Language Understanding by Generative Pre-Training
Alec Radford · 2018
- Language Models are Unsupervised Multitask Learners
Alec Radford · 2019