BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
What it is
This paper introduces BERT, a language representation model that pre-trains deep bidirectional representations from unlabeled text by conditioning on both left and right context. It demonstrates that the pre-trained model can be fine-tuned with a single additional output layer to achieve state-of-the-art results on a wide range of natural language processing tasks.
The problem it solves
Previous language representation models were unidirectional or could not be easily adapted to diverse downstream NLP tasks without substantial architecture modifications.
What you could use it for
- Question answering systems
- Natural Language Inference
- Text classification
- Named Entity Recognition
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.