(NLP 연구) prompt based learning 04.18

• 논문 리스트 정리
  • Attention Is All You Need
    • https://arxiv.org/pdf/1706.03762.pdf
  • BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
    • https://arxiv.org/pdf/1810.04805.pdf
  • ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
    • https://arxiv.org/pdf/1909.11942.pdf
  • Improving language understanding by generative pre-training
    • https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
  Language Models are Unsupervised Multitask Learners
  • https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
  • Language Models are Few-Shot Learners
    • https://arxiv.org/pdf/2005.14165.pdf
  • Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference
    • https://arxiv.org/pdf/2001.07676.pdf
  • It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners
    • https://arxiv.org/pdf/2009.07118.pdf
  • GPT Understands, Too
    • https://arxiv.org/pdf/2103.10385.pdf