(NLP) Prompt Learning 발표 (2022-04-27)

• Attention Is All You Need
  • https://arxiv.org/pdf/1706.03762.pdf
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
  • https://arxiv.org/pdf/1810.04805.pdf
• ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
  • https://arxiv.org/pdf/1909.11942.pdf
• Improving language understanding by generative pre-training
  • https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf

Language Models are Unsupervised Multitask Learners

• https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
• Language Models are Few-Shot Learners
  • https://arxiv.org/pdf/2005.14165.pdf
• Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference
  • https://arxiv.org/pdf/2001.07676.pdf
  • https://littlefoxdiary.tistory.com/62
  • https://github.com/timoschick/pet
• It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners
  • https://arxiv.org/pdf/2009.07118.pdf
• GPT Understands, Too
  • https://arxiv.org/pdf/2103.10385.pdf