(NLP) 2차 Prompt Learning 발표 (2022-05-04)

• 논문 리스트 정리
  • Attention Is All You Need
    • https://arxiv.org/pdf/1706.03762.pdf
  • BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
    • https://arxiv.org/pdf/1810.04805.pdf
  • ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
    • https://arxiv.org/pdf/1909.11942.pdf
  • Improving language understanding by generative pre-training
    • https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
  • Language Models are Unsupervised Multitask Learners
    • https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
  • Language Models are Few-Shot Learners
    • https://arxiv.org/pdf/2005.14165.pdf
  • Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference
    • https://arxiv.org/pdf/2001.07676.pdf
    • https://littlefoxdiary.tistory.com/62
    • https://github.com/timoschick/pet
  • It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners
    • https://arxiv.org/pdf/2009.07118.pdf
  • AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts
    • https://arxiv.org/abs/2010.15980
  • GPT Understands, Too
    • https://arxiv.org/pdf/2103.10385.pdf
    • https://github.com/THUDM/P-tuning

GitHub - THUDM/P-tuning: A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.