跳到正文
论文阅读

论文阅读

扩散模型

大语言模型

  • 注意力机制 Transformer — Attention Is All You Need
  • 生成式预训练 GPT — Improving Language Understanding by Generative Pre-Training
  • 上下文学习 GPT-3 — Language Models are Few-Shot Learners
  • 训练规模与数据 Chinchilla — Training Compute-Optimal Large Language Models
  • 基础语言模型 LLaMA — LLaMA: Open and Efficient Foundation Language Models
  • 低秩微调 LoRA — LoRA: Low-Rank Adaptation of Large Language Models
  • 指令微调与对齐 InstructGPT — Training language models to follow instructions with human feedback
  • 直接偏好优化 DPO — Direct Preference Optimization: Your Language Model is Secretly a Reward Model
  • 检索增强生成 RAG — Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
  • 思维链 CoT — Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • 推理强化学习 DeepSeek-R1 — DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning