00:00:00

Share Your Feedback 🏝️

A Survey | Context Engineering for LLMs

A Survey | Context Engineering for LLMs

MinWoo(Daniel) Park | Tech Blog

Read more
Previous: Towards Large Reasoning Models Next: Apple LFM | Tech Report

A Survey | Context Engineering for LLMs

  • Related Project: Private
  • Category: Paper Review
  • Date: 2025-07-21

A Survey of Context Engineering for Large Language Models

  • url https://arxiv.org/abs/2507.13334
  • pdf https://arxiv.org/pdf/2507.13334
  • html: https://arxiv.org/html/2507.13334v1
  • abstract The performance of Large Language Models (LLMs) is fundamentally determined by the contextual information provided during inference. This survey introduces Context Engineering, a formal discipline that transcends simple prompt design to encompass the systematic optimization of information payloads for LLMs. We present a comprehensive taxonomy decomposing Context Engineering into its foundational components and the sophisticated implementations that integrate them into intelligent systems. We first examine the foundational components: context retrieval and generation, context processing and context management. We then explore how these components are architecturally integrated to create sophisticated system implementations: retrieval-augmented generation (RAG), memory systems and tool-integrated reasoning, and multi-agent systems. Through this systematic analysis of over 1300 research papers, our survey not only establishes a technical roadmap for the field but also reveals a critical research gap: a fundamental asymmetry exists between model capabilities. While current models, augmented by advanced context engineering, demonstrate remarkable proficiency in understanding complex contexts, they exhibit pronounced limitations in generating equally sophisticated, long-form outputs. Addressing this gap is a defining priority for future research. Ultimately, this survey provides a unified framework for both researchers and engineers advancing context-aware AI.
Previous: Towards Large Reasoning Models Next: Apple LFM | Tech Report

post contain ""

    No matching posts found containing ""