AI Engineering

Part Three: AI Engineering

Imagine you are building an assistant for a real company. Someone asks: “What did we promise customer X last quarter, and can you open a follow-up ticket?” A plain chatbot will invent an answer. A useful system will find the right documents, remember the conversation, call tools safely, and leave a trail you can trust.

This part is the story of how that system is built — not as magic, but as a stack of ideas you can explain on a whiteboard.

  • How LLMs work — why next-token prediction is enough to get reasoning, code, and conversation.
  • Prompting — the control surface: roles, examples, structure, and evaluation.
  • RAG — giving the model your private knowledge at question time.
  • Memory — carrying the right context across turns without drowning the window.
  • Agents — the think → act → observe loop that turns answers into actions.
  • MCP — a standard way to plug tools and data into any host.
  • Skills — reusable procedures loaded only when a task needs them.
  • Design walkthrough — wiring every piece into one assistant.

Read it as a continuous story. Each chapter adds one capability. By the end you should be able to design, critique, and interview on modern AI systems with the same confidence you bring to coding patterns and distributed design.