Talks

Concepts for Reliability of LLMs in Production

📍 Google Developer Workspace, Singapore
🗓️ Oct 11, 2023

  • Concerns with utilizing LLM APIs in production ML systems
  • Swiss cheese strategy for reliability in LLM-enabled applications
  • Compartmentalization, explainability, online guardrails, offline testing, human evaluation
  • Examples / case studies
Slides