4Generative AI quality assurance and observability

• 4.1Evaluating and validating generative AI apps and agents

  Understand creating test datasets and data mapping, AI quality metrics (groundedness/relevance/coherence/fluency), risk and safety evaluations for harmful content detection, and configuring automated evaluation workflows using built-in/custom metrics.

• 4.2Observability for generative AI apps and agents

  Understand continuous monitoring in Foundry, monitoring performance metrics (latency, throughput, response times), tracking and optimizing cost metrics (token consumption, resource usage), and configuring detailed logging, tracing, and debugging for production troubleshooting.