Evaluating Large Language Model Outputs: A Practical Guide
This course addresses evaluating Large Language Models (LLMs), starting with foundational evaluation methods, exploring advanced techniques with Vertex AI's tools.
Segment 01: Introduction to the Course and Meet the Instructor
Segment 02: Introduction to LLMs and their Evaluation Methods
Segment 03: Benefits and Challenges of LLM Evaluation Methods
Segment 04: LLM Evaluation on Vertex AI
Segment 05: Automatic Metrics
Segment 06: Automatic Metrics Demo
Segment 07: AutoSxS
Segment 08: AutoSxS Demo
Segment 09: Text-based Evaluation Models
Segment 10: Diversity Metrics and Zero-shot Evaluation for LLMs
Segment 11: Evaluation of Non-Text Generative AI Models
Segment 12: Final Notes: Importance of Human Evaluation
Segment 13: Congratulations and Continuous Learning Journey