Eval Testing and Debugging Questions
Practice questions for Eval Testing and Debugging topic in Claude Certified Developer – Foundations. 5 questions covering this domain.
A developer updates a system prompt to improve clarity and receives reports that Claude now produces hallucinated facts in some cases, despite the upd...
A developer deploys a new system prompt and receives user feedback that the bot now hallucinated facts that it previously handled correctly. The devel...
A developer uses Claude as an LLM judge to score outputs from their RAG pipeline on a 1-5 quality scale. They notice the judge consistently assigns sc...
A developer builds an eval suite to test a RAG pipeline that answers questions from a 500-page internal knowledge base. The eval suite includes 100 te...
A developer builds a RAG system and creates an eval suite with 100 test questions. They use Claude Opus 4.8 as an LLM judge to score answers on a 1-10...