A developer deploys a new system prompt and receives user feedback that the bot now hallucinated facts that it previously handled correctly. The developer wants to identify exactly which prompt change caused the regression before the next deployment. What is the recommended approach?
This question requires Pro
Unlock all 5 questions in this certification
Written by certified professionals · Aligned to official exam objectives
View all Pro featuresMore Eval Testing and Debugging Questions
5 questions
Full Claude Certified Developer – Foundations Practice Test
All topics covered
All Claude Certified Developer – Foundations Questions
Browse by topic
Related Questions
A developer updates a system prompt to improve clarity and receives reports that Claude now produces...
A developer uses Claude as an LLM judge to score outputs from their RAG pipeline on a 1-5 quality sc...
A developer builds an eval suite to test a RAG pipeline that answers questions from a 500-page inter...
A developer builds a RAG system and creates an eval suite with 100 test questions. They use Claude O...
Educational Content — CertQnA practice questions are written against official exam objectives, covering the same domains tested on the real exam. All content is original and independent — not actual exam questions, not affiliated with any certification vendor. Learn more about our content policy