Which evaluation setup best aligns with GH-600 guidance for agent tasks?

AJudge success only by whether the model sounded confident

BDefine expected outcomes, operational constraints, and qualitative or quantitative signals

CMeasure only token usage and ignore task intent

DAccept any output if it modifies at least one file

More Perform evaluation, error analysis, and tuning Questions

54 questions

Full GitHub Agentic AI Developer Practice Test

All topics covered

All GitHub Agentic AI Developer Questions

Browse by topic

Related Questions

A team wants objective evaluation signals for an agent that updates dependencies. Which signal sourc...

medium

Which root-cause category is explicitly listed in the GH-600 study guide for agent failures?...

easy

An agent produced the wrong change, and you need to identify why. Which evidence sources does GH-600...

medium

In the VS Code Chat Debug view, which section is the best place to verify that custom instructions o...

medium

In the VS Code Chat Debug view, which section lets you verify the inputs and outputs of tools that w...

medium

View all Perform evaluation, error analysis, and tuning questions

Educational Content — CertQnA practice questions are written against official exam objectives, covering the same domains tested on the real exam. All content is original and independent — not actual exam questions, not affiliated with any certification vendor. Learn more about our content policy

Discussion

Be the first to share your understanding of this concept

⚠️ Discussion is for concept clarification only. Do not share or request actual exam questions or answers.