Skip to content
calwm

Quiz: Testing, validation, and troubleshooting

Think you know Testing, validation, and troubleshooting? The quiz will find out. Every question has a clear answer, a timer that is polite but firm, and an explanation that tells you why the wrong choices looked so tempting.

Pick the right answer before the clock picks for you.

Start the quiz10 questions, about 20 min

What you will practise

You will practise Testing, validation, and troubleshooting, with questions touching testing.

  • Testing

It is part of the AWS Certified Generative AI Developer - Professional track (AIP-C01), where Testing, validation, and troubleshooting is about 11% of the exam.

A taste of what you will get

  • Which Bedrock capability uses a stronger model to score another model's outputs for qualities like correctness and helpfulness?

    • LLM-as-a-judge model evaluation jobs
    • Provisioned Throughput for steady capacity
    • Prompt caching for repeated prompt prefixes
    • Guardrails word filters for blocked terms

    Answer: LLM-as-a-judge model evaluation jobs. Model Evaluation supports LLM-as-a-judge jobs where a judge model rates responses against metrics. The other options handle capacity, cost and filtering.

  • You changed your chunking strategy. How do you check that retrieval quality did not regress?

    • Ask a colleague whether the answers feel better than before
    • Raise the temperature and see whether the answers look varied
    • Re-embed everything with a different model and skip any measuring of results
    • Run a golden dataset through RAG evaluation and compare to the baseline

    Answer: Run a golden dataset through RAG evaluation and compare to the baseline. A fixed dataset with RAG evaluation gives comparable before-and-after numbers for retrieval and generation. Feelings are not a metric.

Advertise here

How scoring works

  • Every correct answer pays 10 XP for each difficulty level, so an easy item is worth 10, a medium one 20 and a hard one 30.
  • Answer with time to spare and you can earn up to 5 bonus XP on top.
  • A wrong answer pays nothing. It does not cost you anything either.
  • Flashcards pay 2 XP each time you grade yourself 3 or higher.
  • Using a hint costs 2 XP, so use it when it helps, not when it is comfortable.
  • Finish a session on consecutive days to build a streak. Your progress lives in your browser, and signing in syncs it.

Quick answers

How long does the quiz on Testing, validation, and troubleshooting take?
About 20 minutes for 10 questions. Pause whenever you like.
Do I need an account to play the quiz?
No. Progress is saved in your browser, and signing in syncs it across devices.