Skip to content
calwm

Match: Testing, validation, and troubleshooting

Testing, validation, and troubleshooting is mostly knowing which thing belongs with which other thing. Pair the terms, fix the order, sort the cards, and get your mistakes pointed out before an exam does it for you.

Pair the terms before they pair you off.

Match the terms2 matching rounds, about 2 min

What you will practise

You will practise Testing, validation, and troubleshooting, with questions touching testing.

  • Testing

It is part of the AWS Certified Generative AI Developer - Professional track (AIP-C01), where Testing, validation, and troubleshooting is about 11% of the exam.

A taste of what you will get

  • Sample round 1: which term goes with which?

    • ThrottlingException bursts
    • Malformed JSON replies

    Answer: ThrottlingException bursts goes with Quota hit, so back off and spread load. Malformed JSON replies goes with No schema enforcement or validation.

  • Sample round 2: put these in the right order.

    • Fix chunking, embeddings, filters or freshness
    • Re-run the golden dataset before shipping
    • Reproduce the issue and pull the logged prompt
    • Refine the prompt and grounding instructions

    Answer: The right order is Reproduce the issue and pull the logged prompt, then Check which chunks retrieval returned, then Fix chunking, embeddings, filters or freshness, then Refine the prompt and grounding instructions.

Advertise here

How scoring works

  • Every correct answer pays 10 XP for each difficulty level, so an easy item is worth 10, a medium one 20 and a hard one 30.
  • Answer with time to spare and you can earn up to 5 bonus XP on top.
  • A wrong answer pays nothing. It does not cost you anything either.
  • Flashcards pay 2 XP each time you grade yourself 3 or higher.
  • Using a hint costs 2 XP, so use it when it helps, not when it is comfortable.
  • Finish a session on consecutive days to build a streak. Your progress lives in your browser, and signing in syncs it.

Quick answers

How long does the match on Testing, validation, and troubleshooting take?
About 2 minutes for 2 matching rounds. Pause whenever you like.
Do I need an account to play the match?
No. Progress is saved in your browser, and signing in syncs it across devices.