Skip to content
calwm

Flashcards: Testing, validation, and troubleshooting

Testing, validation, and troubleshooting sticks when you recall it, not when you reread it. Flip a card, answer out loud, then grade yourself honestly. Nobody is checking, which is exactly why lying to yourself is the only way to lose.

Flip, recall, grade yourself honestly.

Flip the cards14 cards, about 7 min, plus any cards due

What you will practise

You will practise Testing, validation, and troubleshooting, with questions touching testing.

  • Testing

It is part of the AWS Certified Generative AI Developer - Professional track (AIP-C01), where Testing, validation, and troubleshooting is about 11% of the exam.

A taste of what you will get

  • What is a golden dataset?

    Answer: A curated set of prompts with expected answers or rubrics, replayed after every change to catch regressions.

  • What is LLM-as-a-judge?

    Answer: Using a model to score other outputs against criteria such as correctness, completeness, helpfulness or harmfulness.

How scoring works

  • Every correct answer pays 10 XP for each difficulty level, so an easy item is worth 10, a medium one 20 and a hard one 30.
  • Answer with time to spare and you can earn up to 5 bonus XP on top.
  • A wrong answer pays nothing. It does not cost you anything either.
  • Flashcards pay 2 XP each time you grade yourself 3 or higher.
  • Using a hint costs 2 XP, so use it when it helps, not when it is comfortable.
  • Finish a session on consecutive days to build a streak. Your progress lives in your browser, and signing in syncs it.

Quick answers

How long does the flashcards on Testing, validation, and troubleshooting take?
About 7 minutes for 14 cards, plus any cards due. Pause whenever you like.
Do I need an account to play the flashcards?
No. Progress is saved in your browser, and signing in syncs it across devices.