Chapter 6

Hosted on YouTube. Nothing loads from YouTube until you press play.

Essentials · Chapter 6 · 6 of 24 in the series

Build an Online Recruitment Test in Quelixa

Build a recruitment assessment from reviewed questions to an online sitting. This lesson shows the question bank, a 20-question timed paper and the test register that calls candidates who have passed scrutiny.

01Lesson notes

What you will learn#

  • The distinction between question bank, paper and sitting register
  • Why draft questions need review before use
  • How a timed online paper and its window are configured
  • How candidates are fetched from scrutiny and notified

Step by step#

  1. Recruitment › Assessment Topics

    • Product design — The topic this paper draws on.
    • Questions — How many live questions each topic holds.
  2. Recruitment › Question Bank

    • Drafts — Waiting for review — not usable in a paper.
    • Drawable — Reviewed and valid: these can go on a paper.
    • Mei's question — Entered this morning, still a draft.
  3. Recruitment › Question Bank › Draft

    • Reviewed — may be drawn — Off: nobody has checked it yet.
    • Options — Four answers, one marked correct.
    • Mark as Reviewed — The second pair of eyes.
  4. Recruitment › Question Bank › Reviewed

    • Reviewed — may be drawn — Now on: it can be used in a paper.
  5. Recruitment › Online Test Papers › Product design exercise

    • Fixed questions — Every candidate gets these, on top of any random draws.
    • Composition — What a candidate will actually receive.
  6. Recruitment › Online Test Papers › Settings

    • Time allowed — Thirty minutes, running from the moment she starts.
    • Shuffling — Questions and options in a different order for each candidate.
    • Tab switches — Three are allowed; a fourth raises a flag.
    • Results — Released with the test result, not on the spot.
  7. Recruitment › Online Test Papers › Twenty questions

    • Random draws — Each candidate gets a different set from the bank, per topic.
    • Fixed questions — Everyone gets the same twenty.
    • Composition — Ready: twenty questions in thirty minutes.
  8. Recruitment › Test Registers › Draft

    • The sitting — The date, the venue — online — the duration and the invigilator.
    • Online delivery — The paper, and the window it is open.
    • Quick Actions — Eight scrutinised candidates, waiting to be fetched.
  9. Recruitment › Test Registers › Score sheet

    • Score sheet — One row per candidate, fetched from scrutiny.
  10. Recruitment › Test Registers › ISO 10667

    • Assessment procedure — What is measured, how it is scored, who validated it.
    • Validated by — Empty for now.
  11. Recruitment › Test Registers › Ready to call

    • Quick Actions — Readiness against the standard, and the next step.
    • Lock & Call Candidates — Freeze the list and send the call letters.
  12. Recruitment › Test Registers › Candidates called

    • Score sheet — Eight candidates, by name now, marks still to come.
  13. Recruitment › Test Registers › Validated

    • Assessment procedure — Now complete.
    • Validated by — James Whitfield, recruitment manager.
  14. Candidate portal › Dashboard

    • Upcoming sittings — The test, the date and how it is delivered.
    • Latest updates — Called for the test; the online test is ready.
  15. Candidate portal › Online tests

    • The paper — Twenty questions, thirty minutes, and the window — opens soon.
Practice task

In Recruitment › Question Bank, add a draft question for a role you hire for, with four options and one marked correct. Ask a colleague to mark it reviewed, then confirm it now counts as drawable.

Transcript

What will it actually ask?

Lina: Monday in Singapore. Eight people are through scrutiny, and the next step is a written test that does not exist yet.

Mei Tan: I sent you my questions last week. And one more at midnight.

Elena Novak: Then let us turn them into a paper everyone can sit, from wherever they are.

David: From five countries, on the same day?

Lina: From eight countries, in one twelve-hour window. This chapter builds it: the questions, the paper, and the sitting.

Lina: This is chapter six. We build a written test from nothing — a bank of reviewed questions, a timed paper, and a register that calls the candidates.

A test is built in four layers

Lina: A test in Quelixa is four layers, and each one is reused differently.

Lina: The question bank holds questions, each with its answer key, and each reviewed before it can be used.

Lina: A paper picks questions from the bank and sets the rules: how long, in what order, what happens if you leave the window.

David: And the register is the day itself?

Lina: The register is one sitting: this post, this date, these candidates.

Lina: And the call is what the candidates receive. Build the first two once, and every future sitting reuses them.

The bank, in topics

Lina: The bank is organised by topic. General aptitude, numerical reasoning, verbal reasoning — and product design, which is ours.

David: So a topic is just a shelf.

Lina: A shelf, and the count beside it is how much it holds today.

Drawable, or not yet

Lina: And this is the bank itself. The top row is the question the whole screen answers: what can I use?

Lina: Thirty-six questions are drawable — reviewed, valid, ready.

Lina: One is a draft. It is Mei's question from last night, which Elena entered this morning.

David: Why can't she just use it?

Lina: Because nobody has checked it yet. A draft never reaches a candidate.

Mei's question

Lina: Here it is. A new market reads right to left — what do you check first?

Lina: Four answers, and one ticked as correct. The wrong ones are the kind a hurried designer might pick, which is what makes it a real question.

Lina: And the flag that matters: reviewed. It is off.

David: Who turns it on?

Lina: Somebody who did not write it. That is the whole review, and the button for it is right there.

Three tests for every question

Lina: Three tests every question has to pass before it belongs in a paper.

Lina: It tests the job. Not general knowledge — something the person would face in their first month.

Lina: One answer is defensible, and the others are plausible. A question with a silly wrong answer is really a question with three options.

Lina: And someone other than the author has checked it. The system enforces that last one for you.

David: Which of the three do teams skip?

Lina: The third, usually. Checking a colleague's questions feels awkward — which is exactly why the system insists on it.

In the bank

Lina: Elena reads it, agrees, and marks it reviewed.

Lina: The status changes from draft to in the bank.

David: Only for this paper?

Lina: For any paper, for any post that tests product design. Written once, reviewed once, reused.

The paper, one short

Lina: Now the paper. It already holds nineteen questions, every one reviewed.

Lina: And the composition at the bottom says what a candidate will actually receive: nineteen questions, in thirty minutes.

David: Nineteen is an odd number for a paper out of a hundred.

Lina: It is. Twenty makes every question worth five per cent — and Mei's question is the twentieth.

The rules of the paper

Lina: The top of the paper holds its rules.

David: Thirty minutes from when?

Lina: From the moment a candidate starts, not from when the window opens.

Lina: Questions and options shuffled, so two candidates never see the same order.

David: Because they are sitting at home.

Lina: Because they are sitting at home. For the same reason, leaving the test window is recorded — three times is allowed, and a fourth raises a flag for the recruiter.

Lina: And the score is not shown the moment she hands in. It comes with the result, once the register closes.

Fixed, or drawn

David: And Mei's question goes on.

Lina: As question twenty.

Lina: There are two ways to build one. Random draws give every candidate a different set from the bank — useful when hundreds sit a test over weeks.

Lina: Fixed questions give everyone the same twenty.

David: And for eight people on one day?

Lina: Fixed is the fairer choice. Nobody can say their questions were harder.

Lina: And the composition turns green: twenty questions, thirty minutes, ready to attach to a sitting.

One sitting

Lina: That afternoon Elena opens the register — the record of this one sitting.

Lina: Friday the sixteenth, online, thirty minutes, with an invigilator named. And look at the total marks and the pass mark.

David: She did not type those.

Lina: She did not. They come from the post — set in chapter three, before anyone applied.

Lina: Underneath, the paper we just finished, and a window from nine in the morning to nine at night, in UTC. Twelve hours, so everyone can sit it in daylight.

David: And it already knows who is waiting.

Lina: Eight candidates, straight from scrutiny.

Eight rows, still codes

Lina: Fetch the candidates, and the score sheet fills: one row each.

David: Still under codes.

Lina: Still under codes. They are not called yet — until they are, blind review holds.

How the test is run, written down

Lina: Further down, the procedure — under ISO 10667, the international standard for delivering an assessment.

Lina: What is measured, how it is scored, and that feedback goes to candidates.

Lina: And one field still empty: who validated the procedure.

David: Is that page for an auditor, or for the candidates?

Lina: Both. Candidates read it on their own portal, and it stays on the record for anyone checking later.

Four of five

Lina: Tuesday morning, and the register grades itself: four of five. The missing one is that validation.

David: Does that stop her from calling them?

Lina: It does not. A standard is not a gate. But the flag stays until somebody accountable signs.

David: So she calls them anyway.

Lina: She locks the register, and the call letters go out.

The call brings the names back

Lina: This is where chapter five left them.

Lina: And the moment they are called for the test, the names come back.

David: Why give them back at all?

Lina: Because from here on, people have to meet them. You cannot interview a code.

Called, by name

Lina: The same eight rows — by name now.

David: And they have all been told?

Lina: Every one of them has a call letter and an online invitation, sent the moment she locked it.

Signed off

Lina: By mid-morning James, the recruitment manager, has read the procedure and signed it.

Lina: Five of five. And if anyone asks in a year how this test was run, the answer is on this page, with a name against it.

David: Could Elena have signed it herself?

Lina: She built the test, so it should be someone accountable for how it is run. Here, the recruitment manager.

What Sofia sees

Lina: And on Sofia's side, that evening, the portal has moved.

Lina: Her next step is the written test, on Friday, online.

Lina: And her updates say why: called for the written test, and the online test is ready.

David: Four days' notice.

Lina: Four days, with the date and how she sits it on her own dashboard.

Opens soon

Lina: Her online tests page shows the paper: twenty questions, thirty minutes, and the window. The button says it opens soon.

David: So she knows exactly what she is walking into.

Lina: Exactly. Nobody is surprised by the length of a test on the morning.

Chapter six, in five lines

Lina: Five lines.

Lina: Questions live in a bank, each with an answer key, and a draft never reaches a candidate.

Lina: A paper sets the rules: time, order, the window, when results appear.

Lina: A register is one sitting, and its pass mark comes from the post.

David: And the standard?

Lina: Graded on the record, and signed by a person.

Lina: And the call is the moment the names come back.

Friday, nine o'clock

Lina: Thursday afternoon. Everything is ready, and there is nothing left to do but wait.

Mei Tan: What if someone's connection drops halfway through?

Elena Novak: Every answer is saved as they give it. They sign in again and carry on.

Lina: And tomorrow we watch them sit it. That is chapter seven.

Lina: Next time, eight people in eight countries sit the paper, and the register marks it.

David: See you in chapter seven.

02Knowledge quiz

5 questions · instant feedback
Question 1 of 5

A test in Quelixa is built in four layers. Which are they?

Unlimited retries. Nothing here counts against you.