When is a Question a Good Question?

Types of questions and tips for writing good ones.

During a reinforcement course, we like to gather as much data as possible. This provides organizations with enough information to analyze their training, provide feedback to participants, and guide overall success.

This valuable data starts by constructing good questions.

As a leader, you're ultimately responsible for proper analysis of training results that drive continuous improvement. You can read a variety of books regarding surveys and questions, but we'll focus on multiple-choice questions in this article.

Multiple choice questions are best suited for measuring the knowledge level in an organization. The participant’s answer is either right or wrong, allowing you to make better decisions when analyzing your training reinforcement data.

Five Types of Multiple Choice Questions

1. Standard Questions
The standard type of closed question is where the number of answers can vary from three to six. The answers are listed in alphabetical order if they're written as text or statements and ordered from lowest to highest if the answers are using numbers.

2. Statement Questions
This is a question with two statements. This is a type of proposition question. It's a difficult type both to construct and to respond to. You present the participant with two statements and the participant selects an answer where they connect the statements.

Example

  • Statement 1: There's a link between salt intake and the level of blood pressure.
  • Statement 2: People with high blood pressure are advised to eat lots of salty peanuts.

Question: What applies to these statements?

A: 1 and 2 are correct
B: Only 1 is correct
C: Only 2 is correct
D: 1 and 2 are not correct

In this type of question, it's very important to create a relationship between statements one and two.

3. Rearrangement Questions
In this question type, the material is constructed according to certain principles of order. The participant in the reinforcement course must demonstrate that they can handle these relevant planning principles adequately.

Example
Below are six random historical events. Four of them are related.

  • The attack on Pearl Harbor
  • The occupation of the Ruhr Area
  • The reparations
  • The Battle of Stalingrad
  • The Locarno Treaty
  • The Treaty of Versailles

Question: Which four events belong together and are in chronological order?

A. 1-2-5-3
B. 1-4-5-6
C. 2-1-4-5
D. 2-1-5-3

This type of question can only be used when there's data that can be put in chronological order.

4. Combination Questions
This is a demand type of question, which is similar to the rearrangement question. In this case, the data in one row should be combined with those in the other row.

Example
Below are the names of some animals.

A. Bear
B. Donkey
C. Dog
D. Cat
E. Lion
F. Pig

Question: Complete the following sentences with one of the animals. An animal can occur more than once.

A. As sick as a…
B. As strong as a…
C. As faithful as a…
D. As dumb as a…

5. True or False Questions
This question type differs from the standard closed question as a statement or claim is made and the answer is either true or false.

Take caution when using true or false. Research shows this type of question may not provide reliable data for two reasons:

  1. It's difficult to construct an answer that all participants in a reinforcement course will accept as completely true.
  2. Presenting a false statement is an unusual action in reinforcement, where training is being associated in general with transferring facts and probabilities.

When constructing this type of question, it’s important to understand that a closed type of question is a question type, in which the correct answer is being given in addition to a number of incorrect responses.

After reading the introduction and question the participant has two possibilities:

  • The participant will formulate the correct answer for themselves by looking at the alternatives and then answering correctly.
  • The participant will indicate the correct answer based on the given alternatives.

It's preferable to formulate the question positively. Always show any negatively formulated questions clearly by capitalizing, italicizing, underlining, or another way to visually cue the participant. This way it's obvious the question is formulated negatively. Determining the correct answer is more difficult if the question is formulated negatively.

6 Tips for Creating Great Multiple Choice Questions

  1. When formulating alternatives, start by writing down the best answers first
  2. Use learning difficulties and common errors made by participants as distractors
  3. Use only those distractors you expect that participants will actually choose
  4. Formulate positive questions
  5. Highlight a negatively formulated question by underlining or italicizing the negative element
  6. Formulate direct questions