Except where otherwise noted, content on this website is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Why use online assessment?
[wpb-fmc-floating-menu]
Methods and implementation ideas
[wpb-fmc-floating-menu]
Objective vs Subjective question types
Before you start using online assessment, it is important to consider what you want to achieve with the assessment. This will help you choose the tools and methods that will help you to achieve your assessment goals. A common misconception about online assessment is that your test will be automatically graded. Reducing marking time is also the most common incentive for starting to use online assessment. The fact is that only some question types are marked automatically by an online assessment platform such as an LMS. This is where objective vs subjective questioning plays an important role. The difference between these two question types are:
Objective question types require students to select a response from a list of alternatives provided to them or to supply a word or short phrase. Only one correct answer is identified. Subjective question types allows a student to organise an original answer, using their own words. These answers are usually longer (such as a paragraph or a couple of sentences).
Therefore, if the purpose for using online assessment is to reduce marking time and to have an online assessment program mark for you, you need to make use of objective question types. Subjective question types are not marked automatically by any platform. You will always need to mark subjective question types yourself, usually the marking can be alleviated by creating a rubric.
Objective question types
The most well-known and commonly used objective question type, is a multiple choice question which is a question with a number of options of which a student must select the correct or most correct option. There are, however, typically many other objective question types available to use on an online assessment platform such as Respondus or an LMS, which allow you to use a wide spectrum of different types of questioning in your test. In addition, online assessment provides several options for multiple choice questions that are not necessarily practical or feasible in a written format. All of the objective question types shown in this section will be automatically marked.
Multiple choice questions (MCQ)
A simple example of a multiple choice question is the following:
You can do more with a MCQ online, however. For instance, consider using an image as part of the question, or a short video or audio clip (see examples here). Multiple choice questions can also be developed to test higher-order thinking.
Multiple response questions
A multiple response question is similar to a multiple choice question but instead of having to choose one option from a list, a student is required to choose more than one of the options. A simple example of a multiple response question is the following:
As with a MCQ, you can incorporate images, videos or audio clips as part of your multiple response questions.
Matching questions
Matching questions are similar to match the column questions sometimes also used in written assessments. A simple example of a matching question is the following:
Match the capital cities in the column on the left, to the countries in the column on the right:
A matching question can be more difficult if there are some extra options in one column that do not have a match in the other column, such as in the following example:
Match the capital cities in the column on the left, to the countries in the column on the right:
In addition, matching questions do not only have to be questions with single words in each column. Instead, a single word or phrase can be used in one column to describe an explanation or description in another column. Another option is using images in one column and short descriptions in the other column. Matching questions are often used to test not only knowledge recall but also application of knowledge. Here are some examples of different types of matching questions. It is important to note that the assessment program (both Blackboard and Questionmark) automatically shuffles one of the two columns so that each students who completes an assessment sees a different order.
Ranking question
A ranking question requires a student to rank steps of a process or order of events in the correct sequence. An example of a simple ranking question is:
Select the correct order of the following significant events in world history:
Ranking question
A ranking question requires a student to rank steps of a process or order of events in the correct sequence. An example of a simple ranking question is:
Select the correct order of the following significant events in world history:
Instead of one or two words, a short phrase or paragraph can also be used in the left column of a ranking question (to describe a step in a process for instance) in order to make the question more complex. It is important to note that the assessment program (both Blackboard and Questionmark) automatically shuffles the column on the left so that each students who completes an assessment sees a different order.
Select a blank question
A select a blank question is a longer question, usually in a paragraph format, with multiple answers. This question type is not commonly available on all online assessment platforms, but it is available on Questionmark, for example. An example of a simple select a blank question is:
Human Resources Management consists of various processes within an organisation. The process aimed at attracting applicants that match job criteria is known as [Recruitment/ Selection/ Hiring/ Remuneration Management/ Training and Development/ Performance Management/ Employee relations]. The aim of [Recruitment/ Selection/ Performance Management/ Remuneration Management/ Employee Relations] is to evaluate performance in order to reward good performance and address poor performance. [Recruitment/ Selection/ Hiring/ Remuneration Management/ Training and Development/ Performance Management/ Employee relations] is the process that involves determining salaries, incentives, and fringe benefits.
With this question students are provided with a list of possible answers for each ‘blank space’ in the question. This is an alternative to the better-known fill in the blank question. The advantage of this question, however, is that grading the correct answer is not influenced by incorrect spelling or synonyms of the correct answer. With a fill in the blank question students can easily make a spelling or typing error and will then not receive a mark as the system only recognises key words as identified by the lecturer as correct answers. Students also sometimes use synonyms for the identified key words, which is also not recognised by the system. The select a blank question eliminates these potential issues when a list of potential options is provided for each blank space in the question.
Hotspot question
A hotspot question allows a student to click somewhere on an image to indicate an answer. The system automatically gives a mark if the student clicks within a predetermined area but receives a zero if he/she clicks outside of this area. An example of a hotspot question is:
Refer to the image of a heart below. Click on the aorta:
1
Students who clicks anywhere in the green marked area will receive a mark and students who click outside of the area will receive zero. Students do not see the green marked area as part of the question, the image in the example above is to illustrate how the question is set up on the system (Blackboard/ Questionmark). As the example illustrates, this question type works well in modules where students need to visually be able to distinguish between certain areas such as in Physiology or Biology. However, it can also be used creatively in other types of modules as in these examples. It is important to note that this question type should be used with caution if you have students in your class who are visually impaired as the software on their computers will typically not read an image.
Drag and drop question
Drag and drop questions allow a student to drag and drop a number of labels to appropriate spaces on an image. A student can either get a single mark for placing all the labels at the correct spaces on the image or can get a mark for each label placed correctly. A simple example of a drag and drop question is:
Drag and drop the labels at the bottom of the image to the corresponding countries on the image. Place the label anywhere on its corresponding country:
[h5p id=”1″]
Students do not see the colour-coded marked areas as part of the question, the image and labels in the example above is to illustrate how the question is set up on the system. Drag and drop questions also work well for an image of text such as matching a step in a process with a description. It is important to note that the labels at the bottom of a drag and drop questions should be short (preferably one or two words) as it must fit in next to each other at the bottom of the image. This question type should be used with caution if you have students in your class who are visually impaired as the software on their computers typically cannot read an image. This question type is not commonly available on all online assessment platforms but it is available on Questionmark.
[wpb-fmc-floating-menu]
Feedback to students
[wpb-fmc-floating-menu]
Using assessment results effectively
[wpb-fmc-floating-menu]
Considerations and challenges in the SA context
[wpb-fmc-floating-menu]
Further reading and other resources
[wpb-fmc-floating-menu]