Question settings

You can make settings related to the questions in the tests that you create, in this section.

Shuffling questions

Use this option to shuffle the order of questions in a test.

Important: This is different from randomizing questions in a test using the question pooling feature.

When you make this setting, it applies to all the questions in the test. It will not have an impact on the options of the MCQs in your test.

Cut off scores

Use this option to set a recommendation score, will act as an indication for you when you are filtering candidates who have taken a specific test. 

For example, if you set the cut off score at 90, you can manually filter the scores in the candidate report. This will give you a more realistic number of candidates who you can further evaluate and interview.

Helping candidates debug better

Use the Show runtime error to candidates and Show hints when candidate's output is wrong options that are introduced to help candidates debug their code more effectively.

Runtime errors

Note: These errors are applicable to programming problems only and will be displayed for the following languages only: C, C++, Java, Python, and Python 3.

These include errors that occur when:

• Invalid mathematical operations are executed, for example, when the candidate tries to divide a number by zero, calculate the square root of a negative number etc.
• Programs crash because of a segmentation fault, for example, an out-of-scope array index causes a buffer overflow, incorrectly initialized pointers, etc.
• Candidate's program has printed more than the maximum limit of data to the standard output

Output errors

These include errors that occur when the output has:

• Only one line but the correct output requires more than one line.
• Non-numeric characters, whereas the correct output requires only numeric characters.
• Negative numbers, whereas the correct output requires only positive numbers.
• Extra empty lines because of printing more new lines '\\n' than expected.
• Intermediate spaces

For more information about the errors that are displayed for candidates, see Types of errors.