Reliability of the test

The reliability of a test can be defined as the measure of how consistent your test is in measuring a candidate's technical skills accurately. If a test is reliable, it has good questions, making it a good assessment to test candidates' skills.

To calculate the reliability of a test, the following conditions should be fulfilled:

• A minimum of 50 candidates should have taken the test
• A minimum of 10 questions should be in the test

What makes a question good?

A question in a test becomes a good question when it accurately assesses a candidate's technical skills. For example, a good question contains proper language and implementation of the concept the question is based on.

What makes a question bad?

The following things make a question bad:

1. The content of the question is not proper or clear. This includes the following: 
• The language of the question might be confusing. 
• The test cases of the question might not be clear.
• The code stubs might be wrong.
• There might be some missing libraries or dependencies in the question.
2. The test is too difficult for the candidates.
3. The test questions and the candidates' skills do not match, which means that the candidates do not have the skills to solve the questions asked in the test.
4. The test is taken by too few candidates.

It is recommended to delete or hide such questions from the test.