Much of the power of ALEKS comes from its capacity for accurately
and efficiently assessing the current state of a learner's knowledge.
What is an ALEKS assessment (knowledge check)?
[Chapter 4]
An assessment by the ALEKS system consists of a sequence of
mathematical problems posed to the student. The answers are in the form
of mathematical expressions and constructions produced by the system's
input tools (no multiple choice). The student can answer "I don't know" where necessary.
During an ALEKS assessment, the student is not told whether answers
are correct or incorrect. The assessment is adaptive. Each question
after the first is chosen on the basis of answers previously submitted.
Assessment problems (like practice problems) are algorithmically
generated, with random
numerical values. The length of the assessment is variable, between 15
and 35 questions. There are no time constraints, but some assessments
can take less than a half-hour and a few more than an hour and a half.
Students taking an assessment need to have paper and pencil. The ALEKS calculator
button will become active when use of a calculator is permitted.
No help whatsoever should be given to students taking a knowledge check,
not even rephrasing problems. Outside help can easily lead to false
assessment results and hinder subsequent work in the ALEKS Learning
Mode.
Students may be assessed when they first register with ALEKS.
It is advisable that all assessments from which the instructor uses
data for grading or a similar purpose take place under the instructor's
supervision. At a minimum, the Initial Assessment should be supervised.
How does the ALEKS assessment work?
[Sec. 9.2.5]
In assessing a student's knowledge, the system is in fact determining
which of the feasible knowledge states for that subject correspond
to the student's current knowledge. The assessment is probabilistic,
so it is not fooled by odd careless errors. (Lucky guesses are very
rare, because multiple
choice answers are not used.) Likelihood values (values for the likelihood that
the student is in a particular knowledge state) are spread out over
the states belonging to the structure. With each correct answer, the
likelihood of states containing the item for which a correct answer
was given is raised and that of states not containing the item lowered.
The reverse occurs for incorrect answers or "I don't know." At each
step of the assessment, the system attempts to choose an item for which
it estimates, based on current likelihood values, that the student has
about a fifty-fifty chance of success; such questions are maximally
informative. When the likelihood values of a few states are extremely
high and those of all the rest are extremely low---in technical terms,
when the entropy of the structure is lower than a
certain threshold value---the assessment ends and results are produced.
If a student makes a careless error or lucky guess, this will appear
inconsistent with the general tendency of the student's responses,
and the system will "probe" that area of knowledge until it is sure.
For this reason, inconsistent assessments may require more questions.
ALEKS® is a registered trademark of ALEKS Corporation.