There are many obstacles to effective student modeling, in this article, the authors address three. A student modeling system should: (a) analyze data in a statistically sound, defensible manner, (b) augment data on a person's performance while they work with data from other tasks, and (c) provide assessments at multiple grain sizes. The authors present OLAE, a computer assistant to a human assessor that collects data about problem solving in elementary physics, analyzes that data with sound, probabilistic methods, and flexibly presents the results of analysis.
For a postscript version of the paper, click here .
Note: This paper won the "best paper" prize of the conference.