April 2004 — Industry Perspective
Print this article | Email this articleClick here to receive your FREE subscription to T.H.E. Journal
The Coming of the Intelligence Age: Enhancing Education Through Assessment
Intelligent Systems
So, where does intelligence come into play? I suggest that these are potentially intelligent systems because they can perform logical and analytical tasks faster than we can, and with fewer mistakes. Scoring tests is an easy and very useful application of this technology. Educators might say that there is no replacement for paper-based tests wherein students show their work; I agree.
For this reason, I still believe that paper-based tests have a place interspersed throughout periodic computer-based assessment. In these tests, students can show their work, which may be analyzed by hand to detect, for example, errors in the intermediate steps to solving a math problem. This is a very valuable tool. Having said this, there are companies bringing systems to market that fairly accurately score essays by computer — the intelligence is building.
Yet, these intelligent systems can be set up to do much more. In research completed in 2001, I was able to demonstrate that pretty simple interactions between students and computers could capture impressive amounts of cognitive data about a student's capabilities. In our study, we collected behavior data that could be used to understand students' cognitive or multimodal skills beyond mastery of the standards-based skills that were being tested. We detected metacognitive traits — an important cognitive skill — and whether students responded differently to images or sounds (if they were available) than to text or complex sentences. In addition, we timed almost every interaction the student had with the computer to ask questions like: 'Did they spend more time on word problems?' or 'Are there specific words that they had problems comprehending?'
Because of the study's outcomes, we attempt to capture this rich data at every turn in our Assessa line of products — from our Web-based ASP model system to our free, customizable, public source assessment system that can be used on school intranets. Even our Palm and Pocket PC/.NET handheld systems, which beam small quizzes or group participation games back-and-forth between the handheld and a teacher's computer, have this capability.
The Power of Data Collection
Once the student data is collected, it can be used in connection with other data. An intelligent system can actually gather and analyze this data to predict individual and group performance on future standards-based tests. As the data is added to a central data store, educators can track student progress over time. So, instead of one teacher passing on handwritten cards or notes about students to the next grade teacher at the end of the year, these systems enable teachers to look at a student's progress historically, taking advantage of comprehensive characteristics and details that will enable individualized instruction going forward. What amazes me about the ability to collect this data is that the assessment vehicle is noninvasive.
In addition, it's important to remember that personal interaction is so vital to a student's behavioral and cognitive development. I've embraced the intrapersonal aspects of the classroom, as I have never been an advocate of students sitting in front of PCs for hours on end.
