LS & T Component Roadmap 3
This Roadmap identifies five key R&D research topics that will significantly increase the validity, efficiency, utility, effectiveness, and widespread use of learner modeling and technology-enabled assessment:
1. Performance Modeling: Mapping and reconciliation of disparate models of domain expertise, competency, and pedagogy into a metatheory of competence.
2. Assessment Object Strategy: Automated modular assessment design, development, delivery, and analysis to support performance models.
3. Learner Models and Methods: Defining multidimensional learner models and measurement
methods to drive specification of automated modular assessment object strategies.
4. Reporting and Data Mining: Reporting, warehousing, mining, and using assessment data to
validate learner models and inferences.
5. Web Services Infrastructure: Web services infrastructure for integration of software applications and services to support learning consumption and production.
In all areas, the emphasis is on developing scalable, integrated, cost-effective software tools and
systems that embody and automate practices and processes supported by theory and research. Those theories, practices and processes must first be articulated precisely enough to support their automation.
The articulated processes can exist first as guidelines, prescriptions, and decision aids, which can be
turned into functional specifications for tools and systems. Once tools and systems are built, studies
can be done to validate the theories, practices and processes they embody.
This R&D roadmap will produce the research results to provide guidelines, tools, and systems that directly relate to both user modeling and assessment in a holistic fashion, so the distinction between understanding the learning process and understanding the learning outcomes are seamlessly integrated.This agenda should enable the learning technology standardsgroups to generate both technical standards and quality standards to create a continuous process improvement model for user modeling and assessment.
New technologies can make learning more productive, compelling, personal and accessible. The big
question is how to structure the field of learning and education from the standpoint of learning
modeling and assessment. How can we move to the next level?
A plan needs to be developed to integrate technological advances in learning. The roadmap is focused on education and training at the level of postsecondary education for science, mathematics, engineering and technology. This includes courses at 2-year and 4-year universities and colleges, as well as lifelong learning
experiences in business, industry, and the government.