In this second blog in the series, we explain how to develop and represent a validity argument. We use a validity argument for the interpretation of scores from the AP History test to illustrate using graphs and outlines to represent a validity argument and assume teachers are the intended audience. This blog is a bitContinue reading “Effectively Developing a Validity Argument“
This is the first in a series of six blogs as a tutorial to help practitioners in educational measurement develop, represent, and effectively communicate validity arguments to stakeholder audiences. This first blog explains how to address stakeholder concerns when developing and communicating your validity argument. Before planning how to develop and effectively communicate a validity argumentContinue reading “Addressing Stakeholder Concerns in a Validity Argument“
We, Michelle and Paul, are partnering to offer a tutorial as a series of six blogs—a new blog posted every week starting Tuesday, September 14, 2021—to help practitioners in educational measurement develop, represent, and effectively communicate validity arguments to stakeholder audiences. A validity argument is a valuable tool, as it can build the foundation forContinue reading “How to Effectively Represent and Communicate a Validity Argument“
Planful Learning and Assessment is looking for a Data Scientist for a contract position. Our candidate will be collaborating with a small team with learning science, psychometric, design, and business expertise supporting development of the Phenomenation app.
When assessing complex, multidimensional standards like Common Core Mathematics and Next Generation Science Standards (NGSS), how can you cut costs of assessments, increase the quality of the assessment results, while improving convenience for states and districts? My answer is based on understanding the assessment industry is experiencing a strategic inflection point—fundamental changes in the businessContinue reading “Challenging Old Assessment Development in a New Assessment World”
Are you wondering how to respond to what seems to be an inflection point for the assessment industry? Nearly 20 years ago, Sam Messick and Bob Mislevy and colleagues were wondering the same thing. They were anticipating an inflection point in the assessment industry—fundamental changes in the business environment that challenged conventional test development. TheContinue reading “A Principled Response to Our Inflection Point”
A few years ago, I created The Innovation Factory to support learning and assessment organizations in turning good ideas into impactful innovations as measured by revenues, margin, and/or positive change in the lives of the individuals and communities. The Innovation Factory is a framework and a set of tools and processes to support organizations inContinue reading “Many a Slip ‘Twixt Invention and Innovation”