Free Tool Helps Schools Do Quick Impact Studies of Ed Tech Usage

Free Tool Helps Schools Do Quick Impact Studies of Ed Tech Usage 

A new, free online tool is expected to help school administrators perform "quick, low-cost evaluations" to make better decisions about educational technologies. "Rapid-Cycle Evaluation (RCE) Coach" is the creation of Mathematica Policy Research and the Office of Educational Technology at the U.S. Department of Education.

RCE is a scientific approach promoted by Mathematica as an alternative to traditional program evaluation. The goal is to help schools conduct "high-quality, low-cost, quick-turnaround, policy-relevant studies."

According to Alexandra Resch, associate director of Mathematica's human services research, the RCE Coach can help district decision makers evaluate ed tech use in the classroom to determine whether it caused its intended improvement, the impact of the change, and who was affected.

RCE Coach 

The tool helps the user through five steps:

  1. Choosing the best approach for evaluating a technology;
  2. Designing an evaluation based on what outcomes are of interest;
  3. Setting up the data to create two groups -- a technology user group and a comparison group;
  4. Generating results for analysis; and
  5. Compiling the results into a report or presentation.

After following those five steps, the user can get insight on five questions:

  • How to set up a meaningful pilot of new ed tech;
  • Whether a new program led to the desired outcomes; and
  • Whether the school system should continue paying for a software tool it's already using.

A beta version of the Ed Tech RCE Coach was launched last year for school districts and researchers to test and provide feedback on the tool's usability and functionality. Comments from these users guided the utility's development, which is expected to continue being updated in the future with additional tools.

More information about the tool, as well as the registration link, is on the Ed Tech RCE website here.

About the Author

Dian Schaffhauser is a former senior contributing editor for 1105 Media's education publications THE Journal, Campus Technology and Spaces4Learning.

Featured

  • digital graph

    Building Genuinely Data-Informed School Districts

    Schools today generate enormous amounts of data. The difference between collecting it and using it effectively often comes down to quality, access, and context.

  • Neon blue security locks with a single red highlight

    With AI, Cybersecurity Focus Shifts from Finding Flaws to Fixing Them

    For decades, one of cybersecurity's biggest challenges has been finding vulnerabilities before attackers do. A growing number of security professionals now say artificial intelligence is changing that equation, shifting the focus from discovering flaws to fixing them quickly enough to prevent exploitation.

  • Top View Shot in Elementary School Computer Science Classroom

    Education's Top 5 Technology Priorities and the Challenges Standing in the Way

    Cybersecurity ranks as the No. 1 priority for education technology leaders in the United States, according to the latest State of Ed Tech report from CoSN, yet insufficient cybersecurity staffing and the lack of a dedicated budget are key barriers.

  • Engineering team implements digital guardrails on AI

    3 Starting Points for Integrating AI Guardrails in K-12 Districts

    As education leaders start to craft an AI policy that is both practical and flexible enough to evolve with this fast-changing technology, there is at least one principle that should be foundational: AI should serve to augment human critical thinking and creativity but never replace human interaction and decision-making.