In today’s tech-enabled world, education technology isn’t going anywhere. But savvy K-12 educators also realize that tech for tech’s sake doesn’t move the needle on teaching and learning outcomes. That’s why it’s critical to consider the evidence when evaluating edtech tools. The good news? You don’t need research expertise to analyze the evidence base behind edtech solutions–you just need to know what information is key.
Read on to learn about four critical elements of research to watch for and understand — no Ph.D. required.
Is there a Logic Model and/or Theory of Change?
A Logic Model, or Theory of Change, is required to meet the ESSA Level IV standard for evidence. These artifacts clearly define the required inputs (like usage by students) and expected outputs to show how the use of a product, as designed, will lead to positive outcomes. The Logic Model also serves as a practical guide for product users as it outlines the requirements of a strong implementation.
Who conducted the research?
In general, the most reputable research is conducted by 3rd party organizations like research organizations, universities, and independent academics. When reviewing research completed by the company themselves or by researchers without strong credentials, take a closer look - when was the study completed? How many students participated in the study?
What context was the research conducted in?
Understanding the make-up of a test group and the context in which the study was completed will help you to understand what the findings might mean in your organization. Consider if the research was completed with students in the age group you work with. Was the study completed with a sub-group of students or students from general education? Where was the study conducted - a suburban district in the United States or perhaps another country? These questions will help you put findings into context in your product vetting process.
How recent is the research?
EdTech changes quickly! Keep an eye on the date of the research you are reviewing and consider if the product has changed considerably since then. Has the student population or the school system? One pertinent example of this could be research on a digital assessment tool completed pre-Pandemic. The results from that study - with the same group of students in the same schools - could be wildly different in 2021 from the results in 2018.
Building an evidence-based ecosystem takes time, intention, and effort–but the positive impacts on student outcomes make it very much worthwhile. LearnPlatform helps to simplify the process, and our new Evidence Page feature will make it easier than ever to access and understand the complete body of evidence behind individual edtech tools. Learn more about this recent enhancement on LearnPlatform’s Product Blog inside the Instructure Community, or check out our Playbook on Addressing Edtech Challenges with Evidence.
Related Content
columbus_city_schools_1.pngBlog Articles
![We can see their usage, but we want to know [which education tools] teachers feel are helpful in their environment.](/sites/default/files/styles/medium/public/image/2023-06/User%20Group%20Recap.png?itok=_3svfNBb)
User Group Recap.pngBlog Articles
facommons.pngBlog Articles