The Same-Year Study.
Treatment and Comparison,
Done Right.
Earning ESSA Tier II (Moderate Evidence) requires more than showing students improved — it requires showing they improved relative to similar students who didn’t use your product, in the same school year. A real-time quasi-experimental study is the gold standard for that claim. It also gives you something no retrospective study can: the ability to shape implementation while the research is running.
Moderate Evidence.
The most credible claim most edtech companies can make.
ESSA Tier II is the evidence tier that most procurement committees treat as a meaningful differentiator — strong enough to carry weight with state reviewers, distinct enough from basic pre-post growth data. A real-time QED is the most rigorous path to it: concurrent treatment and comparison groups studied in the same year, with the same assessments, under the same conditions.
ESSA Moderate Evidence
Approved on the Evidence for ESSA (Johns Hopkins) national list, recognized by state and district procurement panels.
Evidence for ESSA Eligible
Concurrent comparison group designs qualify for submission to the most rigorous independent review body in K–12 edtech.
Digital Promise + EduEvidence
LXD Research manages submission and certification to both third-party platforms as part of every engagement.
The Evidence Journey: From Look Back to Real-Time
For many edtech companies, a real-time Tier II study follows a Look Back Study. A Look Back gives you a first credential quickly — analyzing historical data to earn Tier II or Tier III recognition and demonstrate that your product has a track record worth examining further. Once that foundation is in place, a real-time study builds on it by answering the stronger question: not just “did students improve when they used this?” but “did they improve more than comparable students who didn’t, studied in the same year, under the same conditions?”
Both study types can reach Tier II, but they are not equivalent in the eyes of Evidence for ESSA reviewers. A Look Back comparison group is assembled from whatever historical data exists — which means baseline equivalence between groups is approximated after the fact. In a real-time study, we design the comparison group before a single student is assessed. Treatment and comparison schools are matched at the outset, their demographic and achievement profiles confirmed in advance, and both groups assessed with the same instruments on the same timeline. That prospective design is exactly what the most rigorous reviewers — and the most sophisticated district procurement panels — are looking for.
The Study Design
At its core, a real-time quasi-experimental study asks one question: did students using your product gain more than comparable students who weren’t — in the same year, on the same measures? The design is built around answering that question as credibly as possible.
Treatment Group
Schools / classrooms implementing your product. Pre-assessment at the start of the year, post-assessment at the end.
Comparison Group
Matched schools / classrooms not using your product. Same assessments, same calendar, same district where possible.
Both groups are assessed at the same two time points. The analysis measures whether treatment students gained more — and by how much. Effect sizes and significance tests determine whether the difference is meaningful and real.
The comparison group is the study’s backbone. Recruiting and retaining the right comparison schools — similar in demographics, prior achievement, and instructional context — is what separates a study that clears Evidence for ESSA review from one that doesn’t. LXD Research manages this entire process.
Four Things a Real-Time Study Does That Retrospective Can’t
Both study types can reach Tier II. But a real-time design consistently produces cleaner evidence — and it gives you something far more valuable than a credential.
Prospective Comparison Matching
We identify and confirm comparison schools before the study begins — not after, when the available options are whatever data happened to be collected. This produces the clean baseline equivalence Evidence for ESSA reviewers require.
Active Implementation Support
Because we’re working with schools in real time, we can identify implementation problems early and help administrators address them — protecting both study integrity and product outcomes. Retrospective designs see none of this.
Administrator Relationship Building
The district partnerships formed during a real-time study often outlast the research itself. Schools that participated become references, case study partners, and in some cases, long-term customers of your product.
Concurrent Data on Both Groups
Treatment and comparison schools are assessed at the same moments in the school year, with identical instruments. Year-to-year conditions — testing schedule shifts, school disruptions, curriculum changes — don’t create noise between groups.
We Interview and Survey Both Groups — and We’re There All Year.
One of the features that makes a real-time study so methodologically valuable — and so useful for your company beyond the credential — is that our qualitative data collection covers both the treatment and comparison groups. We conduct structured administrator interviews with leaders in treatment and comparison schools, and deploy educator surveys to teachers on both sides. This isn’t just methodological thoroughness: it’s what allows us to understand not just whether your product made a difference, but what conditions shaped that difference.
Comparison school interviews reveal what “business as usual” actually looks like — what other tools and approaches those schools were using, what their professional development context was, and what their administrators prioritized. That context makes your study’s findings more credible and more interpretable. When a reviewer or a district buyer asks “what was the comparison group doing instead?”, this study can answer that question in detail, where most retrospective designs can’t.
Administrator support in treatment schools goes beyond data collection. When teachers encounter adoption friction, when implementation varies across classrooms, when administrators need guidance on fidelity — we’re there. Schools where your product is used with integrity produce cleaner, stronger results and are far more likely to renew and advocate afterward.
Research integrity and real-world outcomes are not in tension here. Supporting treatment administrators to implement well, and understanding comparison administrators deeply, are exactly what the study requires — and what distinguishes a real-time engagement from a passive data collection exercise.
The Mid-Year Report: Results in Hand for Spring Sales Season
Because we’re embedded in the study throughout the school year, we can deliver a mid-year findings report — typically in late winter or early spring — before end-of-year assessment data is complete. This report draws on interim assessment data, administrator interview findings, and educator survey results from both treatment and comparison groups. It’s not the final study, but it’s substantive: real findings, in your hands, while your sales team is in the thick of spring conversations.
The edtech sales cycle runs on spring. Districts making purchasing decisions in March and April don’t always want to wait until August for a study report — and with a mid-year deliverable, they don’t have to. Your sales team can enter those conversations with data on how implementation is going, what administrators in both your treatment and comparison schools are experiencing, and early indications of student progress. That’s a different kind of sales tool than a finalized study report sitting in a PDF.
Interim assessment trends, administrator interview themes from both groups, educator survey findings, and implementation quality observations.
Typically January–March, timed to your spring sales cycle. We work backward from when your team needs it.
Shared in district conversations, conference presentations, and RFP responses while the final study is still completing.
Study Deliverables
Every Real-Time ESSA Tier II Study includes a complete package — from district recruitment through publication and certification submission.
Study Design and IRB-Aligned Protocol
We develop the full study design before the school year begins — comparison group criteria, assessment schedule, data sharing agreements, and analysis plan. The design is built to meet Evidence for ESSA’s methodological standards from day one.
District Recruitment and Partnership Management
We identify and recruit both treatment and comparison schools, negotiate data sharing agreements, and manage the district relationship throughout the study. You don’t need to manage the school partnership — we do.
Administrator Interviews — Treatment and Comparison Schools
We conduct structured interviews with administrators in both treatment and comparison schools. Treatment interviews capture implementation quality, fidelity, and adoption dynamics. Comparison interviews document what “business as usual” actually looks like — what other tools were in use, what priorities shaped instruction, and what conditions comparison students were learning in. Both sets of findings appear in the final report and give reviewers the contextual depth that makes a study’s conclusions defensible.
Educator Surveys — Treatment and Comparison Schools
Teachers in both groups complete surveys that capture their instructional context, perceptions of student progress, and professional development experience. Comparison teacher data provides a baseline for what educators experience in similar schools without your product. If your company already has an educator survey instrument, we incorporate it. If not, we develop one. The combined dataset strengthens the study narrative and produces sales collateral that speaks to teacher experience alongside student outcomes.
Mid-Year Findings Report
Delivered in late winter or early spring — before end-of-year assessment data is complete — the mid-year report summarizes interim assessment trends, administrator interview themes from both groups, and educator survey findings. It is not the final study, but it is substantive research in hand when your sales team needs it most: during spring district conversations, conference season, and RFP cycles. We time delivery to your sales calendar.
Quasi-Experimental Data Analysis
Rigorous statistical analysis of pre- and post-assessment data — effect sizes, significance testing, subgroup breakdowns, and matching or propensity score procedures where applicable. Analysis is designed specifically to meet Evidence for ESSA review criteria.
Academic Research Report
A peer-review-ready study report with full methodology, results, discussion, and limitations — written to the standards of Evidence for ESSA, What Works Clearinghouse, and state-level review bodies. This is the document submitted to review platforms and cited in RFP responses.
Research Summary (Co-Branded)
An educator-friendly executive summary that distills the study’s key findings into a format your sales team can hand to a district leader. Co-branded with your product identity, designed to stand alone without the full report.
Publication and Indexing
Your completed study is submitted to ERIC and indexed on ResearchGate — making it publicly discoverable by district leaders, state reviewers, and procurement teams searching for evidence.
Evidence for ESSA Submission and Certification
LXD Research manages the submission process to Evidence for ESSA (Johns Hopkins), EduEvidence, and Digital Promise — so your study arrives certified, indexed, and ready for state submission without additional coordination on your part.
How a Real-Time Study Unfolds
A real-time study requires a longer runway than a retrospective one — but most of that time is productive. Design, recruitment, and administrator onboarding happen before the school year begins, so the research team is positioned to support implementation from the first day of the study.
Study Design, Protocol Development, and IRB Alignment
We finalize the study design, develop the analysis plan, and draft all instruments — assessments, surveys, interview guides, and data agreements. The comparison group criteria are defined before recruitment begins.
District and School Recruitment
We identify treatment and comparison schools, confirm demographic and prior-achievement match, negotiate data sharing agreements, and onboard administrators. Recruitment can run in parallel with design and is often the longest phase.
Data Collection, Interviews, Surveys, and Mid-Year Report
Pre-assessments are collected at the start of the study period. Throughout the year, we conduct administrator interviews and educator surveys with both treatment and comparison groups, monitor implementation, and flag fidelity issues in treatment schools. In late winter or early spring, we deliver the mid-year findings report — so your sales team has substantive data during the spring buying season, before end-of-year assessments are complete. Post-assessments are collected at year’s end.
Quantitative Analysis and Report Drafting
Once post-assessment data arrives, we conduct the full statistical analysis — matching, effect size calculation, significance testing, and subgroup analysis — and draft the research report and educator summary.
Report Delivery, Publication, and Certification Submission
Finalized reports are delivered, submitted to ERIC and ResearchGate for indexing, and submitted to Evidence for ESSA, EduEvidence, and Digital Promise for certification review.
Real-Time Tier II Studies from Our Portfolio
These are real-time quasi-experimental studies LXD Research has conducted for edtech clients — concurrent treatment and comparison groups, rigorous matching, and Evidence for ESSA approval.
95 Percent Group — 95 Phonics Core Program
A prospective quasi-experimental study comparing students in classrooms using 95 Phonics Core Program to matched comparison students in the same districts. Two separate studies are approved on the Evidence for ESSA national list, with results holding across multiple sites and demographic groups. The research partnership has led to seven total Evidence for ESSA approvals across 95 Percent Group’s product portfolio.
Scholastic RISE and RISE Up
A multi-site quasi-experimental study examining Tier 2 instructional outcomes for students in grades 1–5. The study compared students receiving RISE instruction to matched comparison students across multiple districts, earning Moderate Evidence approval on the Evidence for ESSA list — a credential that has supported Scholastic’s state approval and district procurement conversations.
engage2learn — growelab
What began as a Look Back Study was elevated to a real-time design when engage2learn pursued Tier I evidence. The real-time phase followed middle school students in math and science with concurrent comparison schools — ultimately yielding two Evidence for ESSA approvals that moved the product’s status from Promising to Moderate Evidence and opened new state procurement pathways.
The firm that has produced more ESSA-approved studies than any other independent research organization.
Running a credible real-time study requires more than methodological expertise — it requires the relationships, systems, and track record to recruit schools that stay in the study, collect data that holds up to reviewer scrutiny, and navigate the Evidence for ESSA submission process without surprises. We work exclusively with edtech companies, which means we understand the data systems districts use, the implementation realities of edtech products, and exactly what procurement committees and state review panels are looking for when they evaluate evidence. We design studies for buyers and reviewers — not academic journals.
“Our Real-Time Efficacy Studies helped us gain the ability to be on those required state lists and participate in many more RFPs, giving us a competitive differentiation.”
“Our Real-Time Efficacy Studies helped us gain state-level partnerships where they are seeing the impact that educator support has on teacher retention and student growth.”
“LXD Research has provided us invaluable consultation surrounding research strategy and partnered with districts to conduct rigorous ESSA studies that secured our products on coveted state lists.”
A Real-Time Tier II Study is the natural next step after a Look Back Study — when you’ve established an initial evidence base and are ready to pursue a stronger, prospective design with a concurrent comparison group. If you haven’t yet run a Look Back, that may be the right starting point: faster to complete and still capable of reaching Tier II. And if your goal is the highest possible evidence tier, a Real-Time Tier I Study (randomized controlled trial) is the logical step beyond this one.
← Start with a Look Back StudyThe researcher who has navigated more ESSA approvals than any other independent firm.
Dr. Rachel Schechter founded LXD Research after serving as Director of Research at Lexia Learning, where she built a 12-member research department and a portfolio of What Works Clearinghouse-aligned studies. LXD Research has produced more studies approved by Johns Hopkins’ Evidence for ESSA than any other independent research organization.
She has led real-time efficacy studies for edtech companies across literacy, math, professional development, and formative assessment — designing quasi-experimental studies from the ground up, managing district partnerships through the full school year, and navigating Evidence for ESSA review for studies that have gone on to support state approvals across the country.
Build the comparison that makes
your evidence stand up.
Schedule a free consultation to assess whether a real-time Tier II study is the right fit — and what recruitment, timeline, and investment look like for your specific situation.