Math Software: Intro to Our Collection

Implementation and Monitoring Matter!

Douglas Reeves (2006) reminded us that "the cause of success in improving student achievement is not the brand name of the product but the degree of implementation by the teacher" (p. 78).  Effective monitoring includes "not only frequency but also the specification of the levels of implementation" (p. 78).

Your School Dollars Matter, Too!

Before you commit your school dollars to purchasing any ed-tech, consider the ten tips for How to Avoid Getting Ripped Off by Ed-Tech Vendors by Rob Waldron, an industry leader (2018, Winter).  It's eye-opening with sufficient detail to assist with making decisions.  Briefly:

1. Audit current hardware, software, apps, established practices for their use, any licensing costs.  Include all teaching and administrative staff and curriculum coordinators.
2. Ask what the technology is being "hired" to do.
3. Buy "off the rack."  Customization is generally not necessary and adds to cost.
4. Compare "apples to apples" from about 3-5 vendors.  Ask vendors for data from districts similar to yours in size and makeup.  Beware of free trials.  A full pilot would provide better data.
5. Check references.  Ask for 5-6 references from districts similar in size to yours.
6. Do a real pilot with clear goals, individuals vested in planning and implementing the pilot, sufficient time (about 12 weeks) to gather meaningful data, and a planned conclusion.  Choose vendors that are transparent about their limitations, invest money into the pilot to get better results (e.g. for professional development), and get reflections from stakeholders that distinguish between product feedback and implementation feedback.
7. Look for a vendor who puts  service above product, not just in the sale, but in training, implementation, and ongoing support for the life of the product.
8. "Find creative savings." Ask for discounts; consider collaborative buying with "consortia and cooperatives operated by school districts, state governments, and education service agencies."  Know all costs ahead of time (e.g., licensing, installation, maintenance, IT support, professional development, troubleshooting).
9. Get an "unconditional money-back" satisfaction guarantee from the vendor.
10. Get everyone (i.e., district and school leaders, school board, IT staff, teachers, parents, students, etc.) "on board and well trained with the product."  They need "to understand the product and buy in to shared objectives and expectations."

Waldron concluded by reminding districts to choose vendors who can adapt to change brought on by technology advancements, curriculum requirements, and "new government requirements or guidelines."

Caution: Be wary of claims by ed tech companies about the effectiveness of their products.

Tara Mathewson and Sarah Butrymowicz (2020) of The Hechinger Report cautioned school leaders to be wary of claims by ed tech companies regarding the effectiveness of their products in raising the achievement of learners.  Their claims of "proven" results, based on research, might appear on their websites, in product brochures, or in email pitches.  However, those claims might be based on "shoddy research."  The authors indicated they have found dozens of companies that have promoted their products in this manner.  They illustrated the problem in their discussion of the claims by several companies (e.g., IXL, Matific, SuccessMaker).

Although a product might appear to work in one district, it might not be suitable for use in another.  Districts are encouraged to conduct their own research.  Mathewson and Butrymowicz (2020) listed the following organizations that have begun to assist districts in this endeavor:

• Project Evident
• Results for America: Evidence in Education Lab
• Proving Ground from the Center for Education Policy Research at Harvard University
• E-TRIALS (Ed-Tech Research Infrastructure to Advance Learning Science, formerly known as the ASSISTments Testbed)