DCMP Includes AI Scene Description Tool for Students with Visual Disabilities

  • By Kate Lucariello
  • 04/23/24

The federally funded Described and Captioned Media Program (DCMP) has developed an "AI Scene Description Tool" add-on to its video player to increase accessibility to video content for blind students and those with a low vision disability. The tool is live and is currently in beta testing.

The tool uses artificial intelligence (AI) to "describe the visual elements of any frame within a paused video," the organization said.

This tool, a supplement to the program rather than a replacement ("DCMP will continue to produce audio description with talented writers and voicers," the organization said) creates a secondary audio track that describes visual information in an educational video. The student presses the "AI Scene Description" button to pause a video and ask detailed questions of the AI. Any paused scene is described via text-to-speech and transcribed.

This is especially helpful when there is "'quiet time' in a video, where the additional narration is inserted," DCMP added.

AI-generated scene descriptions rely "strongly on human-created metadata for each video," DCMP said, and "guardrails" are in place to keep AI responses "contextual to the video" using grade-appropriate vocabulary, educational standards, captions, and audio description. Students cannot have a conversation with the AI. User data is protected and never sent to the AI model, the organization said.

The DCMP program is available with free registration to any teacher or family with at least one early learner through Grade 12 disabled student. Each video has a "Provide Beta Feedback" button to share insights on how it's working for learners.

Teachers or students log in at dcmp.org and select the "beta AI Scene Description button under any video. Teachers give access to students by going to "Account > Students," and selecting "Allow students to use AI Scene Description."

DCMP is funded by the U.S. Department of Education under its Office of Special Education Programs (OSEP), and administered by the nonprofit National Association of the Deaf (NAD).

Visit the DCMP registration page to apply for a free membership and get access to its many educational resources for students who are deaf, blind, hard of hearing, visually impaired, or deaf-blind, and professional development resources for teachers, families, and other caregivers.

About the Author

Kate Lucariello is a former newspaper editor, EAST Lab high school teacher and college English teacher.

Featured

  • students using digital devices, surrounded by abstract AI motifs and soft geometric design

    Ed Tech Startup Kira Launches AI-Native Learning Platform

    A new K-12 learning platform aims to bring personalized education to every student. Kira, one of the latest ed tech ventures from Andrew Ng, former director of Stanford's AI Lab and co-founder of Coursera and DeepLearning.AI, "integrates artificial intelligence directly into every educational workflow — from lesson planning and instruction to grading, intervention, and reporting," according to a news announcement.

  • toolbox featuring a circuit-like AI symbol and containing a screwdriver, wrench, and hammer

    Microsoft Launches AI Tools for Educators

    Microsoft has introduced a variety of AI tools aimed at helping educators develop personalized learning experiences for their students, create content more efficiently, and increase student engagement.

  • laptop displaying a red padlock icon sits on a wooden desk with a digital network interface background

    Reports Point to Domain Controllers as Prime Ransomware Targets

    A recent report from Microsoft reinforces warns of the critical role Active Directory (AD) domain controllers play in large-scale ransomware attacks, aligning with U.S. government advisories on the persistent threat of AD compromise.

  • Two hands shaking in the center with subtle technology icons, graphs, binary code, and a padlock in the dark blue background

    Two Areas for K-12 Schools to Assess for When to Work with a Managed Services Provider

    The complexity of today’s IT network infrastructure and increased cybersecurity risk are quickly moving beyond many school districts’ ability to manage on their own. But a new technology model, a partnership with a managed services provider, offers a way forward for schools to overcome these challenges.