Emilia ALA

Our solution, Emilia the Awesome Lab Assistant (Emilia ALA), is an innovative AI-powered tool designed to transform how elementary and middle school students are assessed in science subjects. Emilia ALA aims to address the shortcomings of traditional assessments by enhancing the alignment with the Next Generation Science Standards (NGSS) and improving accessibility and engagement for all students.

What is it? Emilia ALA is a digital platform that integrates artificial intelligence to make science assessments interactive and inclusive. It’s built to evaluate students on the NGSS's three-dimensional (3D) learning model, which includes scientific knowledge, practices, and crosscutting concepts, ensuring a comprehensive understanding of science.

What does it do? Emilia ALA changes the way students interact with assessments:

• Cultural and Local Relevance: Emilia ALA allows students to incorporate their own cultural and local knowledge into their responses. This feature makes learning more personalized and relevant, bridging the gap between standard curricula and diverse personal experiences.
• Dynamic Interaction: Students interact with Emilia ALA through a friendly interface where they can ask questions and get clarifications in real-time. This ongoing interaction helps students understand complex scientific concepts more deeply and retain information better.
• Accessibility: Emilia ALA reduces the need for extensive reading and writing, making science more accessible to younger students and those who struggle with these skills. The tool uses voice recognition and text-to-speech technologies, allowing students to express their understanding in ways that suit them best.

How it works: Students log into the Emilia ALA platform through any standard web-enabled device. Once logged in, they engage with various science topics through a series of interactive tasks and questions. Emilia ALA responds to student inputs with prompts, feedback, and further questions to guide their thinking and deepen their understanding. This method not only assesses their current knowledge but also stimulates curiosity and fosters a deeper engagement with scientific investigations.

Technology used:

• Probeware: Probeware Integration: Emilia ALA incorporates scientific tools and probeware that can directly interface with the platform. As Emilia ALA guides students through the investigation of scientific phenomena, this technology allows students to interact with experiments in a manner akin to a professional scientist. This approach transforms assessments into active learning experiences, enabling students to demonstrate their knowledge through practical application.
• Artificial Intelligence: Emilia ALA uses AI to personalize interactions based on each student's responses and progress. The AI analyzes input to provide targeted questions and feedback, adapting to each student's learning pace and style.
• Voice Recognition and Text-to-Speech: These technologies make the tool accessible to all students, especially those who find reading and writing challenging. 

Benefits: By using Emilia ALA, assessments become more than just tests—they become powerful learning experiences. The tool's design ensures that every student feels valued and understood, regardless of their background or abilities. It aligns perfectly with educational goals to create more equitable and effective learning environments.

Emilia the Awesome Lab Assistant (Emilia ALA) is meticulously designed to positively impact the lives of priority Pre-K-8 learners, including those facing significant barriers to educational opportunities such as Black and Latino learners, students experiencing poverty, and students with disabilities. Here’s how Emilia ALA addresses their diverse needs through AI-enabled assessment:

Enhancing Engagement and Relevance: Emilia ALA enables students to incorporate their cultural, local, and individual contexts into the learning process. This integration makes science education more relevant and engaging, particularly for Black and Latino students and those whose experiences are not typically reflected in the standard curriculum. By recognizing and valuing diverse backgrounds and experiences, Emilia ALA helps bridge gaps in relevance and engagement, fostering a deeper connection to scientific learning.

Accessibility and Inclusion: Emilia ALA is designed with a strong focus on accessibility, using voice recognition and text-to-speech technologies to accommodate students who face challenges with traditional reading and writing tasks, including those with specific learning disabilities or visual impairments. The platform allows students to engage with content in ways that best suit their learning needs, supporting a broad spectrum of cognitive, linguistic, and physical abilities.

Dynamic and Supportive Interaction: Through AI, Emilia ALA provides real-time interactive feedback, allowing students to ask questions and explore concepts at their own pace and in their own words. This adaptability is especially crucial for marginalized students, who often struggle with more standardized approaches to learning and assessment. Emilia ALA’s supportive interaction ensures that all students feel guided and encouraged throughout their learning journey.

Empowering Educators: Emilia ALA equips teachers with actionable insights into each student's learning progress, including those with disabilities. This detailed feedback helps educators tailor their teaching strategies to better meet individual needs, enhance learning outcomes, and ensure that all students, regardless of their abilities, are supported effectively.

Encouraging Scientific Inquiry: Emilia ALA integrates probeware and scientific tools to facilitate hands-on experiments, engaging students in active learning and scientific inquiry. This approach is invaluable for all students including students with disabilities, providing them with tactile and experiential learning opportunities that can be crucial for understanding complex concepts and developing problem-solving skills.

We believe that Emilia ALA will be particularly transformative for formative and interim assessments. The rich, real-time data provided to students, coupled with detailed reporting for teachers, will deeply support both learning and instructional practices. Although summative assessments are slower to adopt new models due to their nature, this provides an opportunity to refine psychometric models and collaborate with policymakers. This ensures that Emilia ALA meets the critical elements outlined by the Department of Education, paving the way for broader acceptance and integration into standardized testing environments.

Chris Lazzaro, Ph.D. and Velma Itamura, MBA have both been at the forefront of science educational assessments, implementing innovative solutions and working directly with teachers, school, districts, and state DOEs for over 20 year. 

Chris served as the Director of Science at New Meridian, where he led the effort to develop science assessments and implement an interstate exchange of science assessment content. Prior to New Meridian Chris worked as the Senior Director of Science Education for over 11 years at the College Board. While at College Board Chris led projects ranging from professional development programs for science teachers, the AP Science redesign, the creation of the Science College Board Standards for College Success, as well as working directly with state DOEs across the country on adoption and implementation plans associated with Next Generation Science Standards and the SAT Suite of Assessments. Chris has served as a Science and Mathematics Item Review Committee (SMIRC) member for the Trends in International Math and Science Study (TIMSS) on the 2015 and 2019 administrations, working on international assessments where over 41 countries participated. Chris has also taught high school and college-level physics, in New York City. Chris’s research interests include national and international large-scale assessments, design-based research methods in education, science education, research and development of science standards, and the influence of national and state policies on local education. Chris has earned undergraduate degrees in Earth and Planetary Sciences and Physics, has a Masters degree in Physics from New York University, and a Ph.D in Science and Education Policy from Columbia University.

Velma has a robust background in curriculum and assessment development. Most recently, Velma was the Science Strategy Manager for New Meridian, where she led initiatives to enhance science education quality and equity. Her work includes collaborating with national science education organizations to align with current educational trends. Velma's contributions include leading science education for the state of Utah, where she implemented both formal and informal statewide programs in STEM education. Her efforts focus on creating equitable learning opportunities, improving student growth metrics, and fostering teacher professional development. Velma's has a degree in biology from the University of Utah and an MBA from Western Governors University.

Chris and Velma have been working together for 5 years to create equitable assessment solutions in science. The science education community, and in particular the science assessment community, is one that both Chris and Velma have been a part of for the entirety of their careers. They are active members of the Council for State Science Supervisors (CS3), the National Association for Research in Science Teaching (NARST), the National Science Teachers Association (NSTA). We have served as reviewers and awardees of for NSF funded science assessment projects and served on committees including, National Research Council (NRC) Board on Science Education (BOSE), American Association for the Advancement of Science (AAAS), and Presidential Awards for Excellence in Mathematics and Science Teaching (PAEMST).

We are currently in the pilot stage of developing Emilia ALA, focusing on integrating and testing the platform with probeware technology through a partnership with a leading probeware provider. While we have yet to engage students directly, our efforts are centered on refining Emilia ALA through user testing with our partner. This includes ensuring seamless integration of their probeware into our system. Our analysis has highlighted the significant value of channel partnerships, leading us to pursue collaborations with science curriculum developers to enhance the tool's reach and effectiveness before broader deployment to educators and learners.

Emilia the Awesome Lab Assistant (Emilia ALA) represents a significant innovation in the field of educational assessments, particularly in the way it approaches the challenges of science education at the elementary and middle school levels. What sets Emilia ALA apart is its integration of artificial intelligence to create a more dynamic, inclusive, and effective learning environment that goes beyond the capabilities of traditional assessment tools.

Approach to the Problem: Traditional science assessments often rely on static, one-dimensional testing methods that fail to capture the complexity of scientific knowledge and do not cater to the diverse needs of today’s student population. Emilia ALA challenges this norm by employing a three-dimensional approach to assessment, aligned with the Next Generation Science Standards (NGSS). It not only evaluates scientific knowledge but also how students apply and interconnect this knowledge across various contexts.

1. Cultural and Local Relevance: Emilia ALA allows students to bring their personal and cultural perspectives to their scientific inquiries, making assessments more meaningful and relatable. This is especially important for fostering a sense of belonging and engagement among students from diverse backgrounds, who may feel alienated by traditional curricula that do not reflect their experiences.

1. Dynamic Interaction: Unlike traditional assessments that are passive, Emilia ALA involves students in an active dialogue. Through AI, Emilia ALA interacts with students in real-time, providing personalized questions and feedback based on their responses. This dynamic interaction encourages deeper understanding and critical thinking, crucial skills in scientific education.
2. Accessibility: Emilia ALA significantly reduces the reliance on text-heavy responses, making science accessible to all students, including those with disabilities or those who struggle with literacy. By incorporating voice recognition and text-to-speech technologies, Emilia ALA ensures that every student can engage with content in ways that suit their learning styles and needs.

Catalyzing Broader Impacts: Emilia ALA has the potential to catalyze broader positive impacts in the educational technology space. By demonstrating the effectiveness of AI in creating more personalized and interactive learning experiences, it can encourage other developers to pursue similar innovations, leading to a more adaptive and student-centered approach across educational tools. Furthermore, Emilia ALA’s success could drive increased demand for AI-integrated learning platforms, pushing the market towards more innovative educational solutions that prioritize student engagement and understanding over rote memorization.

Changing the Market/Landscape: In the broader educational landscape, Emilia ALA could shift the market focus from standardized testing towards more holistic assessment methods. Its emphasis on inclusivity and accessibility could set new standards for how educational tools are designed to meet the needs of all students, particularly those from underserved communities. This shift could encourage policymakers and educators to rethink assessment strategies and embrace technologies that offer more equitable learning opportunities.

Emilia the Awesome Lab Assistant is not just a tool for assessment; it is a catalyst for change in educational practices, promoting a shift towards assessments that are as diverse as the student populations they serve. By leveraging AI to enhance interactivity, inclusivity, and relevance, Emilia ALA is paving the way for a future where all students can excel and be accurately assessed, regardless of their backgrounds or abilities.

Emilia the Awesome Lab Assistant (Emilia ALA) harnesses a sophisticated blend of AI technologies and other cutting-edge tech solutions to redefine how assessments are conducted in educational settings. Here's an outline of the core AI domains and additional technologies that empower our solution:

Core AI Technologies:

1. Natural Language Processing (NLP): Emilia ALA utilizes advanced NLP techniques to interpret and respond to student inputs. This allows the tool to understand and process student responses, whether they are typed or spoken, facilitating a conversational and interactive assessment experience. NLP also enables Emilia ALA to provide real-time feedback and guidance tailored to the context of each student's responses, enhancing the learning process.

1. Speech Recognition: Central to making Emilia ALA accessible to all learners, including those with disabilities or those who struggle with traditional reading and writing tasks, is use of speech recognition technology. This allows students to engage with the tool through voice, making the assessments more inclusive and reducing barriers related to text-based input.

1. Machine Learning (ML): Our solution incorporates ML algorithms to adapt the difficulty and types of questions based on the student’s performance. This adaptive learning approach ensures that each assessment is personalized to the student's knowledge level and learning pace, optimizing educational outcomes.

Dependency on External Technologies:

While Emilia ALA incorporates in-house trained AI models, it also leverages third-party models and APIs for specific functions such as enhanced speech recognition and certain NLP capabilities. This hybrid approach ensures that Emilia ALA benefits from the most advanced and efficient technologies available, while focusing our development efforts on areas where customization and specialized functionality are crucial.

Emilia ALA integrates with existing educational technology ecosystems by using standard APIs, making it easy for schools to implement alongside their current systems. This integration capability is essential for ensuring that Emilia ALA can reach as many students as possible without requiring significant changes to existing IT infrastructure.

Technological Synergy:

The combination of these AI technologies and user-friendly frontend development ensures that Emilia ALA is not just a tool for assessment but a comprehensive educational platform that supports and enhances learning. By leveraging AI's power across multiple domains—NLP, ML, and speech recognition—Emilia ALA offers a dynamic and accessible learning environment that can adapt to the diverse needs of students, fostering an inclusive and engaging educational experience.

While the technology for Emilia ALA is still in development and its efficacy is pending the results of our ongoing pilot tests, the underlying principles of our approach are supported by extensive research conducted by experts in the field. Our team members, Chris and Velma, who each have over 20 years of experience in science education, have contributed significantly to the foundational research in the field that guides the development of Emilia ALA. 

Chris and Velma’s recent scholarly activities provide credible evidence supporting the effectiveness of the methods we are incorporating into Emilia ALA. They have published a white paper and delivered an informational webinar, both sponsored by the National Science Teachers Association (NSTA), which detail the benefits of integrating probeware technology in classroom settings. This technology is central to Emilia ALA’s approach, as it enables students to engage actively with scientific phenomena, thereby enhancing learning and assessment through direct interaction and exploration.

The white paper, titled "What the Research Says About the Value of Probeware for Science Instruction," discusses various studies and findings that highlight how probeware can improve understanding of scientific concepts and processes among Pre-K-8 students. The webinar provides practical insights into implementing such technologies effectively in classrooms to maximize student engagement and learning outcomes.

For further details on the research and its implications for improving science education through technology like Emilia ALA, you can access the webinar recording here: NSTA Webinar. The white paper is available for download here: Vernier Whitepapers.

This foundational research not only informs the design and function of Emilia ALA but also reassures stakeholders of the sound, research-based methodology behind our innovative assessment tool, ensuring that when fully developed, it will be an effective resource for educators and learners alike.

Our approach to ensuring equity and combating bias in the implementation  of Emilia the Awesome Lab Assistant (Emilia ALA) is grounded in a deep commitment to understanding the diverse backgrounds and needs of learners, particularly focusing on priority learners in the 3-8 grade levels.

Understanding Diverse Needs: We begin by gathering diverse datasets that reflect the broad spectrum of students we aim to serve. This involves collaborating with educators from varied backgrounds to collect insights and feedback on how different students interact with and respond to our AI technology. Our current pilot plan includes a purposeful selection of diverse student populations. The insights we expect to gain from the pilot will ensure that Emilia ALA is responsive to the cultural, linguistic, and cognitive needs of all students.

Combatting Algorithmic Bias: To combat algorithmic bias, we employ several strategies:

1. Diverse Data Sets: We ensure that the data used to train our AI algorithms is representative of the diverse student populations we serve. This includes varied linguistic, socioeconomic, and cultural backgrounds to minimize bias in AI responses and assessments.

1. Continuous Feedback Loop: We maintain a continuous feedback loop with users and stakeholders to gather ongoing insights into how our AI is performing across different demographics. This feedback is crucial for refining AI algorithms and ensuring they remain unbiased and equitable.

1. Bias Audits: Regular audits by third-party experts help identify and mitigate any emerging biases in our algorithms. These audits are designed to analyze the AI’s decision-making processes and ensure they remain fair and objective.

Development and Deployment Process: Our development and deployment process is structured to monitor and avoid bias, discrimination, and other harmful impacts actively:

1. Ethical AI Frameworks: Along with the Learning Policy Institute we are in the process of establishing ethical AI frameworks, which, when published, will guide our development process and help define clear guidelines on maintaining equity and avoiding bias.
2. User-Centric Design: Emilia ALA is developed with a user-centric approach, engaging with students, teachers, and parents from diverse backgrounds throughout the development process. This engagement helps ensure that our tool meets their needs effectively and equitably.

Future Commitments: As we continue to develop and refine Emilia ALA, we remain committed to advancing equity by making sure our tool is accessible to all students and effectively supports their educational journey without bias. We understand that equity is not a one-time goal but a continuous commitment to improving and adapting our technology to serve every student effectively.

Currently we have two full time, Chris and Velma. We also have a part time tech consultant that has helped us in defining platform requirements. We also consult with a scientific probeware company on the integration of data collection and analysis to be used on the platform.

Emilia the Awesome Lab Assistant (Emilia ALA) is currently pilot-ready. Here's a streamlined overview of our preparation and evidence of our progress:

Development Milestones:

• Technology Integration and Optimization: We're collaborating with a probeware provider to enhance Emilia ALA’s AI technologies as we pilot the program. Our focus is on Natural Language Processing and Speech Recognition for interactive learning.
• Development of content: To date, we have developed three full modules of content aligned with elementary and middle school science curriculum.

Evidence of Progress:

• Prototype Development: A functional prototype is in active user-testing phases, incorporating adaptive learning algorithms and accessibility features.
• Feedback Collection: Initial feedback from educators during testing has been positive, affirming Emilia ALA’s engagement and adaptability to diverse student needs.
• Partnership Agreements: We are hoping to secure a full partnership with a probeware manufacturer in the next 6 months. 

Plans for the Next Year:

• Finalizing Product Development: We will complete all technical enhancements based on pilot feedback.
• Expanding Partnerships: We aim to formalize additional partnerships to broaden resource networks and support deployment.
• Pilot Implementation: We plan to initiate a controlled pilot in selected schools to gather insights and adjust before wider rollout.
• Evaluation and Scaling Strategy: An evaluation plan will be developed to assess Emilia ALA’s educational impact, focusing on engagement, learning outcomes, and usability. These findings will be published and presented at various assessment and science educational conferences (i.e., NARST, NSTA, AERA, NCME) in 2025/2026.

To ensure Emilia the Awesome Lab Assistant (Emilia ALA) is available, accessible, and affordable to priority learners at scale, we have developed a comprehensive strategy. Here’s our plan:

1. Strategic Partnerships: We are collaborating with educational organizations, technology providers, and curriculum developers to integrate Emilia ALA seamlessly into existing educational infrastructures. These partnerships will help us distribute Emilia ALA widely across school districts, particularly those serving high percentages of priority learners.

2. Cost-Effective Pricing Model: Emilia ALA will be offered at a tiered pricing model that ensures affordability for schools serving underprivileged communities. This model will be subsidized through partnerships, and grants.

3. Comprehensive Accessibility Features: Emilia ALA is designed with a range of accessibility features to cater to diverse learning needs, including speech recognition and text-to-speech capabilities for students with literacy challenges, and interface adaptability for those with visual or motor impairments. We continue to refine these features based on feedback from our pilot tests to ensure they meet the real-world needs of all students.

4. Robust Support and Training: To facilitate the effective use of Emilia ALA, we will provide comprehensive training and support for educators. This includes online tutorials, live workshops, and ongoing customer support to ensure that teachers feel confident using the tool and can fully leverage its features to support their students.

5. Scaling for Wider Impact: Once proven effective in pilot schools, our strategy includes scaling Emilia ALA to a broader network through state and national education systems. This expansion will be supported by advocacy for policy changes that recognize and fund innovative educational technologies as essential tools for equity in education.

We are applying to the Learner//Meets//Future Challenge because it aligns with our mission to transform educational assessments with our AI tool, Emilia the Awesome Lab Assistant. This challenge presents a unique opportunity to amplify and accelerate our impact, especially among priority learners.

Barriers We Face:

1. Financial: As an emerging educational technology company, securing sufficient funding to scale our solution while keeping it affordable and accessible to underserved schools is a significant challenge. 
2. Cultural: Ensuring that Emilia ALA is culturally responsive and appropriately serves diverse student populations, including Black and Latino learners and those experiencing poverty, is paramount. We would benefit from a larger pilot of the program as well as additional expertise in culturally responsive pedagogy and insights into local community needs to better tailor our solution. All of which would be feasible if we had additional funding and a partner that shared our goals for cultural responsiveness. 
3. Market: Breaking into the educational technology market, particularly within the public education sector, involves navigating bureaucracies and long sales cycles. Strategic partnerships and advocacy from well-known institutions could help facilitate introductions and build credibility with school districts and decision-makers.