Early Childhood Outcomes TA Meeting

Developing A State Outcome Measurement System

NECTAC meeting, Salt Lake City, Utah, April 18-20, 2005

Sponsored by NECTAC in collaboration with The Early Childhood Outcomes (ECO) Center and The Data Community of Practice (WRRC, NECTAC, NCSEAM, Westat, and Region 1 PTAC)

Intended outcomes:

States will gain information about a planning framework for addressing the issues involved in developing state outcome systems.
States will gain information about issues and challenges as well as various approaches to developing and implementing an outcome system.
States will utilize information from the meeting to plan with their state team and make progress in their current outcome efforts.

Monday, April 18
1:00 – 3:00 Seasons South	Welcome and greetings from OSEP Jennifer Tschantz and Larry Wexler Considerations in measuring Part C and Section 619 child outcomes Kathy Hebbeler, ECO Presentation [756K PDF] Overview to a planning framework for addressing the issues involved in developing state outcome systems Anne Lucas, NECTAC Presentation [112K PDF] Agenda, logistics for the next 2 days Lynne Kahn, NECTAC and ECO
3:00 – 3:15	Break
3:15 – 4:15 Various meeting rooms, as assigned	State team planning (with room assignments for states) Where are you now? What do you want to accomplish during this meeting? Who are the important stakeholders to involve?
4:15 – 4:30	Break
4:30 – 5:30 Seasons South	Considerations, evidence statements and measures for family outcomes Don Bailey, ECO Presentation [2.3MB PDF]
6:00 Wasatch	Reception / GSEG State posters and materials

Tuesday, April 19
8:30 – 10:00 Seasons South	Developing evidence statements and measures for child outcomes Donna Spiker, ECO Presentation [840K PDF]
10:00 – 10:15	Break
10:15 – 11:30	Concurrent sessions:
Market	GSEG State Spotlight: Maryland Maryland’s GSEG focuses on outcomes and indicators for birth-5; measurement approaches, processes, tools; analytic protocols and models for documenting results and improving programs; and a statewide infrastructure for implementing the system that includes logistical processes, a technical data collection and reporting system, and online resources and technical assistance. Presentation [840K PDF]
Granary	GSEG State Spotlight: Delaware This session will examine the process and strategies the state of Delaware is using to establish a framework for collecting assessment data to provide evidence of child outcomes, birth to five. It will highlight how they are linking the proposed child outcomes to their state early learning guidelines at various age levels and outline how they propose to fit the framework with assessment instruments in current use throughout the state. Early learning foundations presentation [1.9MB PDF] Early childhood accountability presentation [1MB PDF]
Rap-Smokehouse	GSEG State Spotlight: New York New York will describe their use of “Concept Mapping”, a strategy they will use with stakeholders to define their child/family outcomes, outcome indicators, and measurements. Their GSEG will include field testing and developing final recommendations on implementation of an EI outcomes system in NYS. Presentation 1 [888K PDF] Presentation 2 [556K PDF]
Summer	Converse with the ECO staff Kathy Hebbeler, Don Bailey, Donna Spiker, and Charlie Greenwood will be available to answer questions and discuss ECO’s work in supporting the development and implementation of state early childhood outcome measurement systems for child and family outcomes. The discussion will be directed by the participants.
Weights and Measures	The NCSEAM Family Survey Batya Elbaum, of NCSEAM, will describe the development and some of the important characteristics of the “Impact on Family” scales of the Part B and Part C NCSEAM Family Surveys. She will share the results of an exploration of the relationship between NCSEAM “Impact on Family” items and ECO family outcome statements. Presentation [1.1MB PDF]
11:30 – 12:30 Various meeting rooms, as assigned	State team planning
12:30 – 1:30	Lunch on your own
1:30 – 2:45	Choice of two facilitated workshops:
Market Street & Granary	*Developing evidence statements and measures for family outcomes: Part 2 (building on the Monday, 3:15 session)* Don Bailey, ECO
Seasons South	*Developing evidence statements and measures for child outcomes: Part 2 (building on the Tuesday, 8:30 session)* Kathy Hebbeler and Donna Spiker, ECO
2:45 – 3:00	Break
3:00 – 4:15	Concurrent sessions:
Market	GSEG State Spotlight: Illinois and Texas Illinois and Texas are collaborating to develop a family centered outcome questionnaire (in English and Spanish) patterned after the NEILS family survey, and to integrate the resulting data elements into the states’ data systems. They will implement the family-centered outcomes instrument as a regular component in data collection for the EI programs in Illinois and Texas. Presentation [836K PDF]
Granary	Converse with NCSEAM staff Batya Elbaum & Sharon Walsh will be available to answer questions and discuss NCSEAM’s work on their Family Surveys and on integrating outcomes measurement into general supervision and monitoring activities. The discussion will be directed by the participants.
Rap-Smokehouse	GSEG State Spotlight: Kentucky The session will describe Kentucky’s work in aligning early childhood outcomes measurement with the state’s educational achievement standards. With their GSEG, they will pilot a process that can help programs implement a comprehensive Assessment System that can be used for children (0-5) with and without disabilities across delivery systems. The discussion will highlight some of their measurement strategies and challenges. Handout [836K PDF]
Weights and Measures	Do as We Say, Not as We Did: The California Experience California will describe the context, the process they used, and what they learned from their experience in developing an inclusive, universally designed child observation tool for use by early care and education programs in California. Lessons learned through their experience will apply to other states who will be selecting or adapting tools for measuring child outcomes. Materials [684K PDF]
Summer	GSEG State Spotlight: Utah In this session, Utah will describe their experience with the application of developmental rates analysis to measure child outcomes. They will welcome discussion of challenges and learnings with other states who have also conducted analyses of growth rates. Presentation [268K PDF]
4:15 – 5:30 Rooms TBD	Discussion sessions suggested by participants or optional time for states to continue planning on their own

Wednesday, April 20
7:30 – 8:30 Rooms TBD	Discussion sessions suggested by participants
8:30 – 8:45 Seasons South	Welcome and housekeeping
8:45 – 10:00 Seasons South	Uh-Ohs, Ah-Has, and Duhs: The Urgency of Engaging Local Stakeholders throughout the Development of Outcomes Measurement Systems Larry Edelman Presentation [1.5MB PDF] Handout [124K PDF]
10:00 – 11:15 Various meeting rooms, as assigned	State team planning
11:30 – 12:30	Concurrent sessions:
Market	Strategic Communication and Engaging Stakeholders: California This session reviews what was learned through several years of strategic communication with stakeholders and the studied use of various strategies to inform and engage them in California’s Desired Results measurement system. Presenters will describe the major lessons learned (and how they learned each lesson), and provide examples of how they responded to their learning experiences.
Granary	GSEG State Spotlight: New Hampshire Participants will learn about New Hampshire's experiences with efforts to gain the support of family organizations, promote family engagement and increase family involvement in the subcommittee work of the Cornerstone Project (NH’s GSEG), including details about publicity, recruitment, distance membership, use of stipends and input via surveys. Lessons learned and questions still to be answered will be shared.
Rap-Smokehouse	GSEG State Spotlight: Colorado Broad stakeholder input is critical, but managing the information flow and varying levels of involvement across multiple stakeholders can be a challenge. Colorado will share an organizational scheme and process that was developed to manage various levels of stakeholder communication and involvement in Results Matter, the accountability system for Colorado’s early childhood care and education programs. Checklist [200K PDF]
Weights and Measures	GSEG State Spotlight: Utah Motivated by its size and rural population, Utah has adopted a variety of distance learning and communication technology strategies to facilitate stakeholder involvement in the development of their outcomes system. Participants in the session will be encouraged to discuss similar challenges and successful strategies. Presentation [660K PDF]
Summer	Converse with the ECO staff about family outcomes Don Bailey and Kathy Hebbeler welcome participants to converse informally about their efforts to measure family outcomes. The discussion will be directed by the participants.
12:30	Adjourn and turn in evaluation forms! We value your input.