|
Field
Abstract
|
Before
Summary: The purpose of the evaluation is to assess the effectiveness of a classroom-based program intended to increase the vocabulary of preschool and primary school children. The program, called the Big Word Club (BWC), consists of videos, books and activities intended to help children learn one new word per day over a school year. The intent of the program is not only to teach specific new words, but also to increase children’s interest in words and literacy in general and thereby improve school success. The evaluation will assess the program’s success in achieving the narrow goal of increasing children’s receptive vocabulary. Specifically, we will assess receptive vocabulary using a test that includes words from the BWC as well as a set of age-appropriate words not included in the BWC. The evaluation will include a minimum of 50 schools and maximum of 65 schools all located in the Southwestern United States.
|
After
Summary of the Evaluation Results:
We estimate whether pre-kindergarten and kindergarten children in schools randomly assigned to participate in the Big Word Club (BWC) scored higher than students in a control group of schools on an assessment of receptive vocabulary based on words included in the BWC program (the BWC Assessment). We also assessed students using a standardized test of receptive vocabulary. 818 students in 47 schools were assessed.
Results show that children in classrooms with access to the BWC for 17 weeks identified, on average, between 1.194 and 1.319 more words on the BWC Assessment compared to the control group. The intent-to-treat effect size is between .229 and .267 standard deviations depending on how scores were imputed. All estimates are statistically significant at p<0.01. In the treatment-on-treated model, treated students identified 1.638 more words on the BWC Assessment at 17-weeks than the students who were not treated. The effect size was .320 standard deviations.
We assessed students 25 weeks after the intervention began on words included in the first 17 weeks of the BWC program. At that point students in schools with access to the BWC identified between 1.071 and 1.242 more words (depending on the imputation) on the BWC Assessment than students in the control schools. This corresponds to an effect size of between .229 and .257 standard deviations with all estimates statistically significant at p<0.01. At 25 weeks the TOT estimated effect size was .305. This means that children in the treatment group retained their advantage over children in the control group for at least 8 weeks.
We also assessed students at 25 weeks after treatment using the Peabody Picture Vocabulary Test 4, a standardized test of receptive vocabulary. Children in classrooms with access to the BWC scored higher on the PPVT than students in classrooms without access, but the difference was not statistically significant at p=.05.
The estimated effect of the BWC was greater for female students compared to male students who took the 25-week BWC Assessment, but there was no difference in the effect by students’ age, whether the student was in kindergarten, whether the student had English as a second language or had special needs, or whether the school was private or received Title 1 funding. Teachers report liking the BWC, believing that it is effective, and wanting to use it in the future. The main reason that they report not using he BWC is having too many other required activities.
The effect of the BWC on receptive vocabulary is the same as or greater than the effect of the only two programs that we could find that are comparable to the BWC. The BWC may be more cost effective than other programs because it does not require teacher training or follow up.
|