The short- and medium-term effects of an early literacy tutoring intervention

Last registered on March 20, 2024

Pre-Trial

Trial Information

General Information

Title
The short- and medium-term effects of an early literacy tutoring intervention
RCT ID
AEARCTR-0011007
Initial registration date
February 28, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
March 13, 2023, 8:32 AM EDT

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
March 20, 2024, 6:12 AM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Primary Investigator

Affiliation
VIVE - The Danish Center for Social Science Research

Other Primary Investigator(s)

PI Affiliation
VIVE - The Danish Center for Social Science Research
PI Affiliation
VIVE - The Danish Center for Social Science Research
PI Affiliation
VIVE - The Danish Center for Social Science Research
PI Affiliation
VIVE - The Danish Center for Social Science Research

Additional Trial Information

Status
On going
Start date
2022-10-01
End date
2026-12-31
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
This project examines the short- and medium-term effects of a literacy program for kindergarten-age children in Denmark, called Læseklar (meaning reading-ready in Danish). Læseklar is a multi-sensory tutoring program that targets the students most at risk of reading difficulties. The program combines components that have shown promising results in the international literature: one-to-one and small-group tutoring, a focus on phonemic awareness, phonics, decoding, and multi-sensory learning methods.

We evaluate the effectiveness of the program with a cluster-randomized controlled trial (RCT). Approximately 80 schools will participate in the experiment, half will receive the treatment and the other half is the control group. The short-term primary outcome measure is a standardized test of decoding. Secondary outcomes are subscales from the Danish national survey of well-being. Both outcomes are measured at the end of kindergarten. The medium-term primary outcome is the Danish national test in reading conducted in the first semester of grade 2. Secondary outcomes are subscales from the second grade version of the well-being survey. All outcomes are measured for all students in participating classes in treatment and control schools, which enables us to examine peer effects of the intervention for each outcome.
External Link(s)

Registration Citation

Citation
Bingley, Paul et al. 2024. "The short- and medium-term effects of an early literacy tutoring intervention." AEA RCT Registry. March 20. https://doi.org/10.1257/rct.11007-1.1
Sponsors & Partners

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information
Experimental Details

Interventions

Intervention(s)
The intended frequency and duration of the program is 3-4 times a week for 8-10 weeks, over a total of 30-35 sessions where each session lasts 10-15 minutes. However, this dosage can and should be adapted to the individual child (i.e., students with greater difficulties may need more sessions). Instruction is given one-to-one (for the students with the greatest difficulties) or in small-groups of 2-3 students by a tutor. Teachers, special educators, pedagogues, and teacher’s aides may serve as tutors. The participating schools may choose the type of tutors that is best suited given their organizational context. The tutors receive a manual and can see three short films illustrating the method.

The aim of Læseklar is threefold: First, to make the students realize that words denote both content (e.g., “lion” represents the animal) and has a form made up of a number of phonemes. Second, to help students grasp the connection between letters and sounds. Third, and most important, to show students how to decode simple words (i.e., to translate written letter combinations into sounds).

The program includes three types of sessions. In the first type, the tutor uses clay figurines representing 24 Danish language sounds and letters, a box with a compartment for each letter, and a laminated sheet with the fingerspelling alphabet. A session starts with the tutor selecting three figurines. The student’s (or students’, if the session is conducted in a small group) task is to help the figurine to move into its designated compartment, or “house”. To do so, the student needs to figure out a code. The first part of the code is the sound of the first letter in the figurine’s name, for example, /l/ in “lion”, and the second part consists of fingerspelling the letter. The student should make the /l/ sound, while at exactly the same time fingerspelling the letter. Then the student moves the figurine into its house, which is marked with the corresponding letter. After the three figurines have moved into their houses, the procedure is repeated once and then the session ends. During the next session, the student repeats the previously completed figurines, and then continues with a couple of new ones. For students experiencing difficulties remembering letter-sound combinations, tutors can use a mirror so that students see how their mouths look and feel when saying letter names and sounds. This multi-sensory method can also be used in the second and third type of session.

The second type of session starts after the student has learnt about 12-15 of the letter sounds, which typically takes less than a month. The tutor uses images representing short words, which are glued onto the back of the pages in a small booklet. The tutor acts as a secretary for the student, who sounds out the phonemes in the word represented by the image. As the student sounds out the phonemes, the tutor writes the word on the front of the page. If needed, the student uses fingerspelling to aid the memory of the letter-sound combinations. Using the booklet, the student can practice by themselves or with their parents, as it is possible to verify whether words are read correctly by simply turning the page and check the image.

The third type of session aims to build decoding speed and fluency by practicing the decoding of short syllables with the help of flashcards. The student’s task is to decode as many syllables as possible during one minute. The tutor registers the result on a chart and then the same syllables are repeated in the same order two more times in the same session. This procedure usually yields a clear improvement. Making improvements visible for the students with the help of the chart usually motivates them to practice more. The second and third type of session are often used interchangeably, which decreases the risk that the student gets bored. It is also possible to go back to the first type of session, when words contain letter-sounds that were not among the first 12-15 that the students learned.
Intervention Start Date
2023-01-09
Intervention End Date
2024-06-30

Primary Outcomes

Primary Outcomes (end points)
Our primary post-intervention outcome at the end of kindergarten will be a measure of decoding skills from a subtest of a standardized dyslexia test widely used in Denmark (the 30 real words in “Elbros ordlister” from “Ordblinderisikotesten”; Gellert & Elbro, 2016). The test score is the number of correctly read words (i.e., a number between 0 and 30).

We will use the compulsory Danish national tests in reading conducted in the first semester of second grade as our primary outcome at the first follow-up test. This test is currently mandatory for all public schools. Further compulsory national tests in reading are conducted in 3rd, 4th, 6th, and 8th grade. We will analyze these tests as well, should we have the resources.
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
At all measurement occasions, we will use subscales from the national survey of student well-being as secondary outcome measures. All students in public schools take this survey annually from Kindergarten to 3rd grade (Ministry of Education, 2018b).
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
The experimental design is a cluster-randomized controlled trial in which schools are randomly assigned to either the treatment or the control group. We prioritized inviting schools that were likely to have many at-risk students. To determine the eligible set of schools, we used data on educational characteristics of parents that are highly correlated with the national reading test in 2nd grade. Specifically, for the first round of invitations, we selected the schools in Denmark in which no more than half of the parents have a tertiary education (using data from the kindergarten classes in the school year 2019/2020). This cutoff yielded an eligible sample of 394 public schools (out of 1,135 for which we could obtain sufficient information). Our targeted number of participating schools is 80.

For administrative reasons, we will recruit over at least two school years. In spring 2022, we started inviting schools and in total 16 schools agreed to participate and were randomized to the treatment and control groups. In the second year, we will not-yet-invited schools and schools that declined the invitation in the first year. Depending on the response rate, we may also have to increase the number of eligible schools. It is also possible that the response rate is higher than expected. As our budget determines the number of schools we can give the program to, should we end up with more schools than the targeted 80 we may choose to randomly assign less than 50% of participating schools to the treatment group.

We conducted the randomization for the first round and notified the schools of their treatment status mid-November 2022. We will use a similar procedure in 2023. The treatment schools are expected to implement the program in the spring semester of 2023 or of 2024, which will give schools at least two months to prepare the implementation (and usually more, as they do not have to start early January). That is, regardless of when their school was recruited, students in treatment schools will train with the program in the second semester of kindergarten.

Among the schools that accepted the invitation to participate in 2022, we randomized the treatment (receipt of Læseklar) at the school level. We conducted a stratified randomization. As the recruitment procedure stretches over at least two school years and schools recruited the first year will receive the intervention before the recruitment in the second year begins, schools were stratified by recruitment year. Within each recruitment-year strata, we used a pair-matching procedure: We ranked schools by the proportion of students at risk of reading difficulties according to test scores of literacy and language skills, and then matched schools with adjacent ranks into pairs. The pre-test scores comes from language and literacy tests conducted by all Danish schools at the beginning of the first semester of kindergarten (typically in September or October). We then used the random number generator in Stata to determine the assignment to the treatment and control group in each pair. The assignment probability was 50% for each school. We will use the same procedure for schools recruited in 2023.
Experimental Design Details
Not available
Randomization Method
We used the random number generator in Stata.
Randomization Unit
School
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
80 schools
Sample size: planned number of observations
In total around 4,000 pupils: 2,000 pupils in the control schools and 2,000 pupils in the treatment schools, of which around 250 will receive training with the program.
Sample size (or number of clusters) by treatment arms
40 treatment schools and 40 control schools.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
Minimum detectable effect size is 0.36 standard deviations on the pupils receiving training with the program, and 0.20 standard deviations on peers not receiving the program.
IRB

Institutional Review Boards (IRBs)

IRB Name
Internal Review Board at VIVE
IRB Approval Date
2022-06-22
IRB Approval Number
2022/4
Analysis Plan

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information