Pilot Study - The Impact of a Personalised Application on Newly Arrived Immigrant Students' Learning, Integration and Development

Last registered on May 02, 2025

Pre-Trial

Trial Information

General Information

Title
Pilot Study - The Impact of a Personalised Application on Newly Arrived Immigrant Students' Learning, Integration and Development
RCT ID
AEARCTR-0012656
Initial registration date
December 05, 2023

Initial registration date is when the trial was registered.

It corresponds to when the registration was submitted to the Registry to be reviewed for publication.

First published
December 06, 2023, 9:06 AM EST

First published corresponds to when the trial was first made public on the Registry after being reviewed.

Last updated
May 02, 2025, 9:42 AM EDT

Last updated is the most recent time when changes to the trial's registration were published.

Locations

Primary Investigator

Affiliation
Université Paris-Dauphine

Other Primary Investigator(s)

PI Affiliation
IRD
PI Affiliation
City University of London

Additional Trial Information

Status
Completed
Start date
2023-10-02
End date
2024-04-01
Secondary IDs
Prior work
This trial does not extend or rely on any prior RCTs.
Abstract
In France, over 89,500 newly arrived allophone students were enrolled in schools in 2022-2023, with 60% placed in specialised language support units (UPE2A*). Despite near-immediate school enrolment, language barriers often represent a significant obstacle to the integration of allophone children. They can prevent their socialisation with peers, lead to learning difficulties at school, and reduce parental involvement in children’s education. Additionally, only 8% of teachers feel prepared to teach in multicultural settings. To address these challenges, we conducted a pilot study to assess the feasibility of using digital tools to support allophone students' learning. Although no application specifically designed for allophone students currently exists, we leveraged LearnEnjoy's "School" application due to its personalised learning features and ability to adapt content to students' levels.

This pilot thus evaluated the feasibility of an RCT that aims at studying the impact of a technological intervention on (i) first-generation immigrant children’s development, learning, and integration; (ii) parental involvement in education and social inclusion; and (iii) teaching practices in a multicultural context. This pilot study also aimed at getting precise feedback on the application from teachers and parents so that we could adapt its contents and design, and develop a specific application for allophone pupils that could be deployed as part of a large-scale evaluation.

The pilot study was conducted between April 2023 and July 2024 across four French académies (Strasbourg, Lille, Créteil, Paris). It involved 19 UPE2A teachers (for 400 students) who were randomly assigned to three groups: a control group, a group receiving 5 digital tablets and teacher training, and a group receiving 5 digital tablets along with training for both teachers and parents. The digital applications used were existing LearnEnjoy apps designed for personalised learning, though they were not specifically tailored for allophone students. Data collection included classroom observations, teacher interviews, and surveys with teachers and parents in 11 schools.

The pilot confirmed the need for specialised digital tools that emphasise oral language development and school vocabulary. Teachers strongly valued the personalisation features, reinforced by significant classroom heterogeneity, but highlighted the importance of adapting contents specifically for allophone students. The study also revealed the need for teachers to be trained to use digital tools before being trained in using the app, particularly in a setting where they can work across multiple schools with limited internet connectivity. Finally, qualitative fieldwork showed that the provision of tablets, despite their limited number in the context of the pilot, appeared to foster communication between first-generation immigrant parents and schools, as the valuable nature of the tablet and the need to establish usage guidelines naturally created opportunities for interaction. This suggests that formal parent training on the application may be less crucial than simply ensuring the logistics of tablet distribution to create these touch points between parents and teachers. However, the pilot's limited number of tablets per teacher prevented us from fully delving into this mechanism.

Based on these findings, the research team is now working with LearnEnjoy to develop an application specifically designed for allophone students, incorporating feedback from teachers and parents gathered during the pilot. Once developed, we will conduct a large-scale randomised evaluation to assess its impacts on student learning, parental involvement, and teaching practices.


*UPE2A units are designed to support students who are non-native French speakers and have recently arrived in the country, helping them integrate into the school system by focusing on language acquisition and cultural adaptation.

Registration Citation

Citation
Gubert, Flore, Alice Mesnard and Alexandre Touw. 2025. "Pilot Study - The Impact of a Personalised Application on Newly Arrived Immigrant Students' Learning, Integration and Development." AEA RCT Registry. May 02. https://doi.org/10.1257/rct.12656-2.0
Experimental Details

Interventions

Intervention(s)
The interventions consist of (i) training parents and teachers in the application and (ii) distributing tablets to allophone pupils with the startup's application so that they can use it in class.
In order to be able to estimate separately the effects of (i) implementing the application in classrooms through the change in teaching practices and the effects of (ii) the use of the application by parents as an increase in parental involvement, we deploy the intervention between three treatment arms consisting of :

[T1] Introducing a digital tablet to students in class with the application and train the teachers so that they can adapt their teaching practices ;
[T2] Providing a digital tablet to students with the application and train both parents and teachers.
[T3] Control group. The teachers will be trained and tablets will be given to students after data collection for ethical reasons.
Intervention (Hidden)
Intervention Start Date
2023-11-30
Intervention End Date
2023-12-01

Primary Outcomes

Primary Outcomes (end points)
Child development:
• French language proficiency
• School grades, student’s progress, national evaluations
• Social-emotional skills & relationships with other children at school
• Absenteeism

Parents’ involvement in the child’s education and SES situation :
• Time spent working supporting the child
• Participation to collective meetings, school report meetings
• Relationship with the teacher

Teaching practices
• Willingness to train in digital technology
• The integration of digital technology
• Barriers to the use of digital technology Teacher’s survey
• Collaborative practices among teachers
• Practices to foster students’ collaboration
• Teachers’ sense of self-efficacy (digital integration)
• Teaching in a multicultural setting
Primary Outcomes (explanation)

Secondary Outcomes

Secondary Outcomes (end points)
Secondary Outcomes (explanation)

Experimental Design

Experimental Design
Inside each French academic regions, teachers of French as a foreign language who volunteer for the project are randomly assigned to one of the following three groups consisting of :

[T1] Introducing a digital tablet to students in class with the application and train the teachers so that they can adapt their teaching practices ;
[T2] Providing a digital tablet to students with the application and train both parents and teachers.
[T3] Control group. The teachers will be trained and tablets will be given to students after data collection for ethical reasons.

Students and their parents are randomly assigned to their teacher's group. Parents' consent is collected by a consent form translated in families mother tongue.
For the pilot phase, teachers had the opportunity to enrol within each academy as they went along. The random draw therefore took place within each academy as and when the lists of teachers were finalised.
For the full-scale study, teachers will be drawn at random in a stratified way by academy at once.
Experimental Design Details
Randomization Method
For the pilot phase: randomisation done in an office by a computer.
Randomization Unit
Teachers
Was the treatment clustered?
Yes

Experiment Characteristics

Sample size: planned number of clusters
4 French academic regions for the pilot study.
Sample size: planned number of observations
For the pilot study : 350 students for 20 teachers in 4 French academic regions
Sample size (or number of clusters) by treatment arms
For the pilot study : 116 students per treatment arms.
Minimum detectable effect size for main outcomes (accounting for sample design and clustering)
IRB

Institutional Review Boards (IRBs)

IRB Name
Paris School of Economics
IRB Approval Date
2023-01-13
IRB Approval Number
2023-001

Post-Trial

Post Trial Information

Study Withdrawal

There is information in this trial unavailable to the public. Use the button below to request access.

Request Information

Intervention

Is the intervention completed?
Yes
Intervention Completion Date
April 01, 2024, 12:00 +00:00
Data Collection Complete
Yes
Data Collection Completion Date
April 01, 2024, 12:00 +00:00
Final Sample Size: Number of Clusters (Unit of Randomization)
/!\ This was a pilot study /!\
19 schools were included, 5 in control, 7 in T1 and 7 in T2
Was attrition correlated with treatment status?
No
Final Sample Size: Total Number of Observations
/!\ This was a pilot study /!\
450 allophone children identified in the 19 schools, 42 left the sample. Among the remaining pupils, 213 parents did not consent to the project for multiple reasons. Among the 153 consent forms received, we only administered the questionnaire to 49 parents for calendar, administrative and budget reasons.
We received 14 questionnaire answers from teachers.
Adminstrative data on pupils was not meant to be collected during the pilot study.
Final Sample Size (or Number of Clusters) by Treatment Arms
/!\ This was a pilot study /!\ 19 schools, 49 parents answered the questionnaire for them and gave information for 61 children. 14 teachers answered for them and gave information for 88 children.
Data Publication

Data Publication

Is public data available?
No

Program Files

Program Files
No
Reports, Papers & Other Materials

Relevant Paper(s)

Reports & Other Materials