NOTE: Scroll about 2/3 of the way down this page to read the summary.
EBP THERAPY ANALYSIS
SOURCE: Daly, A. (2009). Teaching prosody through Readers Theatre. Capstone Paper for Master of Arts at Hamline University, Saint Paul, MN.
DATE: June 1, 2014
ASSIGNED GRADE FOR OVERALL QUALITY: C- (The highest possible grade was C+ due to the design of the investigation.)
TAKE AWAY: This single group investigation revealed that a comprehension-based Readers Theatre intervention for 2nd graders who are English Language Learners can improve timing (phrasing), intonation, and stress (i.e., fluency) of oral reading.
1. What type of evidence was identified?
a. What was the type of evidence? (bold the appropriate design)
• Prospective, Single Group with Pre- and Post-Testing and
• Descriptive Research
• The investigator used a combined quantitative and qualitative (Action Research) approach.
b. What was the level of support associated with the type of evidence? Level = C+
2. Group membership determination:
a. If there were groups, were participants randomly assigned to groups?
N/A, there was only one group.
3. Was administration of intervention status concealed?
a. from participants? No
b. from clinicians? No
c. from analyzers? No
4. Was the group adequately described? Yes
- How many participants were involved in the study?
• total # of participant: 6
• # of groups: 1
• # of participants in each group: 6
• List names of groups: NA, there was only one group.
b. The following variables were described:
• age: 7 – 8 years of age
• gender: 2m, 4f
• language: all English Language Learners (ELL); first 21% of the children in the district are ELL
• first language: Hmong (3); Spanish (3)
• SES: 52% of children at school were eligible for reduced/free lunch
• educational level of clients: all Ps in G2
• reading level: 3/6 Ps were reading below grade level; all Ps (including those who read at grade level) read word-by-word when orally reading.
c. Were the groups similar before intervention began? Not Applicable
d. Were the communication problems adequately described?
• disorder type: (List) no disorder- all ELL; literacy problem 3/6 had below grade level, all had oral reading problems (fluency)
• functional level
– speaking and listening skills on a 1 (beginning) – 5 (ready to transition out of ELL classes) scale: 3 (1P), 4 (4P), 5 (1P)
– reading and writing skills on a 1 (beginning) – 5 scale (ready to transition out of ELL classes): 3 (4P), 4 (2P)
– reading level: Late G1 (2P); Early G2 (1P); Mid G2 (1P); Late G2 (2P)
• other (list)
5. Was membership in groups maintained throughout the study?
a. Did each the group maintain at least 80% of their original members? Yes
b. Were data from outliers removed from the study? No
6. Were the groups controlled acceptably? No, this was a single group study.
7. Were the outcomes measure appropriate and meaningful? Yes
a. The outcomes were
• OUTCOME #1: Improved ranking on timing rubric
• OUTCOME #2: Improved ranking on stress rubric
• OUTCOME #3: Improved ranking on intonation rubric
• OUTCOME #4: Positive P perception of the intervention (no pretest data provided)
b. All of the outcome measures were subjective.
c. None of the outcome measures were objective.
8. Were reliability measures provided?
a. Interobserver for analyzers? No. The investigator did not provide data but insured reliability by having a second, independent judge. For the rubrics, the judges came to a consensus on disagreements. Most scores on the rubric were within one point of one another. A second judge also reviewed the observations; the investigator did not describe how disagreements were handled.
b. Intraobserver for analyzers? No
c. Treatment fidelity for clinicians? No. However, the investigator made about notes about routines, teaching, and learning (i.e., the observation data).
9. What were the results of the statistical (inferential) testing?The investigator did not subject the data to inferential testing. The results which follow are solely from descriptive analyses.
PRE VS POST TREATMENT—The investigator provided 3 cycles of treatment. Before initiating treatment in a cycle, the investigator administered a pretest; after treatment for a cycle, the investigator administered a posttest.
– Pretest/Posttest comparisons found to be markedly improved:
• OUTCOME #1:Improved ranking on timing rubric— Scores for each cycle increased from pretest to posttest. Moreover, each pretest was higher than the previous pretest but lower than the previous posttest.
• OUTCOME #2:Improved ranking on stress rubric— Scores for each cycle increased from pretest to posttest. Moreover, each pretest was higher than the previous pretest but lower than the previous posttest.
• OUTCOME #3:Improved ranking on intonation rubric— Scores for each cycle increased from pretest to posttest. Moreover, each pretest was higher than the previous pretest but lower than the previous posttest.
• OUTCOME #4: Positive P perception of the intervention (no pretest data provided)—The Ps’ remarks about the treatment were positive.
b. What was the statistical test used to determine significance? Not Applicable
c. Were confidence interval (CI) provided? No
10. What is the clinical significance? Not provided.
11. Were maintenance data reported? No
12. Were generalization data reported?Yes.The investigator administered a “transfer assessment” following the completion of the 3 cycles. The transfer assessment involved a new script at the same reading level as the previous cycles. To avoid a “cold reading”, the group read the transfer script 2 times before the assessment. Overall, Ps’ transfer scores were higher than the first pretest but lower than the final posttest. Scores for the stress rubric were lower than the timing and intonation rubrics.
ASSIGNED GRADE FOR QUALITY OF EXTERNAL EVIDENCE: C-
SUMMARY OF INTERVENTION
PURPOSE: To investigate the effectiveness of comprehension-focused Readers Theatre on the intonation, timing (phrasing), and stress of ELL second graders while oral reading.
POPULATION: English Language Learners (ELL), Literacy (fluency problems); Child
MODALITY TARGETED: production (for oral reading)
ELEMENTS/FUNCTIONS OF PROSODY TARGETED: intonation; timing (phrasing); stress
ELEMENTS OF PROSODY USED AS INTERVENTION: intonation; timing (phrasing); stress
OTHER ASPECTS OF LANGUAGE/COMMUNICATION TARGETED (Dependent variable): Literacy (fluency)
DOSAGE: small group (7Ps—one P was not part of the investigation); 35 minute sessions; 4 weeks; 3 six session cycles
ADMINISTRATOR: English as a Second Language (ESL)Teacher
STIMULI: written scripts, diagrams, pictures, oral modeling by C, visual cues (e.g., hand signals, symbols on scripts)
– TECHNIQUES: Readers Theatre (expressive oral reading or prosodic reading), repeated reading, comprehension instruction strategies, modeling; metalinguistics, feedback
• There were 3 cycles: timing, stress, intonation
• each cycle lasted 6 days
• each cycle was associated with a different script.
• each session began with a pretest and ended with a post test using the practice script
• following the Cycle 3 post test, there was a transfer (generalization) assessment in which Ps orally read a script that had not been practiced (although the group had read it aloud 2 times to avoid a cold reading).
– DAILY SCHEDULE:
• 5 minute opening—snack and interaction among group members. (They were a cohesive group prior to the Readers Theatre intervention.)
• Then C administered the activities described below.
FOR EACH CYCLE, THE FOLLOWING PROCEDURES WERE ADMINISTERED
• Day 1: Pretesting: the group read the script aloud 2 times and worked on difficult words. C then recorded each P individually reading the script.
• Day 2:
– C read aloud the script using expressive prosody (i.e., modeling).
– C then presented activities designed to improve the background knowledge associated with the theme of the script for the Cycle. (The investigator describes these activities starting on page 45.)
– The group read aloud the script (i.e., everyone in the group read all the parts.)
– C provided Ps with copies of the script and directed Ps to practice them at home each day.
• Day 3:
– C presented a brief lesson on the prosodic element of timing.
– C assessed Ps’ comprehension of the topic and clarified her presentation.
– C read the script 2 times: 1 time with an inappropriate timing element that was the focus of the cycle and 1 with an acceptable representation.
– Ps identified the preferred reading of the script
– The group identified the errors produced by C during the “inappropriate” reading.
– Ps and C marked the first 2 pages of scripts with symbols for timing (e.g., // for long pause, / for short pause in timing)
– C highlighted a different role for each P with Ps reading aloud their own parts from the script.
– Ps then exchanged scripts so that each P performed each role.
– If necessary, the group discussed meaning of lines and/or how to improve the timing of a line.
• Day 4:
– C presented a brief lesson on the prosodic element of stress.
– C wrote a line from the script on the board and read it aloud with appropriate stress.
– C directed the Ps to identify the loudest word and then she underlined the word with a thick line.
– C asked Ps to identify words that were “a little loud” but not as loud as the previous (full stressed) word. Then she underlined those words with thin lines.
– C asked Ps to identify words that were spoken softly and she did not underline them.
– C presented another line from the script and repeated the process
– C explained to the Ps that speakers emphasize words that they think are important and that they already did this when they spoke. C also explained that as actors the Ps needed to be sure they understood the scripts so they could emphasize the correct words.
– As a group, the Ps and the C read through the script identifying the level of stress for each work (thick line, thin line, no line).
– The Ps then read through the script several times. Each P took a different role, each time the script was read.
– At the end of the session, C assigned the roles to the Ps for the final performance. C provided Ps with highlighters that they took home to mark their lines in their homework script.
– C reminded Ps that good actors practice their lines many times and encouraged them to practice at home.
• Day 5:
– During the 2nd and 3rd cycles, the following was included. However, it was eliminated from Cycle 1. Rather, during Cycle 1, C reviewed stress and timing (phrasing) with the Ps.
• C sang the “Star Spangled Banner” using hand signals to signify rising or falling pitch.
• C explained to the Ps that in every day speech, pitch rises and falls, although not as much as for singing.
• C repeated a sentence she had produced at the beginning of the session, using hand signals to signify rising and falling pitches.
• C noted that actors decide to use rising and falling pitches based on their understanding of the lines in the script.
• C wrote a line from the script on the board and signified rising or falling pitch with symbols.
• C continued writing lines of the board. Each time, the group said the line slowly and a P drew lines indicating the proper intonation.
– During Cycle 3, C repeated sentences Ps spoke during snack time and linked the intonation pattern to a line in the script using hand signals to signify intonation patterns. C encouraged Ps to use the every day intonation patterns in their readings.
– Ps read aloud the script one time and then they read it with each P taking his/her part.
– C directed Ps to go into separate sections of the room and to practice reading aloud their own lines. C circulated among the Ps and provided corrective feedback.
– C then placed Ps in their respective places for the performance (Day 6) and the Ps read through their lines in turn.
• Day 6:
– Ps rehearsed the script before the performance.
– After the performance, P briefly debriefed.
– C administered the post test to P individually.
– ADDITIONAL RECOMMENDATIONS FOR CHANGES/INSIGHTS DERIVED FROM SYSTEMATIC OBSERVATIONS:
• Increase the number of days in a cycle to 7.
• Increase vocabulary work during comprehension instruction.
• Explicit attention to prosody (timing/phrasing, intonation, stress) is effective but it may be helpful to limit attention to a single feature per cycle.
• Cs might consider allowing a few weeks between each cycle to facilitate consolidation of gains.
• Modeling and visual cues (hand signal, written symbols) are useful in teaching about timing.
• One challenge associated with timing—For sentences that extended beyond a single line of script, some Ps tended to pause at the end of the line on the script. (C provided extra modeling and a reminder to pause only at slashes to deal with this issue.)
• Some of the students had trouble with stress, particularly function words.
• Visual cues for intonation were less successful than for stress and timing (phrasing). To deal with this. C adopted the music teacher’s strategy for signifying pitch in music. (See page 69.)