Forms for Collaboration

UPDATED: October 12, 2015

 

FORMS FOR COLLABORATION

The forms provided below are for analyzing and summarizing the literature concerned with prosodic intervention and nature of (impaired) prosody. The 5 forms are

#1. Analysis of single subject research

#2. Analysis of group research designs

#3. Analysis of secondary research such as meta analyses, systematic reviews, and narrative reviews.

#4. Critique of unsupported procedural descriptions. These are intervention descriptions for which no supporting evidence is provided.

#5: Analysis of comparison studies. [Usually, these are neither intervention nor diagnostic studies (Clinical Research), but rather they provide information relevant to clinical intervention or learning (Clinically Related), describe prosody disorders (Clinically Related), or the prosodic characteristics of clinical conditions (Clinically Related.)]

If you would like to submit an Intervention Analysis for a prosodic intervention,

  1. scroll down to the appropriate form,
  2. copy and save the appropriate form,
  3. complete the form (if possible save as a pdf), and
  4. email
  5. the completed form
  6. your name and email address

to patricia.hargrove@mnsu.edu

========================================================

FORM #1

 

EBP THERAPY ANALYSIS for

Single Subject Designs

 

(Hints for completing this form can be found in “Directions for the Use of Collaboration Forms” section of the Dashboard.)

 

NOTES:

  • The summary of the intervention procedure(s) can be viewed by scrolling about two-thirds of the way down on this page.

 

Key:

C = Clinician

EBP = evidence-based practice

NA = not applicable

P = Patient or Participant

pmh = Patricia Hargrove, blog developer

SLP = speech–language pathologist

 

SOURCE:

 

REVIEWER(S):

 

DATE:

ASSIGNED OVERALL GRADE:

 

TAKE AWAY:

                                                                                                           

                                                                                                           

 

  1. What was the focus of the research? (signify the focus by placing xxx after the appropriate focus)
  • Clinical Research
  • Clinically Related
  • Essential Research

 

 

  1. What type of evidence was identified?

2a What type of single subject design was used? (place xxx after the appropriate design)

  • Case Studies

– Program Description(s) with Case Illustration(s)

– Description of One Event

– Description with Pre and Post Test Results

  • Single Subject Experimental Design with Specific Client

– Multiple Baseline

– ABAB (withdrawal/reversal)

– Alternating Treatment

– Other

                                                                                                           

2b What was the level of support associated with the type of evidence?

Level = ______       

                                                                                                           

 

  1. Was phase of treatment concealed? (answer Yes, No, or Unclear to each of the questions)

3a from participants? Yes ______   No _______   Unclear _______

3b from clinicians? Yes ______   No _______   Unclear _______

3c from data analyzers? Yes ______   No _______   Unclear _______

 

 

  1. Were the participants (Ps) adequately described?

Yes ___   No ___   Unclear_______

 

4a How many Ps were involved in the study? List here:     

4b What the P characteristics/variables controlled or described?

– List characteristics CONTROLLED:

  • age:
  • gender:
  • cognitive skills
  • expressive language:
  • receptive language:
  • MLU:
  • SES:
  • educational level of participant:
  • educational level of parents:
  • Other (list):

– List characteristics DESCRIBED:

  • age:
  • gender:
  • cognitive skills
  • expressive language:
  • receptive language:
  • MLU:
  • SES:
  • educational level of participant:
  • educational level of parents:
  • Other (list):

                                                 

4c Were the communication problems adequately described?

Yes___   No ___   Unclear/Variable _________                      

  • List the disorder type(s):
  • List other aspects of communication that were described:

 

                                                                                                                       

  1. Was membership in treatment maintained throughout the study?                                Yes _____       No _____     Unclear ____   Not applicable _____

 

                

5a If there was more than one participant, did at least 80% of the participants remain in the study? Yes ___       No _____       Not applicable (NA) _____

5b Were any data removed from the study? Yes ___       No _____

Explain:

 

 

  1. Did the design include appropriate controls?

Yes _____           No _____         Unclear ____   Varied _____

                                                                      

6a Were baseline/preintervention data collected on all behaviors?

   Yes___     No ___      Data were Provided Only for Some Outcomes ____

 

6b Did probes/intervention data include untrained stimuli?

Yes ___     No ___    No Data were Provided _____

 

6c Did probes/intervention data include trained stimuli?

Yes ___     No ___   No Data were Provided _____

6d Was the data collection continuous? Yes___     No ___

6e Were different treatment counterbalanced or randomized?

 

       Yes____     No _____   NA ____

6f If “6e” was yes, describe here how it was matched (e.g., counterbalanced, randomized, or not matched.)

 

 

  1. Were the outcome measures appropriate and meaningful?

Yes _____      No _____       Unclear/Variable ____

 

7a List the outcome(s)/dependent variable(s) with a number:

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(continue numbering as needed)

7b List numbers of the outcomes that are subjective:                                               

 

7c List numbers of the outcomes that are objective:                                                 

 

7d List the number of the outcome measures that are associated with reliability data, the type of reliability data (e.g., interobserver reliability, intraobserver reliability), and the actual data: (Use the Outcome numbers from 7a.)

 

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(continue numbering as needed)

 

  1. Results:

 

8a Did the target behavior(s) improve when treated?

Yes, for the most part___       No, for the most part ____ Variable_____

8b For each of the outcomes, FROM YOUR POINT OF VIEW list the overall quality of improvement as strong, moderate, limited, ineffective, contraindicated:

 

[ • The outcomes numbers should match the numbers in item 7a.

  • In making this judgment, consider the information in Questions 7, 9, 10, 11, 12, 13.]
  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(continue numbering as needed)

  1. Description of baseline:

 

9a Were baseline data provided? Yes _____     No _____ Variable ________

                                               

— If yes, continue through item #9 and list the number of data points for each dependent variable/outcome.

If no, proceed to item #10.

— If variable, place xxx next to the Outcomes that are associated with baseline data and only be concerned with those outcomes in items 9b through 9d. (The outcome numbers should match the numbers in item 7a.)

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(continue numbering as needed)

 

9b Was baseline low (or high, as appropriate) and stable? (The outcome numbers should match the numbers in item 7a.)

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(continue numbering as needed)

                                                       

9c Was the percentage of nonoverlapping data (PND) provided?

Yes _____ No ________ Only for the following Outcomes ___________

— Proceed to item 10, if the answer to item 9c is NO.

 

9d What was the PND and what level of effectiveness does it suggest?

(The outcome numbers should match the numbers in item 7a. Note if there are insufficient data to calculate PND. The suggested interpretation of PND from Schlosser & Wendt, 2008, is

PND ≥ 90% = highly effective

PND = 70%-90% = fairly effective

PND – 50%-70% = questionable effectiveness

PND > 50% = unreliable/ineffective

 

OUTCOME #1:

OUTCOME #2:

OUTCOME #3:

(continue numbering as needed)

 

 

  1. What is the clinical significance(List outcome number with data with the appropriate Evidence Based Practice, EBP, measure.)

— If the magnitude is not provided, respond “NA ” next to the item 10 question.

 

If the magnitude is provided, list

  • the magnitude of treatment effect,
  • the measure used (e.g., Cohen’s d, number need to treat (NNT), eta, etc.),
  • the interpretation for each outcome using outcome numbers from item 7a.

 

(The interpretation can be the standard interpretation in the literature or the interpretation provided in the investigation.)

– OUTCOME #1:

  • magnitude of effect:
  • measure calculated:
  • interpretation:

– OUTCOME #2:

  • magnitude of effect:
  • measure calculated:
  • interpretation:

– OUTCOME #3:

  • magnitude of effect:
  • measure calculated:
  • interpretation:

(continue as needed)

 

 

  1. Was information about treatment fidelity adequate?
  • Yes ___       No ___     Not Provided _____
  • Describe support:

 

 

  1. Were maintenance data reported? Yes ____ No ______

If yes, summarize findings:

 

 

  1. Were generalization data reported? Yes ____ No ______

If yes, summarize findings:

 

 

  1. Brief description of the design:

 

 

 

ASSIGNED OVERALL GRADE OF THE QUALITY OF SUPPORT FOR THE INTERVENTION: _________

 

 

SUMMARY OF INTERVENTION

 

PURPOSE:

POPULATION:

 

MODALITY TARGETED:

 

ELEMENTS/FUNCTIONS OF PROSODY TARGETED (do not list the specific dependent variables here):

 

ELEMENTS OF PROSODY USED AS INTERVENTION (part of independent variable; list only if prosody is being used as a treatment technique with a nonprosodic outcome):

 

OTHER ASPECTS OF LANGUAGE/COMMUNICATION TARGETED (Dependent variable):

 

OTHER TARGETS:

DOSAGE:

 

ADMINISTRATOR:

 

STIMULI:

 

MAJOR COMPONENTS:

 

 

FORM #2

EBP THERAPY ANALYSIS

Treatment Groups

 

(Hints for completing this form can be found in “Directions for the Use of Collaboration Forms” section of the Dashboard.)

 

Note: Scroll about two-thirds of the way down the page to read the summary of the procedure(s).

 

Key:

C = Clinician

EBP = evidence-based practice

NA = not applicable

P = Patient or Participant

SLP = speech–language pathologist

 

 

SOURCE:

 

REVIEWER(S):

 

DATE:

ASSIGNED GRADE FOR OVERALL QUALITY:

 

TAKE AWAY:

 

 

  1. What type of evidence was identified?

                                                                                                           

1a What was the type of evidence? (place xxx after the appropriate design)

  • Randomized Clinical Trial
  • Systematic Review
  • Prospective, Randomized Group Design with Controls
  • Single Subject Experimental Design with Specific Client
  • Prospective, Nonrandomized Group Design with Controls?
  • Evidence-Based Clinical Practice Guidelines
  • Retrospective, Nonrandomized Group Design with Controls?
  • Prospective, Single Group with Pre- and Post-Testing
  • Retrospective, Single Group with Pre- and Post-Testing
  • Descriptive Research
  • Essential Research
  • Other: (List)

                                                                                                          

1b What was the level of support associated with the type of evidence?

Level = ____

 

                                                                                                           

  1. Group membership determination:

                                                                                                           

2a If there was more than one group, were participants (Ps) randomly assigned to groups?

Yes ____   No ____     Unclear ____       Not Applicable (NA) ______

2b If there were groups and Ps were not randomly assigned to groups, were members of groups carefully matched?

Yes ____     No ___     Unclear ____     NA _______

                                                                    

2c If the answer to 2a and 2b is ‘no’ or ‘unclear,’ describe the assignment strategy:

  1. Was administration of intervention status concealed?

                                                                                                           

3a from participants?        Yes ____     No _____ Unclear ____

                                                                    

3b from clinicians?            Yes ____       No _____       Unclear ____

                                                                    

3c from analyzers? Yes _____     No _____     unclear ____

                                                                    

 

  1. Were the groups adequately described?

Yes ___     No ___        Unclear___       Variable _______

 

4a       How many Ps were involved in the study?

  • total # of Ps:  
  • # of groups:
  • List names of groups and the # of participants in each group:

 

4b List the P characteristics that are controlled (i.e., inclusion/exclusion criteria) or described. Provide data for each characteristic.

CONTROLLED

  • age:
  • gender:
  • cognitive skills:
  • expressive language:
  • receptive language:
  • MLU:
  • Social Economic Status:
  • educational level of clients:
  • educational level of parents:
  • age at referral:
  • Other (list):

DESCRIBED:

  • age:
  • gender:
  • cognitive skills:
  • expressive language:
  • receptive language:
  • MLU:
  • Social-Economic Status:
  • educational level of clients:
  • educational level of parents:
  • age at referral:
  • Other (list):

 

4c   Were the groups similar before intervention began?

Yes ___     No ___     Unclear ____   NA ______

                                                         

4d Were the communication problems adequately described?

Yes ___     No ___     Unclear ____

  • disorder type: (List)
  • functional level
  • other (list)

 

 

  1. Was membership in groups maintained throughout the study?

                                                                                                             

5a Did each of the groups maintain at least 80% of their original members?

Yes ___     No ___     Unclear ____

                                                               

5b Were data from outliers removed from the study?

Yes ____     No _____     Unclear ____

 

 

  1. Were the groups controlled acceptably?

Yes _____       No _____      Unclear ____      NA_____

 

NOTE: If there was only one group, go to #7.

                                                                                                             

6a Was there a no intervention group?

Yes ___     No ___     Unclear ___    

                                   

6b Was there a foil intervention group?

Yes ___     No ___     Unclear ____

                                   

6c Was there a comparison group?

Yes ___     No ___     Unclear ____

6d Was the time involved in the foil/comparison and the target groups constant? Yes ___     No ___     Unclear ____     NA _______

 

 

  1. Were the outcomes measure appropriate and meaningful?

Yes _____       No _____       Unclear ____   Variable ___________

 

                                                                                                             

7a List outcomes (dependent variables):

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(add additional outcomes as appropriate)

7b List the outcome measures (using outcome numbers from item 7a) that are subjective:

 

 

7c List the outcome measures (using outcome numbers form item 7a) that are objective?

 

                                         

 

  1. Were reliability measures provided?

                                                                                                            

8a Interobserver for analyzers?

Yes ___     No ___     Unclear ____     Variable _____

If Yes or Variable, list the interobserver reliability associated with the appropriate outcomes:

 

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(add additional outcomes as appropriate)

 

8b Intraobserver for analyzers?

Yes ___     No ___     Unclear ____ Variable ______

If Yes or Variable, list intraobserver reliability associated each outcome/variable:

 

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(add additional outcomes as appropriate)

 

8c Treatment fidelity for clinicians? Yes ___     No ___     Unclear ____

  • If yes, describe

 

 

 

  1. What were the results of the statistical (inferential) testing and/or the description of the results?

9a Summary Of Important Results

 

— What level of significance was required to claim significance? p = _______

Directions:

  • If the investigators compared any groups (e.g., treatment vs no treatment, treatment vs foil, treatment vs comparison) report the findings in the section labeled: Treatment And Foil/Comparison/No Treatment Group Analyses. Use this section to report results even the investigators ALSO report pre and post results.
  • If the investigators ONLY report pre and post test analyses (or only post test analyses), report the finding in the section labeled: Pre And Post Treatment Only Analyses.
  • If the investigators ONLY use descriptive statistics, in response to the question about significance level (What level of significance will be required to claim significance?) write the following: “only descriptive statistics were provided.” Then, follow the 2 bullets above for directions about where to list findings.

TREATMENT AND FOIL/COMPARISON/NO TREATMENT GROUP ANALYSES

For each outcome,

– list any significant difference among comparisons or

– in the case of the use of descriptive statistics only, list any notable differences or trends.

OUTCOME #1:

OUTCOME #2:

OUTCOME #3:

 

(Continue for all outcomes; the outcome numbers should match the outcomes in item #7.)

PRE AND POST TREATMENT ONLY ANALYSES

For each outcome,

– list any significant difference among comparisons or

– in the case of the use of descriptive statistics only, list any notable differences or trends.

OUTCOME #1:

OUTCOME #2:

OUTCOME #3:

 

(Continue for all outcomes; the outcome numbers should match the outcomes in item #7.)

9b What was the statistical test used to determine significance? Place xxx after any statistical test that was used to determine significance. Write NA, if only descriptive statistics were used

  • t-test:
  • ANOVA:
  • Mann-Whitney U:
  • Wilcoxon:
  • Other: (List the test)

 

9c Were confidence interval (CI) provided? Yes ___         No _____

 

9d If the answer to 9c was yes, list the outcome number (from item 7a) associated with the reported confidence interval (CI):

  • 98% CI:
  • 95% CI:
  • 90%
  • Other (List CI%):
  1. What is the clinical significance(List outcome number with data with the appropriate Evidence Based Practice, EBP, measure.)

10a  Place xxx next to the EBP measure provided:

  • Standardized Mean Difference: 

 

  • Effect Size Correlation: 

 

  • Number Needed to Treat:

 

  • ETA: 

 

  • r2: 

 

  • other (List ):

10b Results of EBP testing and the interpretation:

DIRECTION: Next to the appropriate Outcome(s) list the name of the EBP measure, the result of the testing, and the interpretation (e.g., Large/Strong, Moderate, Small/Negligible, No Effect, Negative) using either the investigators’ interpretations or standard guidelines to EBP measures.

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

 

(add additional outcomes as appropriate)

 

  1. Were maintenance data reported? Yes ____ No ______

If yes, summarize findings:

 

  1. Were generalization data reported?

Yes ____     No _____     Not clear _____

If yes, summarize findings

 

 

  1. Describe briefly the experimental design of the investigation.

 

 

 

ASSIGNED OVERALL GRADE FOR QUALITY OF EXTERNAL EVIDENCE: _____

 

 

 

SUMMARY OF INTERVENTION

 

PURPOSE:

POPULATION:

 

MODALITY TARGETED:

 

ELEMENTS/FUNCTIONS OF PROSODY TARGETED (do not list the specific dependent variables here):

 

ELEMENTS OF PROSODY USED AS INTERVENTION (part of independent variable; list only if prosody is being used as a treatment technique with a nonprosodic outcome):

 

OTHER ASPECTS OF LANGUAGE/COMMUNICATION TARGETED (Dependent variable):

 

OTHER TARGETS:

DOSAGE:

 

ADMINISTRATOR:

 

STIMULI:

 

MAJOR COMPONENTS:

 

_______________________________________________________________

FORM #3

SECONDARY REVIEW CRITIQUE

 

(Hints for completing this form can be found in “Directions for the Use of Collaboration Forms” section of the Dashboard.)

KEY:

C = clinician

NA = not applicable

P = patient or participant

SLP = speech-language pathologist

SR = Systematic Review

 

Source:

 

Reviewer(s):

 

Date:

 

Overall Assigned Grade:

 

Level of Evidence:

 

Take Away:

 

What type of secondary review? (place xxx next to the type of secondary review)

  • Narrative Review
  • Narrative Systematic Review
  • Classic Systematic Review
  • Meta Analysis
  • Other (list the name of the type of secondary review)

 

 

  1. Were the results valid? Yes ___ No ___   Unclear/Variable ___

 

1a Was the review based on a clinically sound clinical question?

Yes ___     No ___     Unclear/variable ____

 

1b Did the reviewers clearly describe reasonable criteria for inclusion and exclusion of literature in the review (i.e., sources)?

Yes ___     No ___   Unclear/Variable ___

1c The authors of the secondary research noted that they reviewed the following resources: (place xxx next to the appropriate resources)

  • abstracts from conferences
  • conference proceedings
  • experts                            
  • funding agencies
  • hand searches
  • internet based databases  
  • personal files
  • references from identified literature
  • registries
  • theses/dissertations
  • traditional databases
  •  other sources (list):
  • Mark with xxx if the authors of the secondary research did not describe the search strategy _______

 

1d Did the sources involve only English language publications?

Yes ___     No ___     Unclear/Variable ___

 

1e Did the sources include unpublished studies?

Yes ___     No ___     Unclear/Variable ___

 

1f Was the time frame for the publication of the sources sufficient?

Yes __     No ___     Unclear/Variable ___

1g Did the authors of the secondary research identify the level of evidence of the sources?

Yes ___     No ___     Unclear/Variable ___

 

1h Did the authors of the secondary research describe procedures used to evaluate the validity of each of the sources?

Yes ___     No _x__     Unclear/Variable ___

 

1i Was there evidence that a specific, predetermined strategy was used to evaluate the sources?

Yes ___     No _x__     Unclear/Variable

1j Did the authors of the secondary research or review teams rate the sources independently?

Yes ___     No _x__     Unclear/Variable            ___

1k Were interrater reliability data provided?

Yes ___     No ___     Unclear/Variable  ___

1l If the authors of the secondary research provided interrater reliability data, list the data here:  _____________________________________________________

 

1m If there were no interrater reliability data, was an alternate means to insure reliability described?

Yes ___     No ___     Unclear/Variable  ___ Not Applicable (NA) ___

1n Were assessments of sources sufficiently reliable?

Yes ___     No ___     Unclear/Variable ________    NA______

  1. Was the information provided sufficient for the reader to undertake a replication?

Yes ___     No ___     Unclear/Variable  ___   NA ______

 

1p Did the sources that were evaluated involve a sufficient number of participants?

Yes ___     No ___     Unclear/Variable  ___

 

  1. Were there a sufficient number of sources?

Yes ___     No ___     Unclear/Variable  ___

  1. Description of outcome measures:

List only the outcome measure(s) of interest to the prosody.

  • Outcomes #1:
  • Outcome #2:
  • Outcome #3:
  • Outcome #4:

 

(add additional outcome numbers if necessary):

 

 

  1. Description of results:

3a What measures were used to represent the magnitude of the treatment/effect size? (Place a xxx next to all that apply)

  • standardized mean difference (d)
  • number needed to treat (NNT)
  • effect size correlation (rxy)
  • relative success rate (RSR)
  • other (list)
  • No measure of the magnitude of the treatment effect/effect size were reported

3b Summarize overall findings of the secondary research:

 

3c Were the results precise?

Yes ___     No ___     Unclear/Variable ___

3d If confidence intervals were provided in the sources, did the reviewers consider whether evaluations would have varied if the “true” value of metrics were at the upper or lower boundary of the confidence interval?

Yes ___     No ___    Unclear/Variable ___   NA ___

3e Were the results of individual studies clearly displayed/presented?

Yes ___     No ___     Unclear/Variable ___

3f For the most part, were the results similar from source to source?

Yes ___     No ___     Unclear/Variable ___

 

3g Were the results in the same direction?

Yes ___     No ___     Unclear/Variable ___

 

3h Did a forest plot indicate homogeneity?

Yes ___     No ___     Unclear/Variable ___     NA ___

 

3i Was heterogeneity of results explored?

Yes ___     No ___     Unclear/Variable ___

 

3j Were the findings reasonable in view of the current literature?

Yes ___     No ___     Unclear/Variable ___

3k Were negative outcomes noted?

Yes ___     No ___     Unclear/Variable ___

           

                                                                                                                   

  1. Were maintenance data reported? Yes ____ No ______

If yes, summarize findings:

 

 

  1. Were generalization data reported? Yes ____ No ___x___

If yes, summarize findings:

 

 

 

SUMMARY OF INTERVENTION

 

NOTE:

[ Reviewers should only complete this section if sufficient information is provided in the review to describe treatment procedure(s).]

For each procedure detailed in the secondary review , provide the following information:

 

 

Population:

 

Prosodic Targets:

Nonprosodic Targets:

Aspects of Prosody Used in Treatment of Nonprosodic Targets:

Description of Procedure/Source #1—(provide title)

 

 

 

Evidence Supporting Procedure/Source #1—(provide title)

 

 

 

Evidence Contraindicating Procedure/Source #1—(provide title)

 

Continue the above for each of the procedures/articles reviewed in the secondary review

 

 

————————————————————————————————————

FORM #4

CRITIQUE OF UNSUPPORTED PROCEDURAL DESCRIPTIONS

(also known as Expert Opinion)

NOTE: Hints for completing this form can be found in “Directions for the Use of Collaboration Forms” section of the Dashboard.

KEY
C = clinician

NA = not applicable

P = patient or participant

pmh = Patricia Hargrove, blog developer

SLP = speech-language pathologist

 

Source:

 

Reviewer(s):

 

Date:

 

Overall Assigned Grade (because there are no supporting data, the highest grade will be F)   ________________

 

Level of Evidence: F = Expert Opinion, no supporting evidence for the effectiveness of the intervention although the author may provide secondary evidence supporting components of the intervention.

 

Take Away:

 

 

  1. Was there a review of the literature supporting components of the intervention?  Yes ______   No ________

– If there was a review of the literature, place xxx next to the type of literature review: (hint, in most cases it will be a Narrative Review)

  • Narrative Review
  • Narrative Systematic Review
  • Classic Systematic Review
  • Meta Analysis
  • Other

 

 

  1. Were the specific procedures/components of the intervention tied to the reviewed literature? Yes ___ No ___   Unclear/Variable ___

 

 

  1. Was the intervention based on clinically sound clinical procedures?

Yes ___     No ___     Unclear/variable ____

 

  1. Did the author(s) provide a rationale for components of the intervention? Yes ___     No ___     Unclear/variable ____

Optional Comments:

  1. Description of outcome measures:

 

5a Are outcome measures suggested?

Yes ___     No ___     Unclear/variable ____

 

5b If there are outcome measures, list them here.

  • Outcome #1:
  • Outcome #2:
  • Outcome #3:
  • Outcome #4:

 

(add additional outcomes numbers,{ if necessary):

 

  1. Was generalization addressed? Yes ____ No ______

If yes, describe:

 

 

  1. Was maintenance addressed? Yes ____ No ______

If yes, describe:

 

 

SUMMARY OF INTERVENTION

 

(NOTE: Only complete this portion of the form if the publication was about intervention/therapy)

 

 

PURPOSE:

POPULATION:

 

MODALITY TARGETED:

 

ELEMENTS/FUNCTIONS OF PROSODY TARGETED (do not list the specific outcomes here):

 

ELEMENTS OF PROSODY USED AS INTERVENTION (list only if prosody is being used as a treatment technique with a nonprosodic outcome):

OTHER ASPECTS OF LANGUAGE/COMMUNICATION TARGETED:

 

OTHER TARGETS:

DOSAGE:

 

ADMINISTRATOR:

 

STIMULI:

 

MAJOR COMPONENTS:

 

 

=========================================================

 

 

FORM #5

ANALYSIS GUIDELINES

Comparison Research

 

NOTES:

  • Hints for completing this form can be found in “Directions for the Use of Collaboration Forms” section of the Dashboard.)
  • Use this form when the focus of the intervention is not on intervention. Accordingly, no summary of intervention is included in the review.

 

 

KEY:

 

eta =   partial eta squared

MLU = mean length of utterance

NA = Not Applicable

P = participant or patient

pmh = Patricia Hargrove, blog developer

SLP = speech-language pathologist

 

 

SOURCE:

 

REVIEWER(S):

DATE:

 

ASSIGNED GRADE FOR OVERALL QUALITY:

 

TAKE AWAY:

 

 

  1. What type of evidence was identified?

                                                                                                           

1a What was the type of design? place xxx after the appropriate design(s)

 

DIRECTIONS: Place xxx after the appropriate design(s)

  • Comparison Research
  • Correlational Research
  • Descriptive Research
  • Developmental Research
  • Evidence-Based Clinical Practice Guidelines
  • Prospective, Nonrandomized Group Design with Controls
  • Prospective, Randomized Group Design with Controls
  • Prospective, Single Group with Pre- and Post-Testing
  • Retrospective, Nonrandomized Group Design with Controls
  • Retrospective, Single Group with Pre- and Post-Testing
  • Single Subject Experimental Design with Specific Partiicpant
  • Systematic Review
  • Other: (List)

1b What was the focus of the research?

 

DIRECTION: Place xxx after the appropriate focus

 

  • Clinical Research
  • Clinically Related
  • Essential Research

                                                                                                           

1c What was the level of support associated with the type of evidence? Level = ____

 

                                                                                                           

  1. Group membership determination:

                                                                                                           

2a If there were groups, were participants randomly assigned to groups?          

Yes ____   No ____   Unclear ____     Not Applicable (NA) ______

2b If there were groups and Ps were not randomly assigned to groups, were members of groups carefully matched?

Yes ____    No ___     Unclear ____      NA _______

                                                                    

  1. Were experimental conditions concealed?

                                                                                                           

3a from participants?

Yes ____     No _____ Unclear ____

                                                                    

3b from administrators of experimental conditions?

Yes ____      No _____       Unclear ____

                                                                    

3c from analyzers/judges?           Yes _____     No _____     unclear ____

                                                                    

 

  1. Were the groups adequately described?

 

Yes ___     No ___     Unclear___     Variable __________

 

4a   How many participants were involved in the study?

  • total # of Ps:
  • # of groups:
  • List names of groups and the number of Ps in each group:
  • Did all groups maintain membership throughout the investigation?  

Yes ____   No   _____   Unclear _________

 

                                                                                

4b List the controlled (i.e., inclusion/exclusion criteria) or described participant characteristics. Provide raw or summary data for each of the characteristics noted in the investigation.

CONTROLLED CHARACTERISTICS                                                     

  • age:
  • gender:
  • cognitive skills:
  • expressive language:
  • receptive language:
  • MLU:
  • Socio-economic status:
  • educational level of clients:
  • educational level of parents:
  • age at referral:
  • Physical, motor, emotional skill:
  • Hearing:
  • Vision:
  • Other (List):

DESCRIBED CHARACTERISTICS

  • age:
  • gender:
  • cognitive skills:
  • expressive language:
  • receptive language:
  • MLU:
  • Socio-economic status:
  • educational level of clients:
  • educational level of parents:
  • age at referral:
  • Physical, motor, emotional skill:
  • Hearing:
  • Vision:
  • Other (List):

 

 

4c Were the groups similar?

Yes ___     No ___     Unclear ____   NA ______  

                                                         

4d Were the communication problems adequately described?

Yes ___     No ___     Unclear ____

  • disorder type: (List)
  • functional level
  • other (list)

 

 

  1. What were the different conditions for this research?

                                                                                                             

5a Subject (Classification) Groups?

Yes ___     No ___     Unclear ____

If yes, list:

                                                               

5b Experimental Conditions?     

Yes ____     No _____     Unclear ____

If yes, list conditions, and in parentheses, levels within each condition:

 

5c Criterion/Descriptive Conditions?

Yes ___     No ___     Unclear ____

If yes, list:

 

  1. Were the groups controlled acceptably?

Yes ___     No ___     Unclear ___     Not Applicable ____

 

 

  1. Were dependent measures appropriate and meaningful?

Yes ___     No ___     Unclear ___     Not Applicable ____

 

                                                                                                             

7a List dependent measures:

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(add additional outcomes as appropriate)

7b List the dependent measures (using numbers from item 7a) that are subjective:

 

 

7c. List the dependent/ outcome measures (using numbers form item 7a) that are objective?

 

 

  1. Were reliability measures provided?

                                                                                                            

8a Interobserver for analyzers? Yes ___     No ___     Unclear ____

If yes, list interobserver reliability of each outcome/variable:

 

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(add additional outcomes as appropriate)

 

 

8b Intraobserver for analyzers?   Yes ___     No ___     Unclear ____

If yes, list intraobserver reliability of each outcome/variable:

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(add additional outcomes as appropriate)

 

8c Treatment or test administration fidelity for investigators?

Yes ___     No ___     Unclear ____

  • If yes, describe:

 

 

 

  1. Description of design: (briefly describe)

 

 

 

  1. What were the results of the statistical (inferential) testing?

 

10a List comparisons that are significant (e.g., p ≤ 0.05). For each outcome, list any significant difference among comparisons or in the case of the use of descriptive statistics only, list any notable differences or trends. Note if you do not use ≤ 0.05 as your criterion.

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(add additional outcomes as appropriate)

10b What was the statistical test used to determine significance? Place xxx after any inferential statistical test used in the investigation.

  • t-test:
  • ANOVA:
  • MANOVA:
  • Tukey:
  • Mann-Whitney U:
  • Wilcoxan:
  • Other: (List the test and the associated outcomes)

10c Were effect sizes provided?

Yes ____ No____

If yes, provide data and interpretation for any outcome with effect size results.

Interpretation Hints:

Cohen’s (1988) guidelines for interpreting standardized mean difference: d = .20 small treatment effect; d = .50 moderate treatment effect; d = .80 large treatment effect

– for partial eta squared (eta): .01 small, .06 is medium, and .14 is large.

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(add additional outcomes as appropriate)

 

10d Were confidence interval (CI) provided? Yes ___         No ____

 

10e If the answer to 10d was yes, list the dependent measure (from item 7a) associated with the reported confidence interval (CI):

  • 98% CI:
  • 95% CI:
  • 90%
  • Other (List CI%):

 

 

  1. Summary of correlational results:

For any outcomes associated with correlational statistics, list the following:

  • The name of the correlational test
  • The correlational data
  • The interpretation of the correlation

 

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

 

(add other outcomes as appropriate)

 

 

  1. Summary of descriptive results: Qualitative research

DIRECTIONS:

– Complete this item only if the investigation was solely or primarily Qualitative in nature.

– List the finding associated with each of the outcomes listed in item 7a.

  • OUTCOME #1:
  • OUTCOME #2:
  • OUTCOME #3:

(add other outcomes as appropriate)

  1. Brief summary of clinically relevant results:

 

 

ASSIGNED GRADE FOR QUALITY OF EXTERNAL EVIDENCE: _____

 

 

 

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: