Posted on 5 Comments

APD Update: New Developments on an Old Controversy

In the past two years, I wrote a series of research-based posts (HERE and HERE) regarding the validity of (Central) Auditory Processing Disorder (C/APD) as a standalone diagnosis as well as questioned the utility of it for classification purposes in the school setting.

Once again I want to reiterate that I was in no way disputing the legitimate symptoms (e.g., difficulty processing language, difficulty organizing narratives, difficulty decoding text, etc.), which the students diagnosed with “CAPD” were presenting with.

Rather, I was citing research to indicate that these symptoms were indicative of broader linguistic-based deficits, which required targeted linguistic/literacy-based interventions rather than recommendations for specific prescriptive programs (e.g., CAPDOTS, Fast ForWord, etc.),  or mere accommodations.

I was also significantly concerned that overfocus on the diagnosis of (C)APD tended to obscure REAL, language-based deficits in children and forced SLPs to address erroneous therapeutic targets based on AuD recommendations or restricted them to a receipt of mere accommodations rather than rightful therapeutic remediation. Continue reading APD Update: New Developments on an Old Controversy

Posted on Leave a comment

Review and Giveaway of Strategies by Numbers (by SPELL-Links)

Today I am reviewing a fairly recently released (2014) book from the Learning By Design, Inc. team entitled SPELL-Links Strategies by Numbers.   This 57 page instructional guide was created to support the implementation of the SPELL-Links to Reading and Writing Word Study Curriculum as well as to help students “use the SPELL-Links strategies anytime in any setting.’ (p. iii) Its purpose is to enable students to strategize their way to writing and reading rather than overrelying on memorization techniques.

SPELL-Links Strategies by Numbers contains in-depth explanations of SPELL-Links’ 14 strategies for spelling and reading, detailed instructions on how to teach the strategies during writing and reading activities, as well as helpful ideas for supporting students as they further acquire literacy skills.  It can be used by a wide array of professionals including classroom teachers, speech-language pathologists, reading improvement teachers, learning disabilities teachers, aides, tutors, as well as parents for teaching word study lessons or as carryover and practice during reading and writing tasks.

The author includes a list of key terms used in the book as well as a guide with instructional icons screen-shot-2016-09-24-at-10-57-10-amscreen-shot-2016-09-24-at-10-56-46-am

The goal of the 14 strategies listed in the book is to build vocabulary, improve spelling, word decoding, reading fluency, and reading comprehension as well as improve students’ writing skills. While each strategy is presented in isolation under its own section, the end result is for students to fully integrate and apply multiple strategies when reading or writing.

Here’s the list of the 14 strategies in order of appearance as applied to spelling and reading:

  1. Sound It Out
  2. Check the Order
  3. Catch the Beat
  4. Listen Up
  5. A Little Stress Will Help This Mess
  6. No Fouls
  7. Play By the Rules
  8. Use Rhyme This Time
  9. Spell What You Mean and Mean What You Spell
  10. Be Smart About Word Parts
  11. Build on the Base
  12. Invite the Relatives
  13. Fix the Funny Stuff
  14. Look It Up

Each strategy includes highly detailed implementation instructions with students including pictorial support as well as both instructor and student guidance for practice at various levels during writing and reading tasks.  At the end of the book all the strategies are succinctly summarized in handy table, which is also provided to the user separately as a double sided one page insert printed on reinforced paper to be used as a guide when the book is not handy.

There are a number of things I like about the book. Firstly, of course it is based on the latest research in reading, writing, and spelling. Secondly, clinicians can use it the absence  of SPELL-Links to Reading and Writing Word Study Curriculum since the author’s purpose was to have the students  “use the SPELL-Links strategies anytime in any setting.’ (p. iii).  Thirdly, I love the fact that the book is based on the connectionist research model, which views spelling and reading as a “dynamic interplay of phonological, orthographic, and semantic knowledge.” (iii). Consequently, the listed strategies focus on simultaneously developing and strengthening phonological, orthographic, semantic and morphological knowledge during reading and writing tasks.

You can find this book for purchase on the Learning By Design, Inc. Store HERE. Finally, due to the generosity of Jan Wasowicz  PhD the book’s author, you can enter my Rafflecopter giveaway below for a chance to win your own copy!

 

 

a Rafflecopter giveaway

Posted on 17 Comments

Review of the Test of Integrated Language and Literacy (TILLS)

The Test of Integrated Language & Literacy Skills (TILLS) is an assessment of oral and written language abilities in students 6–18 years of age. Published in the Fall 2015, it is  unique in the way that it is aimed to thoroughly assess skills  such as reading fluency, reading comprehension, phonological awareness,  spelling, as well as writing  in school age children.   As I have been using this test since the time it was published,  I wanted to take an opportunity today to share just a few of my impressions of this assessment.

               

First, a little background on why I chose to purchase this test  so shortly after I had purchased the Clinical Evaluation of Language Fundamentals – 5 (CELF-5).   Soon after I started using the CELF-5  I noticed that  it tended to considerably overinflate my students’ scores  on a variety of its subtests.  In fact,  I noticed that unless a student had a fairly severe degree of impairment,  the majority of his/her scores  came out either low/slightly below average (click for more info on why this was happening HERE, HEREor HERE). Consequently,  I was excited to hear regarding TILLS development, almost simultaneously through ASHA as well as SPELL-Links ListServe.   I was particularly happy  because I knew some of this test’s developers (e.g., Dr. Elena Plante, Dr. Nickola Nelson) have published solid research in the areas of  psychometrics and literacy respectively.

According to the TILLS developers it has been standardized for 3 purposes:

  • to identify language and literacy disorders
  • to document patterns of relative strengths and weaknesses
  • to track changes in language and literacy skills over time

The testing subtests can be administered in isolation (with the exception of a few) or in its entirety.  The administration of all the 15 subtests may take approximately an hour and a half, while the administration of the core subtests typically takes ~45 mins).

Please note that there are 5 subtests that should not be administered to students 6;0-6;5 years of age because many typically developing students are still mastering the required skills.

  • Subtest 5 – Nonword Spelling
  • Subtest 7 – Reading Comprehension
  • Subtest 10 – Nonword Reading
  • Subtest 11 – Reading Fluency
  • Subtest 12 – Written Expression

However,  if needed, there are several tests of early reading and writing abilities which are available for assessment of children under 6:5 years of age with suspected literacy deficits (e.g., TERA-3: Test of Early Reading Ability–Third Edition; Test of Early Written Language, Third Edition-TEWL-3, etc.).

Let’s move on to take a deeper look at its subtests. Please note that for the purposes of this review all images came directly from and are the property of Brookes Publishing Co (clicking on each of the below images will take you directly to their source).

TILLS-subtest-1-vocabulary-awareness1. Vocabulary Awareness (VA) (description above) requires students to display considerable linguistic and cognitive flexibility in order to earn an average score.    It works great in teasing out students with weak vocabulary knowledge and use,   as well as students who are unable to  quickly and effectively analyze  words  for deeper meaning and come up with effective definitions of all possible word associations. Be mindful of the fact that  even though the words are presented to the students in written format in the stimulus book, the examiner is still expected to read  all the words to the students. Consequently,  students with good vocabulary knowledge  and strong oral language abilities  can still pass this subtest  despite the presence of significant reading weaknesses. Recommendation:  I suggest informally  checking the student’s  word reading abilities  by asking them to read of all the words, before reading all the word choices to them.   This way  you can informally document any word misreadings  made by the student even in the presence of an average subtest score.

TIILLS-subtest-2-phonemic-awareness

2. The Phonemic Awareness (PA) subtest (description above) requires students to  isolate and delete initial sounds in words of increasing complexity.  While this subtest does not require sound isolation and deletion in various word positions, similar to tests such as the CTOPP-2: Comprehensive Test of Phonological Processing–Second Edition  or the The Phonological Awareness Test 2 (PAT 2)  it is still a highly useful and reliable measure of  phonemic awareness (as one of many precursors to reading fluency success).  This is especially because after the initial directions are given, the student is expected to remember to isolate the initial sounds in words without any prompting from the examiner.  Thus,  this task also  indirectly tests the students’ executive function abilities in addition to their phonemic awareness skills.

TILLS-subtest-3-story-retelling

3. The Story Retelling (SR) subtest (description above) requires students to do just that retell a story. Be mindful of the fact that the presented stories have reduced complexity. Thus, unless the students possess  significant retelling deficits, the above subtest  may not capture their true retelling abilities. Recommendation:  Consider supplementing this subtest  with informal narrative measures. For younger children (kindergarten and first grade) I recommend using wordless picture books to perform a dynamic assessment of their retelling abilities following a clinician’s narrative model (e.g., HERE).  For early elementary aged children (grades 2 and up), I recommend using picture books, which are first read to and then retold by the students with the benefit of pictorial but not written support. Finally, for upper elementary aged children (grades 4 and up), it may be helpful for the students to retell a book or a movie seen recently (or liked significantly) by them without the benefit of visual support all together (e.g., HERE).

TILLS-subtest-4-nonword-repetition

4. The Nonword Repetition (NR) subtest (description above) requires students to repeat nonsense words of increasing length and complexity. Weaknesses in the area of nonword repetition have consistently been associated with language impairments and learning disabilities due to the task’s heavy reliance on phonological segmentation as well as phonological and lexical knowledge (Leclercq, Maillart, Majerus, 2013). Thus, both monolingual and simultaneously bilingual children with language and literacy impairments will be observed to present with patterns of segment substitutions (subtle substitutions of sounds and syllables in presented nonsense words) as well as segment deletions of nonword sequences more than 2-3 or 3-4 syllables in length (depending on the child’s age).

TILLS-subtest-5-nonword-spelling

5. The Nonword Spelling (NS) subtest (description above) requires the students to spell nonwords from the Nonword Repetition (NR) subtest. Consequently, the Nonword Repetition (NR) subtest needs to be administered prior to the administration of this subtest in the same assessment session.  In contrast to the real-word spelling tasks,  students cannot memorize the spelling  of the presented words,  which are still bound by  orthographic and phonotactic constraints of the English language.   While this is a highly useful subtest,  is important to note that simultaneously bilingual children may present with decreased scores due to vowel errors.   Consequently,  it is important to analyze subtest results in order to determine whether dialectal differences rather than a presence of an actual disorder is responsible for the error patterns.

TILLS-subtest-6-listening-comprehension

6. The  Listening Comprehension (LC) subtest (description above) requires the students to listen to short stories  and then definitively answer story questions via available answer choices, which include: “Yes”, “No’, and “Maybe”. This subtest also indirectly measures the students’ metalinguistic awareness skills as they are needed to detect when the text does not provide sufficient information to answer a particular question definitively (e.g., “Maybe” response may be called for).  Be mindful of the fact that because the students are not expected to provide sentential responses  to questions it may be important to supplement subtest administration with another listening comprehension assessment. Tests such as the Listening Comprehension Test-2 (LCT-2), the Listening Comprehension Test-Adolescent (LCT-A),  or the Executive Function Test-Elementary (EFT-E)  may be useful  if  language processing and listening comprehension deficits are suspected or reported by parents or teachers. This is particularly important  to do with students who may be ‘good guessers’ but who are also reported to present with word-finding difficulties at sentence and discourse levels. 

TILLS-subtest-7-reading-comprehension

7. The Reading Comprehension (RC) subtest (description above) requires the students to  read short story and answer story questions in “Yes”, “No’, and “Maybe”  format.   This subtest is not stand alone and must be administered immediately following the administration the Listening Comprehension subtest. The student is asked to read the first story out loud in order to determine whether s/he can proceed with taking this subtest or discontinue due to being an emergent reader. The criterion for administration of the subtest is making 7 errors during the reading of the first story and its accompanying questions. Unfortunately,  in my clinical experience this subtest  is not always accurate at identifying children with reading-based deficits.

While I find it terrific for students with severe-profound reading deficits and/or below average IQ, a number of my students with average IQ and moderately impaired reading skills managed to pass it via a combination of guessing and luck despite being observed to misread aloud between 40-60% of the presented words. Be mindful of the fact that typically  such students may have up to 5-6  errors during the reading of the first story. Thus, according to administration guidelines these students will be allowed to proceed and take this subtest.  They will then continue to make text misreadings  during each story presentation (you will know that by asking them to read each story aloud vs. silently).   However,  because the response mode is in definitive (“Yes”, “No’, and “Maybe”) vs. open ended question format,  a number of these students  will earn average scores by being successful guessers. Recommendation:  I highly recommend supplementing the administration of this subtest with grade level (or below grade level) texts (see HERE and/or HERE),  to assess the student’s reading comprehension informally.

I present a full  one page text to the students and ask them to read it to me in its entirety.   I audio/video record  the student’s reading for further analysis (see Reading Fluency section below).   After the  completion of the story I ask  the student questions with a focus on main idea comprehension and vocabulary definitions.   I also ask questions pertaining to story details.   Depending on the student’s age  I may ask them  abstract/ factual text questions with and without text access.  Overall, I find that informal administration of grade level (or even below grade-level) texts coupled with the administration of standardized reading tests provides me with a significantly better understanding of the student’s reading comprehension abilities rather than administration of standardized reading tests alone.

TILLS-subtest-8-following-directions

8. The Following Directions (FD) subtest (description above) measures the student’s ability to execute directions of increasing length and complexity.  It measures the student’s short-term, immediate and working memory, as well as their language comprehension.  What is interesting about the administration of this subtest is that the graphic symbols (e.g., objects, shapes, letter and numbers etc.) the student is asked to modify remain covered as the instructions are given (to prevent visual rehearsal). After being presented with the oral instruction the students are expected to move the card covering the stimuli and then to executive the visual-spatial, directional, sequential, and logical if–then the instructions  by marking them on the response form.  The fact that the visual stimuli remains covered until the last moment increases the demands on the student’s memory and comprehension.  The subtest was created to simulate teacher’s use of procedural language (giving directions) in classroom setting (as per developers).

TILLS-subtest-9-delayed-story-retelling

9. The Delayed Story Retelling (DSR) subtest (description above) needs to be administered to the students during the same session as the Story Retelling (SR) subtest, approximately 20 minutes after the SR subtest administration.  Despite the relatively short passage of time between both subtests, it is considered to be a measure of long-term memory as related to narrative retelling of reduced complexity. Here, the examiner can compare student’s performance to determine whether the student did better or worse on either of these measures (e.g., recalled more information after a period of time passed vs. immediately after being read the story).  However, as mentioned previously, some students may recall this previously presented story fairly accurately and as a result may obtain an average score despite a history of teacher/parent reported  long-term memory limitations.  Consequently, it may be important for the examiner to supplement the administration of this subtest with a recall of a movie/book recently seen/read by the student (a few days ago) in order to compare both performances and note any weaknesses/limitations.

TILLS-subtest-10-nonword-reading

10. The Nonword Reading (NR) subtest (description above) requires students to decode nonsense words of increasing length and complexity. What I love about this subtest is that the students are unable to effectively guess words (as many tend to routinely do when presented with real words). Consequently, the presentation of this subtest will tease out which students have good letter/sound correspondence abilities as well as solid orthographic, morphological and phonological awareness skills and which ones only memorized sight words and are now having difficulty decoding unfamiliar words as a result.      TILLS-subtest-11-reading-fluency

11. The Reading Fluency (RF) subtest (description above) requires students to efficiently read facts which make up simple stories fluently and correctly.  Here are the key to attaining an average score is accuracy and automaticity.  In contrast to the previous subtest, the words are now presented in meaningful simple syntactic contexts.

It is important to note that the Reading Fluency subtest of the TILLS has a negatively skewed distribution. As per authors, “a large number of typically developing students do extremely well on this subtest and a much smaller number of students do quite poorly.”

Thus, “the mean is to the left of the mode” (see publisher’s image below). This is why a student could earn an average standard score (near the mean) and a low percentile rank when true percentiles are used rather than NCE percentiles (Normal Curve Equivalent). Tills Q&A – Negative Skew

Consequently under certain conditions (See HERE) the percentile rank (vs. the NCE percentile) will be a more accurate representation of the student’s ability on this subtest.

Indeed, due to the reduced complexity of the presented words some students (especially younger elementary aged) may obtain average scores and still present with serious reading fluency deficits.  

I frequently see that in students with average IQ and go to long-term memory, who by second and third grades have managed to memorize an admirable number of sight words due to which their deficits in the areas of reading appeared to be minimized.  Recommendation: If you suspect that your student belongs to the above category I highly recommend supplementing this subtest with an informal measure of reading fluency.  This can be done by presenting to the student a grade level text (I find science and social studies texts particularly useful for this purpose) and asking them to read several paragraphs from it (see HERE and/or HERE).

As the students are reading  I calculate their reading fluency by counting the number of words they read per minute.  I find it very useful as it allows me to better understand their reading profile (e.g, fast/inaccurate reader, slow/inaccurate reader, slow accurate reader, fast/accurate reader).   As the student is reading I note their pauses, misreadings, word-attack skills and the like. Then, I write a summary comparing the students reading fluency on both standardized and informal assessment measures in order to document students strengths and limitations.

TILLS-subtest-12-written-expression

12. The Written Expression (WE) subtest (description above) needs to be administered to the students immediately after the administration of the Reading Fluency (RF) subtest because the student is expected to integrate a series of facts presented in the RF subtest into their writing sample. There are 4 stories in total for the 4 different age groups.

The examiner needs to show the student a different story which integrates simple facts into a coherent narrative. After the examiner reads that simple story to the students s/he is expected to tell the students that the story is  okay, but “sounds kind of “choppy.” They then need to show the student an example of how they could put the facts together in a way that sounds more interesting and less choppy  by combining sentences (see below). Finally, the examiner will ask the students to rewrite the story presented to them in a similar manner (e.g, “less choppy and more interesting.”)

tills

After the student finishes his/her story, the examiner will analyze it and generate the following scores: a discourse score, a sentence score, and a word score. Detailed instructions as well as the Examiner’s Practice Workbook are provided to assist with scoring as it takes a bit of training as well as trial and error to complete it, especially if the examiners are not familiar with certain procedures (e.g., calculating T-units).

Full disclosure: Because the above subtest is still essentially sentence combining, I have only used this subtest a handful of times with my students. Typically when I’ve used it in the past, most of my students fell in two categories: those who failed it completely by either copying text word  for word, failing to generate any written output etc. or those who passed it with flying colors but still presented with notable written output deficits. Consequently, I’ve replaced Written Expression subtest administration with the administration of written standardized tests, which I supplement with an informal grade level expository, persuasive, or narrative writing samples.

Having said that many clinicians may not have the access to other standardized written assessments, or lack the time to administer entire standardized written measures (which may frequently take between 60 to 90 minutes of administration time). Consequently, in the absence of other standardized writing assessments, this subtest can be effectively used to gauge the student’s basic writing abilities, and if needed effectively supplemented by informal writing measures (mentioned above).

TILLS-subtest-13-social-communication

13. The Social Communication (SC) subtest (description above) assesses the students’ ability to understand vocabulary associated with communicative intentions in social situations. It requires students to comprehend how people with certain characteristics might respond in social situations by formulating responses which fit the social contexts of those situations. Essentially students become actors who need to act out particular scenes while viewing select words presented to them.

Full disclosure: Similar to my infrequent administration of the Written Expression subtest, I have also administered this subtest very infrequently to students.  Here is why.

I am an SLP who works full-time in a psychiatric hospital with children diagnosed with significant psychiatric impairments and concomitant language and literacy deficits.  As a result, a significant portion of my job involves comprehensive social communication assessments to catalog my students’ significant deficits in this area. Yet, past administration of this subtest showed me that number of my students can pass this subtest quite easily despite presenting with notable and easily evidenced social communication deficits. Consequently, I prefer the administration of comprehensive social communication testing when working with children in my hospital based program or in my private practice, where I perform independent comprehensive evaluations of language and literacy (IEEs).

Again, as I’ve previously mentioned many clinicians may not have the access to other standardized social communication assessments, or lack the time to administer entire standardized written measures. Consequently, in the absence of other social communication assessments, this subtest can be used to get a baseline of the student’s basic social communication abilities, and then be supplemented with informal social communication measures such as the Informal Social Thinking Dynamic Assessment Protocol (ISTDAP) or observational social pragmatic checklists

TILLS-subtest-14-digit-span-forward

14.  The Digit Span Forward (DSF) subtest (description above) is a relatively isolated  measure  of short term and verbal working memory ( it minimizes demands on other aspects of language such as syntax or vocabulary).

TILLS-subtest-15-digit-span-backward

15.  The Digit Span Backward (DSB) subtest (description above) assesses the student’s working memory and requires the student to mentally manipulate the presented stimuli in reverse order. It allows examiner to observe the strategies (e.g. verbal rehearsal, visual imagery, etc.) the students are using to aid themselves in the process.  Please note that the Digit Span Forward subtest must be administered immediately before the administration of this subtest.

SLPs who have used tests such as the Clinical Evaluation of Language Fundamentals – 5 (CELF-5) or the Test of Auditory Processing Skills – Third Edition (TAPS-3) should be highly familiar with both subtests as they are fairly standard measures of certain aspects of memory across the board.

To continue, in addition to the presence of subtests which assess the students literacy abilities, the TILLS also possesses a number of interesting features.

For starters, the TILLS Easy Score, which allows the examiners to use their scoring online. It is incredibly easy and effective. After clicking on the link and filling out the preliminary demographic information, all the examiner needs to do is to plug in this subtest raw scores, the system does the rest. After the raw scores are plugged in, the system will generate a PDF document with all the data which includes (but is not limited to) standard scores, percentile ranks, as well as a variety of composite and core scores. The examiner can then save the PDF on their device (laptop, PC, tablet etc.) for further analysis.

The there is the quadrant model. According to the TILLS sampler (HERE)  “it allows the examiners to assess and compare students’ language-literacy skills at the sound/word level and the sentence/ discourse level across the four oral and written modalities—listening, speaking, reading, and writing” and then create “meaningful profiles of oral and written language skills that will help you understand the strengths and needs of individual students and communicate about them in a meaningful way with teachers, parents, and students. (pg. 21)”

tills quadrant model

Then there is the Student Language Scale (SLS) which is a one page checklist parents,  teachers (and even students) can fill out to informally identify language and literacy based strengths and weaknesses. It  allows for meaningful input from multiple sources regarding the students performance (as per IDEA 2004) and can be used not just with TILLS but with other tests or in even isolation (as per developers).

Furthermore according to the developers, because the normative sample included several special needs populations, the TILLS can be used with students diagnosed with ASD,  deaf or hard of hearing (see caveat), as well as intellectual disabilities (as long as they are functioning age 6 and above developmentally).

According to the developers the TILLS is aligned with Common Core Standards and can be administered as frequently as two times a year for progress monitoring (min of 6 mos post 1st administration).

With respect to bilingualism examiners can use it with caution with simultaneous English learners but not with sequential English learners (see further explanations HERE).   Translations of TILLS are definitely not allowed as they will undermine test validity and reliability.

So there you have it these are just some of my very few impressions regarding this test.  Now to some of you may notice that I spend a significant amount of time pointing out some of the tests limitations. However, it is very important to note that we have research that indicates that there is no such thing as a “perfect standardized test” (see HERE for more information).   All standardized tests have their limitations

Having said that, I think that TILLS is a PHENOMENAL addition to the standardized testing market, as it TRULY appears to assess not just language but also literacy abilities of the students on our caseloads.

That’s all from me; however, before signing off I’d like to provide you with more resources and information, which can be reviewed in reference to TILLS.  For starters, take a look at Brookes Publishing TILLS resources.  These include (but are not limited to) TILLS FAQ, TILLS Easy-Score, TILLS Correction Document, as well as 3 FREE TILLS Webinars.   There’s also a Facebook Page dedicated exclusively to TILLS updates (HERE).

But that’s not all. Dr. Nelson and her colleagues have been tirelessly lecturing about the TILLS for a number of years, and many of their past lectures and presentations are available on the ASHA website as well as on the web (e.g., HERE, HERE, HERE, etc). Take a look at them as they contain far more in-depth information regarding the development and implementation of this groundbreaking assessment.

To access TILLS fully-editable template, click HERE

Disclaimer:  I did not receive a complimentary copy of this assessment for review nor have I received any encouragement or compensation from either Brookes Publishing  or any of the TILLS developers to write it.  All images of this test are direct property of Brookes Publishing (when clicked on all the images direct the user to the Brookes Publishing website) and were used in this post for illustrative purposes only.

References: 

Leclercq A, Maillart C, Majerus S. (2013) Nonword repetition problems in children with SLI: A deficit in accessing long-term linguistic representations? Topics in Language Disorders. 33 (3) 238-254.

Related Posts:

Posted on 9 Comments

What Research Shows About the Functional Relevance of Standardized Language Tests

Image result for standardized language testsAs an SLP who routinely conducts speech and language assessments in several settings (e.g., school and private practice), I understand the utility of and the need for standardized speech, language, and literacy tests.  However, as an SLP who works with children with dramatically varying degree of cognition, abilities, and skill-sets, I also highly value supplementing these standardized tests with functional and dynamic assessments, interactions, and observations.

Since a significant value is placed on standardized testing by both schools and insurance companies for the purposes of service provision and reimbursement, I wanted to summarize in today’s post the findings of recent articles on this topic.  Since my primary interest lies in assessing and treating school-age children, for the purposes of today’s post all of the reviewed articles came directly from the Language Speech and Hearing Services in Schools  (LSHSS) journal.

We’ve all been there. We’ve all had situations in which students scored on the low end of normal, or had a few subtest scores in the below average range, which equaled  an average total score.  We’ve all poured over eligibility requirements trying to figure out whether the student should receive therapy services given the stringent standardized testing criteria in some states/districts.

Of course, as it turns out, the answer is never simple.  In 2006, Spaulding, Plante & Farinella set out to examine the assumption: “that children with language impairment will receive low scores on standardized tests, and therefore [those] low scores will accurately identify these children” (61).   So they analyzed the data from 43 commercially available child language tests to identify whether evidence exists to support their use in identifying language impairment in children.

Turns out it did not!  Turns out due to the variation in psychometric properties of various tests (see article for specific details), many children with language impairment are overlooked by standardized tests by receiving scores within the average range or not receiving low enough scores to qualify for services. Thus, “the clinical consequence is that a child who truly has a language impairment has a roughly equal chance of being correctly or incorrectly identified, depending on the test that he or she is given.” Furthermore, “even if a child is diagnosed accurately as language impaired at one point in time, future diagnoses may lead to the false perception that the child has recovered, depending on the test(s) that he or she has been given (69).”

Consequently, they created a decision tree (see below) with recommendations for clinicians using standardized testing. They recommend using alternate sources of data (sensitivity and specificity rates) to support accurate identification (available for a small subset of select tests).

The idea behind it is: “if sensitivity and specificity data are strong, and these data were derived from subjects who are comparable to the child tested, then the clinician can be relatively confident in relying on the test score data to aid his or her diagnostic decision. However, if the data are weak, then more caution is warranted and other sources of information on the child’s status might have primacy in making a diagnosis (70).”

Fast forward 6 years, and a number of newly revised tests later,  in 2012, Spaulding and colleagues set out to “identify various U.S. state education departments’ criteria for determining the severity of language impairment in children, with particular focus on the use of norm-referenced tests” as well as to “determine if norm-referenced tests of child language were developed for the purpose of identifying the severity of children’s language impairment”  (176).

They obtained published procedures for severity determinations from available U.S. state education departments, which specified the use of norm-referenced tests, and reviewed the manuals for 45 norm-referenced tests of child language to determine if each test was designed to identify the degree of a child’s language impairment.

What they found out was “the degree of use and cutoff-point criteria for severity determination varied across states. No cutoff-point criteria aligned with the severity cutoff points described within the test manuals. Furthermore, tests that included severity information lacked empirical data on how the severity categories were derived (176).”

Thus they urged SLPs to exercise caution in determining the severity of children’s language impairment via norm-referenced test performance “given the inconsistency in guidelines and lack of empirical data within test manuals to support this use (176)”.

Following the publication of this article, Ireland, Hall-Mills & Millikin issued a response to the  Spaulding and colleagues article. They pointed out that the “severity of language impairment is only one piece of information considered by a team for the determination of eligibility for special education and related services”.  They noted that  they left out a host of federal and state guideline requirements and “did not provide an analysis of the regulations governing special education evaluation and criteria for determining eligibility (320).” They pointed out that “IDEA prohibits the use of ‘any single measure or assessment as the sole criterion’ for determination of disability  and requires that IEP teams ‘draw upon information from a variety of sources.”

They listed a variety of examples from several different state departments of education (FL, NC, VA, etc.), which mandate the use of functional assessments, dynamic assessments criterion-referenced assessments, etc. for their determination of language therapy eligibility.

But are the SLPs from across the country appropriately using the federal and state guidelines in order to determine eligibility? While one should certainly hope so, it does not always seem to be the case.  To illustrate, in 2012, Betz & colleagues asked 364 SLPs to complete a survey “regarding how frequently they used specific standardized tests when diagnosing suspected specific language impairment (SLI) (133).”

Their purpose was to determine “whether the quality of standardized tests, as measured by the test’s psychometric properties, is related to how frequently the tests are used in clinical practice” (133).

What they found out was that the most frequently used tests were the comprehensive assessments including the Clinical Evaluation of Language Fundamentals and the Preschool Language Scale as well as one word vocabulary tests such as the Peabody Picture Vocabulary Test. Furthermore, the date of publication seemed to be the only factor which affected the frequency of test selection.

They also found out that frequently SLPs did not follow up the comprehensive standardized testing with domain specific assessments (critical thinking, social communication, etc.) but instead used the vocabulary testing as a second measure.  They were understandably puzzled by that finding. “The emphasis placed on vocabulary measures is intriguing because although vocabulary is often a weakness in children with SLI (e.g., Stothard et al., 1998), the research to date does not show vocabulary to be more impaired than other language domains in children with SLI (140).

According to the authors, “perhaps the most discouraging finding of this study was the lack of a correlation between frequency of test use and test accuracy, measured both in terms of sensitivity/specificity and mean difference scores (141).”

If since the time (2012) SLPs have not significantly change their practices, the above is certainly disheartening, as it implies that rather than being true diagnosticians, SLPs are using whatever is at hand that has been purchased by their department to indiscriminately assess students with suspected speech language disorders. If that is truly the case, it certainly places into question the Ireland, Hall-Mills & Millikin’s response to Spaulding and colleagues.  In other words, though SLPs are aware that they need to comply with state and federal regulations when it comes to unbiased and targeted assessments of children with suspected language disorders, they may not actually be using appropriate standardized testing much less supplementary informal assessments (e.g., dynamic, narrative, language sampling) in order to administer well-rounded assessments.  

So where do we go from here? Well, it’s quite simple really!   We already know what the problem is. Based on the above articles we know that:

  1. Standardized tests possess significant limitations
  2. They are not used with optimal effectiveness by many SLPs
  3.  They may not be frequently supplemented by relevant and targeted informal assessment measures in order to improve the accuracy of disorder determination and subsequent therapy eligibility

Now that we have identified a problem, we need to develop and consistently implement effective practices to ameliorate it.  These include researching psychometric properties of tests to review sample size, sensitivity and specificity, etc, use domain specific assessments to supplement administration of comprehensive testing, as well as supplement standardized testing with a plethora of functional assessments.

SLPs can review testing manuals and consult with colleagues when they feel that the standardized testing is underidentifying students with language impairments (e.g., HERE and HERE).  They can utilize referral checklists (e.g., HERE) in order to pinpoint the students’ most significant difficulties. Finally, they can develop and consistently implement informal assessment practices (e.g., HERE and HERE) during testing in order to gain a better grasp on their students’ TRUE linguistic functioning.

Stay tuned for the second portion of this post entitled: “What Research Shows About the Functional Relevance of Standardized Speech Tests?” to find out the best practices in the assessment of speech sound disorders in children.

References:

  1. Spaulding, Plante & Farinella (2006) Eligibility Criteria for Language Impairment: Is the Low End of Normal Always Appropriate?
  2. Spaulding, Szulga, & Figueria (2012) Using Norm-Referenced Tests to Determine Severity of Language Impairment in Children: Disconnect Between U.S. Policy Makers and Test Developers
  3. Ireland, Hall-Mills & Millikin (2012) Appropriate Implementation of Severity Ratings, Regulations, and State Guidance: A Response to “Using Norm-Referenced Tests to Determine Severity of Language Impairment in Children: Disconnect Between U.S. Policy Makers and Test Developers” by Spaulding, Szulga, & Figueria (2012)
  4. Betz et al. (2013) Factors Influencing the Selection of Standardized Tests for the Diagnosis of Specific Language Impairment

 

Posted on 2 Comments

Embracing ‘Translanguaging’ Practices: A Tutorial for SLPs

Please note that this post was originally published in the Summer 2016 NJSHA’s VOICES (available HERE).  

If you have been keeping up with new developments in the field of bilingualism then you’ve probably heard the term “translanguaging,” increasingly mentioned at bilingual conferences across the nation.  If you haven’t, ‘translanguaging’ is the “ability of multilingual speakers to shuttle between languages, treating the diverse languages that form their repertoire as an integrated system” (Canagarajah, 2011, p. 401).   In other words, translanguaging allows bilinguals to make “flexible use their linguistic resources to make meaning of their lives and their complex worlds” (Garcia, 2011, pg. 1).

Wait a second, you might say! “Isn’t that a definition of ‘code-switching’?” And the answer is: “No!”  The concept of ‘code-switching’ implies that bilinguals use two separate linguistic codes which do not overlap/reference each other.   In contrast, ‘translanguaging’ assumes from the get-go that “bilinguals have one linguistic repertoire from which they select features strategically to communicate effectively” (Garcia, 2012, pg. 1).  Bilinguals engage in translanguaging on an ongoing basis in their daily lives. They speak different languages to different individuals, find ‘Google’ translations of words and compare results from various online sites, listen to music in one language but watch TV in another, as well as watch TV announcers fluidly integrate several languages in their event narratives during news or in infomercials (Celic & Seltzer, 2011).   For functional bilinguals, these practices are such integral part of their daily lives that they rarely realize just how much ‘translanguaging’ they actually do every day.

One of the most useful features of translanguaging (and there are many) is that it assists with further development of  bilinguals’ metalinguistic awareness abilities by allowing them to compare language practices as well as explicitly notice language features.   Consequently, not only do speech-language pathologists (SLPs) need to be aware of translanguaging when working with culturally diverse clients, they can actually assist their clients make greater linguistic gains by embracing translanguaging practices. Furthermore, one does not have to be a bilingual SLP to incorporate translanguaging practices in the therapy room. Monolingual SLPs can certainly do it as well, and with a great degree of success.

Here are some strategies of how this can be accomplished. Let us begin with bilingual SLPs who have the ability to do therapy in both languages. One great way to incorporate translanguaging in therapy is to alternate between English and the desired language (e.g., Spanish) throughout the session. Translanguaging strategies may include: using key vocabulary, grammar and syntax structures in both languages (side to side), alternating between English and Spanish websites when researching specific information (e.g., an animal habitats, etc.), asking students to take notes in both languages or combining two languages in one piece of writing.   For younger preschool students, reading the same book, translated in another language is also a viable option as it increases their lexicon in both languages.

Those SLPs who treat ESL students with language disorders and collaborate with ESL teachers can design thematic intervention with a focus on particular topics of interest. For example, during the month of April there’s increased attention on the topic of ‘human impact on the environment.’  Students can read texts on this topic in English and then use the internet to look up websites containing the information in their birth language. They can also listen to a translation or a summary of the English book in their birth language. Finally, they can make comparisons of human impact on the environment between United States and their birth/heritage countries.

As we are treating culturally and linguistically diverse students it is important to use self-questions such as: “Can we connect a particular content-area topic to our students’ cultures?” or “Can we include different texts or resources in sessions which represent our students’ multicultural perspectives?” which can assist us in making best decisions in their care (Celic & Seltzer, 2011).

We can “Get to know our students” by displaying a world map in our therapy room/classroom and asking them to show us where they were born or came from (or where their family is from). We can label the map with our students’ names and photographs and provide them with the opportunity to discuss their culture and develop cultural connections.  We can create a multilingual therapy room by using multilingual labels and word walls as well as sprinkling our English language therapy with words relevant to the students from their birth/heritage languages (e.g., songs and greetings, etc.).

Monolingual SLPs who do not speak the child’s language or speak it very limitedly, can use multilingual books which contain words from other languages.  To introduce just a few words in Spanish, books such as ‘Maňana Iguana’ by Ann Whitford Paul, ‘Count on Culebra’ by Ann Whitford Paul, ‘Abuela’ by Arthur Doros, or ‘Old man and his door’ by Gary Soto can be used. SLPs with greater proficiency in a particular language (e.g., Russian) they consider using dual bilingual books in sessions (e.g., ‘Goldilocks and the Three Bears’   by Kate Clynes, ‘Giant Turnip’ by Henriette Barkow. All of these books can be found on such websites as ‘Amazon’ (string search: children’s foreign language books), ‘Language Lizard’ or ‘Trilingual Mama’ (contains list of free online multilingual books).

It is also important to understand that many of our language impaired bilingual students have a very limited knowledge of the world beyond the “here and now.”  Many upper elementary and middle school youngsters have difficulty naming world’s continents, and do not know the names and capitals of major countries.  That is why it is also important to teach them general concepts of geography, discuss world’s counties and the people who live there, as well as introduce them to select multicultural holidays celebrated in United States and in other countries around the world.

All students benefit from translanguaging! It increases awareness of language diversity in monolingual students, validates use of home languages for bilingual students, as well as assists with teaching challenging academic content and development of English for emergent bilingual students.  Translanguaging can take place in any classroom or therapy room with any group of children including those with primary language impairments or those speaking different languages from one another. The cognitive benefits of translanguaging are numerous because it allows students to use all of their languages as a resource for learning, reading, writing, and thinking in the classroom (Celic & Seltzer, 2011).

References:

Helpful Smart Speech Therapy Resources:

Posted on Leave a comment

Teaching Punctuation for Writing Success

Child, Kid, Play, Tranquil, Study, Color, Write, LearnLast week  I wrote a blog post entitled: “Teaching Metalinguistic Vocabulary for Reading Success” in which I described the importance of explicitly teaching students basic metalinguistic vocabulary terms as elementary building blocks needed for reading success (HERE).  This week I wanted to write a brief blog post regarding terminology related to one particular, often ignored aspect of writing, punctuation.

Punctuation brings written words to life. As we have seen from countless of grammar memes, an error in punctuation results in conveying a completely different meaning.

In my experience administering the Test of Written Language – 4 (TOWL – 4) as well as analyzing informal writing samples I frequently see an almost complete absence of any and all punctuation marks in the presented writing samples.  These are not the samples of 2nd, 3rd, or even 4th graders that I am referring to. Sadly, I’m referring to written samples of students in middle school and even high school, which frequently lack basic punctuation and capitalization.

This explicit instruction of punctuation terminology does significantly improve my students understanding of sentence formation. Even my students with mild to moderate intellectual disabilities significantly benefit from understanding how to use periods, commas and question marks in sentences.

I even created a basic handout to facilitate my students comprehension of usage of punctuation marks (FREE HERE) in sentences.

Similarly to my metalinguistic vocabulary handout, I ask my older elementary aged students with average IQ, to look up online and write down rules of usage for each of the provided terms (e.g., colon, hyphen, etc,.), under therapist supervision.

This in turns becomes a critical thinking and an executive functions activity. Students need sift through quite a bit of information to find a website which provides the clearest answers regarding the usage of specific punctuation marks. Here, it’s important for students to locate kid friendly websites which will provide them with simple but accurate descriptions of punctuation marks usage.  One example of such website is Enchanted Learning which also provides free worksheets related to practicing punctuation usage.

In contrast to the above, I use structured worksheets and punctuation related workbooks for younger elementary age students (e.g., 1st – 5th grades) as well as older students with intellectual impairments (click on each grade number above to see the workbooks).

I find that even after several sessions of explicitly teaching punctuation usage to my students, their written sentences significantly improve in clarity and cohesion.

One of the best parts about this seemingly simple activity, is that due to the sheer volume of provided punctuation mark vocabulary (20 items in total), a creative clinician/parent can stretch this activity into multiple therapy sessions. This is because careful rule identification for each punctuation mark will in turn involve a number of related vocabulary definition tasks.  Furthermore, correct usage of each punctuation mark in a sentence for internalization purposes (rather mere memorization) will also take-up a significant period of time.

How about you? Do you explicitly work on teaching punctuation?

Posted on 1 Comment

Teaching Metalinguistic Vocabulary for Reading Success

In my therapy sessions I spend a significant amount of time improving literacy skills (reading, spelling, and writing) of language impaired students.  In my work with these students I emphasize goals with a focus on phonics, phonological awareness, encoding (spelling) etc. However, what I have frequently observed in my sessions are significant gaps in the students’ foundational knowledge pertaining to the basics of sound production and letter recognition.  Basic examples of these foundational deficiencies involve students not being able to fluently name the letters of the alphabet, understand the difference between vowels and consonants, or fluently engage in sound/letter correspondence tasks (e.g., name a letter and then quickly and accurately identify which sound it makes).  Consequently, a significant portion of my sessions involves explicit instruction of the above concepts.

This got me thinking regarding my students’ vocabulary knowledge in general.  We, SLPs, spend a significant amount of time on explicit and systematic vocabulary instruction with our students because as compared to typically developing peers, they have immature and limited vocabulary knowledge. But do we teach our students the abstract vocabulary necessary for reading success? Do we explicitly teach them definitions of a letter, a word, a sentence? etc.

A number of my colleagues are skeptical. “Our students already have poor comprehension”, they tell me, “Why should we tax their memory with abstract words of little meaning to them?”  And I agree with them of course, but up to a point.

I agree that our students have working memory and processing speed deficits as a result of which they have a much harder time learning and recalling new words.

However, I believe that not teaching them meanings of select words pertaining to language is a huge disservice to them. Here is why. To be a successful communicator, speaker, reader, and writer, individuals need to possess adequate metalinguistic skills.

In simple terms “metalinguistics” refers to the individual’s ability to actively think about, talk about, and manipulate language. Reading, writing, and spelling require active level awareness and thought about language. Students with poor metalinguistic skills have difficulty learning to read, write, and spell.  They lack awareness that spoken words are made up of individual units of sound, which can be manipulated. They lack awareness that letters form words, words form phrases and sentences, and sentences form paragraphs. They may not understand that letters make sounds or that a word may consist of more letters than sounds (e.g., /ship/). The bottom line is that students with decreased metalinguistic skills cannot effectively use language to talk about concepts like sounds, letters, or words unless they are explicitly taught those abilities.

So I do! Furthermore, I can tell you that explicit instruction of metalinguistic vocabulary does significantly improve my students understanding of the tasks involved in obtaining literacy competence. Even my students with mild to moderate intellectual disabilities significantly benefit from understanding the meanings of: letters, words, sentences, etc.

I even created a basic abstract vocabulary handout to facilitate my students comprehension of these words (FREE HERE). While by no means exhaustive, it is a decent starting point for teaching my students the vocabulary needed to improve their metalinguistic skills.

For older elementary aged students with average IQ, I only provide the words I want them to define, and then ask them to look up their meanings online via the usage of PC or an iPad. This turns of vocabulary activity into a critical thinking and an executive functions task.

Students need to figure out the appropriate search string needed to in order to locate the answer as well as which definition comes the closest to clearly and effectively defining the presented word. One of the things I really like about Google online dictionary, is that it provides multiple definitions of the same words along with word origins. As a result, it teaches students to carefully review and reflect upon their selected definition in order to determine its appropriateness.

A word of caution as though regarding using Kiddle, Google-powered search engine for children. While it’s great for locating child friendly images, it is not appropriate for locating abstract definition of words. To illustrate, when you type in the string search into Google, “what is the definition of a letter?” You will get several responses which will appropriately match  some meanings of your query.  However the same string search in Kiddle, will merely yield helpful tips on writing a letter as well as images of envelopes with stamps affixed to them.

In contrast to the above, I use a more structured vocabulary defining activities for younger elementary age students as well as students with intellectual impairments. I provide simple definitions of abstract words, attach images and examples to each definition as well as create cloze activities and several choices of answers in order to ensure my students’ comprehension of these words.

I find that this and other metalinguistic activities significantly improve my students comprehension of abstract words such as ‘communication’, ‘language’, as well as ‘literacy’. They cease being mere buzzwords, frequently heard yet consistently not understood.  To my students these words begin to come to life, brim with meaning, and inspire numerous ‘aha’ moments.

Now that you’ve had a glimpse of my therapy sessions I’d love to have a glimpse of yours. What metalinguistic goals related to literacy are you targeting with your students? Comment below to let me know.

 

Posted on 9 Comments

Why Are My Child’s Test Scores Dropping?

“I just don’t understand,” says a parent bewilderingly, “she’s receiving so many different therapies and tutoring every week, but her scores on educational, speech-language, and psychological testing just keep dropping!”

I hear a variation of this comment far too frequently in both my private practice as well as outpatient school in hospital setting, from parents looking for an explanation regarding the decline of their children’s standardized test scores in both cognitive (IQ) and linguistic domains. That is why today I wanted to take a moment to write this blog post to explain a few reasons behind this phenomenon.

Children with language impairments represent a highly diverse group, which exists along a continuum.   Some children’s deficits may be mild while others far more severe. Some children may receive very little intervention  services and thrive academically, while others can receive inordinate amount of interventions and still very limitedly benefit from them.  To put it in very simplistic terms, the above is due to two significant influences – the interaction between the child’s (1) genetic makeup and (2) environmental factors.

There is a reason why language disorders are considered developmental.   Firstly, these difficulties are apparent from a young age when the child’s language just begins to develop.  Secondly, the trajectory of the child’s language deficits also develops along with the child and can progress/lag based on the child’s genetic predisposition, resiliency, parental input, as well as schooling and academically based interventions.

Let us discuss some of the reasons why standardized testing results may decline for select students who are receiving a variety of support services and interventions.

Ineffective Interventions due to Misdiagnosis 

Sometimes, lack of appropriate/relevant intervention provision may be responsible for it.  Let’s take an example of a misdiagnosis of alcohol related deficits as Autism, which I have frequently encountered in my private practice, when performing second opinion testing and consultations. Unfortunately, the above is not uncommon.  Many children with alcohol-related impairments may present with significant social emotional dysregulation coupled with significant externalizing behavior manifestations.  As a result, without a thorough differential diagnosis they may be frequently diagnosed with ASD and then provided with ABA therapy services for years with little to no benefit.

Ineffective Interventions due to Lack of Comprehensive Testing 

Let us examine another example of a student with average intelligence but poor reading performance.  The student may do well in school up to certain grade but then may begin to flounder academically.  Because only the student’s reading abilities ‘seem’ to be adversely impacted, no comprehensive language and literacy evaluations are performed.   The student may receive undifferentiated extra reading support in school while his scores may continue to drop.

Once the situation ‘gets bad enough’, the student’s language and literacy abilities may be comprehensively assessed.  In a vast majority of situations these type of assessments yield the following results:

  1. The student’s oral language expression as well as higher order language abilities are adversely affected and require targeted language intervention
  2. The undifferentiated reading intervention provided to the student was NOT targeting actual areas of weaknesses

As can be seen from above examples, targeted intervention is hugely important and, in a number of cases, may be responsible  for the student’s declining performance. However, that is not always the case.

What if it was definitively confirmed that the student was indeed diagnosed appropriately and was receiving quality services but still continued to decline academically. What then?

Well, we know that many children with genetic disorders (Down Syndrome, Fragile X, etc.) as well as intellectual disabilities (ID) can make incredibly impressive gains in a variety of developmental areas (e.g., gross/fine motor skills, speech/language, socio-emotional, ADL, etc.)  but their gains will not be on par with peers without these diagnoses.

The situation becomes much more complicated when children without ID (or with mild intellectual deficits) and varying degrees of language impairment, receive effective therapies, work very hard in therapy, yet continue  to be perpetually behind their peers when it comes to making academic gains.  This occurs because of a phenomenon known as Cumulative Cognitive Deficit (CCD).

The Effect of Cumulative Cognitive Deficit (CCD) on Academic Performance 

According to Gindis (2005) CCD “refers to a downward trend in the measured intelligence and/or scholastic achievement of culturally/socially disadvantaged children relative to age-appropriate societal norms and expectations” (p. 304). Gindis further elucidates by quoting Satler (1992): “The theory behind cumulative deficit is that children who are deprived of enriching cognitive experiences during their early years are less able to profit from environmental situations because of a mismatch between their cognitive schemata and the requirements of the new (or advanced) learning situation”  (pp. 575-576).

So who are the children potentially at risk for CCD?

One such group are internationally (and domestically) adopted as well as foster care children.  A number of studies show that due to the early life hardships associated with prenatal trauma (e.g., maternal substance abuse, lack of adequate prenatal care, etc.) as well as postnatal stress (e.g., adverse effect of institutionalization), many of these children have much poorer social and academic outcomes despite being adopted by well-to-do, educated parents who continue to provide them with exceptional care in all aspects of their academic and social development.

Another group, are children with diagnosed/suspected psychiatric impairments and concomitant overt/hidden language deficits. Depending on the degree and persistence of the psychiatric impairment, in addition to having intermittent access to classroom academics and therapy interventions, the quality of their therapy may be affected by the course of their illness. Combined with sporadic nature of interventions this may result in them falling further and further behind their peers with respect to social and academic outcomes.

A third group (as mentioned previously) are children with genetic syndromes, neurodevelopmental disorders (e.g., Autism) and intellectual disabilities. Here, it is very important to explicitly state that children with diagnosed or suspected alcohol related deficits (FASD) are particularly at risk due to the lack of consensus/training  regarding FAS detection/diagnosis. Consequently, these children may evidence a steady ‘decline’ on standardized testing despite exhibiting steady functional gains in therapy.

Brief Standardized Testing Score Tutorial:

When we look at norm-referenced testing results, score interpretation can be quite daunting. For the sake of simplicity,  I’d like to restrict this discussion to two types of scores: raw scores and standard scores.

The raw score is the number of items the child answered correctly on a test or a subtest. However, raw scores need to be interpreted to be meaningful.  For example, a 9 year old student can attain a raw score of 12 on a subtest of a particular test (e.g., Listening Comprehension Test-2 or LCT-2).  Without more information, the raw score has no meaning. If the test consisted of 15 questions, a raw score of 12 would be an average score. Alternatively, if the subtest had 36 questions, a raw score of 12 would be significantly below-average (e.g., Test of Problem Solving-3 or TOPS-3).

Consequently, the raw score needs to be converted to a standard score. Standard scores compare the student’s performance on a test to the performance of other students his/her age.  Many standardized language assessments have a mean of 100 and a standard deviation of 15. Thus, scores between 85 and 115 are considered to be in the average range of functioning.

Now lets discuss testing performance variation across time. Let’s say an 8.6 year old student took the above mentioned LCT-2 and attained poor standard scores on all subtests.   That student qualifies for services and receives them for a period of one year. At that time the LCT-2 is re-administered once again and much to the parents surprise the student’s standard scores appear to be even lower than when he had taken the test as an eight year old (illustration below).

Results of The Listening Comprehension Test -2 (LCT-2): Age: 8:4

Subtests Raw Score Standard Score Percentile Rank Description
Main Idea 5 67 2 Severely Impaired
Details 2 63 1 Severely Impaired
Reasoning 2 69 2 Severely Impaired
Vocabulary 0 Below Norms Below Norms Profoundly Impaired
Understanding Messages 0 <61 <1 Profoundly Impaired
Total Test Score 9 <63 1 Profoundly Impaired

(Mean = 100, Standard Deviation = +/-15)

Results of The Listening Comprehension Test -2 (LCT-2):  Age: 9.6

Subtests Raw Score Standard Score Percentile Rank Description
Main Idea 6 60 0 Severely Impaired
Details 5 66 1 Severely Impaired
Reasoning 3 62 1 Severely Impaired
Vocabulary 4 74 4 Moderately Impaired
Understanding Messages 2 54 0 Profoundly Impaired
Total Test Score 20 <64 1 Profoundly Impaired

(Mean = 100, Standard Deviation = +/-15)

However, if one looks at the raw score column on the far left, one can see that the student as a 9 year old actually answered more questions than as an 8 year old and his total raw test score went up by 11 points.

The above is a perfect illustration of CCD in action. The student was able to answer more questions on the test but because academic, linguistic, and cognitive demands continue to steadily increase with age, this quantitative improvement in performance (increase in total number of questions answered) did not result in qualitative  improvement in performance (increase in standard scores).

In the first part of this series I have introduced the concept of Cumulative Cognitive Deficit and its effect on academic performance. Stay tuned for part II of this series which describes what parents and professionals can do to improve functional performance of students with Cumulative Cognitive Deficit.

References:

  • Bowers, L., Huisingh, R., & LoGiudice, C. (2006). The Listening Comprehension Test-2 (LCT-2). East Moline, IL: LinguiSystems, Inc.
  • Bowers, L., Huisingh, R., & LoGiudice, C. (2005). The Test of Problem Solving 3-Elementary (TOPS-3). East Moline, IL: LinguiSystems.
  • Gindis, B. (2005). Cognitive, language, and educational issues of children adopted from overseas orphanages. Journal of Cognitive Education and Psychology, 4 (3): 290-315.
  • Sattler, J. M. (1992). Assessment of Children. Revised and updated 3rd edition. San Diego: Jerome M. Sattler.
Posted on 1 Comment

Assessing Behaviorally Impaired Students: Why Background History Matters!

As a speech language pathologist (SLP) who works in an outpatient psychiatric school-based setting, I frequently review incoming students previous speech language evaluation reports.  There are a number of trends I see in these reports which I have written about in the past as well as planned on writing about in the future.

For example, in the past I wrote about my concern regarding the lack of adequate or even cursory social communication assessments for students with documented psychiatric impairments and emotional behavioral deficits.

This leads many professionals to do the following: 

a. Miss vital assessment elements which denies students appropriate school based services and

b. Assume that the displayed behavioral challenges are mere results of misbehaving. 

Today however I wanted express my thoughts regarding another disturbing trend I see in numerous incoming speech-language reports in both outpatient school/hospital setting as well as in private practice  – and that is lack of background information in the students assessment reports.

Despite its key role in assessment, this section is frequently left bare. Most of the time it contains only the information regarding the students age and grade levels as well as the reasons for the referral (e.g., initial evaluation, triennial evaluation).  Some of the better reports will include cursory mention of the student’s developmental milestones but most of the time information will be sorely lacking.

Clearly this problem is not just prevalent in my incoming assessment reports. I frequently see manifestations of it in a variety of speech pathology related social media forums such as Facebook. Someone will pose a question regarding how to distinguish a _____ from ____ (e.g., language difference vs. language disorder, behavioral noncompliance vs. social communication deficits, etc.) yet when they’re questioned further many SLPs will admit that they are lacking any/most information regarding the students background history.

When questioned regarding the lack of this information, many SLPs get defensive. They cite a variety of reasons such as lack of parental involvement (“I can’t reach the parents”), lack of access to records (“it’s a privacy issue”), division of labor (e.g., “it’s the social worker’s responsibility and not mine to obtain this information”) as well as other justifications why this information is lacking.

Now, I don’t know about you, but one of my earliest memories of the ‘diagnostics’ class in graduate school involved collecting data and writing comprehensive ‘Background Information’ section of the report. I still remember multiple professors imparting upon me the vital importance is this section plays in the student’s evaluation report.

Indeed, many years later, I clearly see its vital role in assessment. Unearthing the student’s family history, developmental milestones, medical/surgical history, as well as history of past therapies is frequently the key to a successful diagnosis and appropriate provision of therapy services.  This is the information that frequently plays a vital role in subsequent referrals of “mystery” cases to relevant health professionals as well as often leads to resolution of particularly complicated diagnostic puzzles.

Of course I understand that frequently there are legitimate barriers to obtaining this information.  However, I also know that if one digs deep enough one will frequently find the information they’re seeking despite the barriers. To illustrate, at the psychiatric hospital level where I work,  I frequently encounter a number of barriers to accessing the student’s background information during the assessment process. This may include parental language/education barrier, parental absence, Division of Child Protective Services involvement,  etc.  Yet I always try to ensure that my reports contain all the background information that I’m able to unearth because I know how vitally important it is for the student in question.

In the past I have been able to use the student’s background information to make important discoveries, which were otherwise missed by other health professionals. This included undocumented history of traumatic brain injuries, history of language and literacy disabilities in the family, history of genetic disorders and/or intellectual disabilities in the family, history of maternal alcohol abuse during pregnancy, and much much more.

So what do I consider to be an adequate Background History section of the assessment report?

For starters, the basics, of course.

I begin by stating the child’s age and grade levels, who referred the child (and for what reason), as well as whether the child previously received any form of speech language assessment/therapy services in the past.

If I am preforming a reassessment (especially if it happens shortly after the last assessment took place) I provide a clear justification why the present reassessment is taking place. Here is an actual excerpt from one of my reevaluation reports. “Despite receiving average language scores on his _______ speech language testing which resulted in the  recommendation for speech therapy only, upon his admission to ______, student was referred for a language reassessment in _____, by the classroom staff who expressed significant concerns regarding validity and reliability of past speech and language testing on the ground of the student’s persistent “obvious” listening comprehension and verbal expression deficits.”

For those of you in need of further justification I’ve created a brief list of reasons why a reassessment, closely following recent testing may be needed.

  1. SLP/Parent feels additional testing is needed to create comprehensive goals for child.
  2. Previous testing was inadequate. Here it’s very important to provide comprehensive rationale  and list the reasons for it.
  3. A reevaluation was requested due to third party  concerns (e.g., psychiatrist, psychologist, etc.)

Secondly, it is important to document all relevant medical history, which includes: prenatal, perinatal, and early childhood diseases, surgical interventions and incidents. It is important to note that if a child has a long standing history of documented psychiatric difficulties, you may want to separate these sections and describe psychiatric history/diagnoses following the section that details the onset of the child’s emotional and behavioral deficits.

Let us now move on to the child’s developmental history, which should include, gross/fine motor, speech/ language milestones, and well as cognitive and socioemotional functioning.  This is a section where I typically add information regarding any early intervention services which may have been provided to the child prior to the age of three.

In my next section I discuss the child’s academic functioning to date. Here I mention whether the student qualified for a preschool disabled eligibility category and received services from the age of 3+.  I also discuss their educational classification (if one exists), briefly mention the results of previous most recent cognitive and educational testing (if available) as well as mention any academic struggles (if applicable).

After that I move on to the child’s psychiatric history. I briefly document when did the emotional behavioral problems first arose, and what had been done about them to date (out of district placements, variety of psychiatric services, etc.)  Here I also document  the student’s most recent psychiatric diagnoses (if available) and mention any medication they may be currently on (applicable due to the effect of psychiatric medications on language and memory skills).

The following section is perhaps the most important one in the  report. It is the family’s history of genetic disorders, psychiatric impairments, special education placements, as well as language, learning, and literacy deficits.  This section plays a vital importance in my determination of the contributions to the student’s language difficulties as well as guides my assessment recommendations in the presence of borderline assessment results.

I finish this section by briefly discussing the student’s Family Composition as well as Language Knowledge and Use.

I discuss family composition due to several factors.  For example, lack of consistent caregivers, prolonged absence of parental figures, as well as presence of a variety of people in the home can serve as significant stressor for children with psychiatric impairments and learning difficulties.  As a result of this information is pertinent to the report especially when it comes to figuring out the antecedents for the child’s behavior fluctuation on daily basis.

Language knowledge and use  is particularly relevant to culturally and linguistically diverse children. It is very important to understand what languages does the child understand and use at home and at school as well as what do the parents think about the child’s language abilities in both languages. These factors will guide my decision making process regarding what type of assessments would be most relevant for this child.

So there you have it.  This is the information I include in the background history section of every single one of my reports.  I believe that this information contributes to the making of the appropriate and accurate diagnosis of the child’s difficulties.

Please don’t get me wrong. This information is hugely relevant for all students that we SLPs are assessing.

However, the above is especially relevant for such vulnerable populations as children with emotional and behavioral disturbances, whose struggle with social communication is frequently misinterpreted as “it’s just behavior“. As a result, they are frequently denied social communication therapy services, which ultimately leads to denial of Free Appropriate Public Education (FAPE) that they are entitled to.

Let us ensure that this does not happen by doing all that we can to endure that the student receives a fair assessment, correct diagnosis, and can have access to the best classroom placement, appropriate accommodations and modifications as well as targeted and relevant therapeutic services.  And the first step of that process begins with obtaining a detailed background history!

Helpful Resources: 

 

 

 

Posted on 4 Comments

What’s Memes Got To Do With It?

Today, after a long hiatus, I am continuing my series of blog posts on “Scholars Who do Not Receive Enough Mainstream Exposure” by summarizing select key points from Dr. Alan G. Kamhi’s 2004 article: “A Meme’s Eye View of Speech-Language Pathology“.

Some of you may be wondering: “Why is she reviewing an article that is more than a decade old? The answer is simple.  It is just as relevant, if not more so today, as it was 12 years ago, when it first came out.

In this article, Dr. Kamhi, asks a provocative question: “Why do some terms, labels, ideas, and constructs [in the field of speech pathology] prevail whereas others fail to gain acceptance?

He attempts to answer this question by explaining the vital role the concept of memes play in the evolution and spread of ideas.

—A meme (shortened from the Greek mimeme to imitate) is an idea, behavior, or style that spreads from person to person within a culture”. The term was originally coined by British evolutionary biologist Richard Dawkins in The Selfish Gene (1976) to explain the spread of ideas and cultural phenomena such as tunes, ideas, catchphrases, customs, etc.

‘Selfish’ in this case means that memes “care only about their own self-replication“.  Consequently, “successful memes are those that get copied accurately (fidelity), have many copies (fecundity), and last a long time (longevity).” Therefore, “memes that are easy to understand, remember, and communicate to others” have the highest risk of survival and replication (pp. 105-106).

So what were some of the more successful memes which Dr. Kamhi identified in his article, which still persist more than a decade later?

  • Learning Disability
  • Auditory Processing Disorder
  • Sensory Integration Disorder
  • Dyslexia
  • Articulation disorder
  • Speech Therapist/ Pathologist

Interestingly the losers of the “contest” were memes that contained the word language in it:

  • Language disorder
  • Language learning disability
  • Speech-language pathologist (albeit this term has gained far more acceptance in the past decade)

Dr. Kamhi further asserts that ‘language-based disorders have failed to become a recognizable learning problem in the community at large‘ (p.106).

So why are labels with the words ‘language’ NOT successful memes?

According to Dr. Kamhi that is because “language-based disorders must be difficult to understand, remember, and communicate to others“. Professional (SLP) explanations of what constitutes language are lengthy and complex (e.g., ASHA’s comprehensive definition) and as a result are not frequently applied in clinical practice, even when its aspects are familiar to SLPs.

Some scholars have suggested that the common practice of evaluating language with standardized language tools, restricts full understanding of the interactions of all of its domains (“within larger sociocultural context“) because they only examine isolated aspects of language. (Apel, 1999)

Dr. Kamhi, in turn explains this within the construct of the memetic theory: namely “simple constructs are more likely to replicate than complex ones.” In other words: “even professionals who understand language may have difficulty communicating its meaning to others and applying this meaning to clinical practice” (p. 107).

Let’s talk about the parents who are interested in learning the root-cause of their child’s difficulty learning and using language.  Based on specific child’s genetic and developmental background as well as presenting difficulties, an educated clinician can explain to the parent the multifactorial nature of their child’s deficits.

However, these informed but frequently complex explanations are certainly in no way simplistic. As a result, many parents will still attempt to seek other professionals who can readily provide them with a “straightforward explanation” of their child’s difficulty.  Since parents are “ultimately interested in finding the most effective and efficient treatment for their children” it makes sense to believe/hope that “the professional who knows the cause of the problem will also know the most effective way to treat it“(p. 107).

This brings us back to the concept of successful memes such as Auditory Processing Disorder (C/APD) as well as Sensory Processing Disorder (SPD) as isolated diagnoses.

Here are just some of the reasons behind their success:

  • They provide a simple solution (which is not necessarily a correct one) that “the learning problem is the result of difficulty processing auditory information or difficulty integrating sensory information“.
  • The assumption is “improving auditory processing and sensory integration abilities” will improve learning difficulties
  • Both, “APD and SID each have only one cause“, so “finding an appropriate treatment …seems more feasible because there is only one problem to eliminate
  • Gives parents “a sense of relief” that they finally have an “understandable explanation for what is wrong with their child
  • Gives parents  hope that the “diagnosis will lead to successful remediation of the learning problem

For more information on why APD and SPD are not valid stand-alone diagnoses please see HERE and HERE respectively.

A note on the lack of success of “phonological” memes:

  • They are difficult to understand and explain (especially due to a lack of consensus of what constitutes a phonological disorder)
  • Lack of familiarity with the term ‘phonological’ results in poor comprehension of “phonological bases of reading problems since its “much easier to associate reading with visual processing abilities, good instruction, and a literacy rich environment” (p. 108).

Let’s talk about MEMEPLEXES (Blackmore, 1999)  or what occurs whennonprofessionals think they know how children learn language and the factors that affect language learning (Kamhi, 2004, p.108).

A memplex is a group of memes, which become much more memorable to individuals (can replicate more efficiently) as a team vs. in isolation.

Why is APD Memeplex So Appealing? 

According to Dr. Kamhi, if one believes that ‘a) sounds are the building blocks of speech and language and (b) children learn to talk by stringing together sounds and constructing meanings out of strings of sounds’ (both wrong assumptions) then its quite a simple leap to make with respect to the following fallacies:

  • Auditory processing are not influenced by language knowledge
  • You can reliably discriminate between APD and language deficits
  • You can validly and reliably assess “uncontaminated” auditory processing abilities and thus diagnose stand-alone APD
  • You can target auditory abilities in isolation without targeting language
  • Improvements in discrimination and identification of ‘speech sounds will lead to improvements in speech and language abilities

For more detailed information, why the above is incorrect, click: HERE

On the success of the Dyslexia Meme:

  • Most nonprofessionals view dyslexia as visually based “reading problem characterized by letter reversals and word transpositions that affects bright children and adults
  • Its highly appealing due to the simple nature of its diagnosis (high intelligence and poor reading skills)
  • The diagnosis of dyslexia has historically been made by physicians and psychologists rather than educators‘, which makes memetic replication highly successful
  • The ‘dyslexic’ label is far more appealing and desirable than calling self ‘reading disabled’

For more detailed information, why the above is far too simplistic of an explanation, click: HERE and HERE

Final Thoughts:

As humans we engage in transmission of  ideas (good and bad) on constant basis. The popularity of powerful social media tools such as Facebook and Twitter ensure their instantaneous and far reaching delivery and impact.  However, “our processing limitations, cultural biases, personal preferences, and human nature make us more susceptible to certain ideas than to others (p. 110).”

As professionals it is important that we use evidence based practices and the latest research to evaluate all claims pertaining to assessment and treatment of language based disorders. However, as Dr. Kamhi points out (p.110):

  • “Competing theories may be supported by different bodies of evidence, and the same evidence may be used to support competing theories.”
  • “Reaching a scientific consensus also takes time.”

While these delays may play a negligible role when it comes to scientific research, they pose a significant problem for parents, teachers and health professionals who are seeking to effectively assist these youngsters on daily basis. Furthermore, even when select memes such as APD are beneficial because they allow for a delivery of services to a student who may otherwise be ineligible to receive them, erroneous intervention recommendations (e.g., working on isolated auditory discrimination skills) may further delay the delivery of appropriate and targeted intervention services.

So what are SLPs to do in the presence of persistent erroneous memes?

Spread our language-based memes to all who will listen” (Kamhi, 2004, 110) of course! Since we are the professionals whose job is to treat any difficulties involving words. Consequently, our scope of practice certainly includes assessment, diagnosis and treatment of children and adults with speaking, listening, reading, writing, and spelling difficulties.

As for myself, I intend to start that task right now by hitting the ‘publish’ button on this post!

I am a SLP

 References:

Kamhi, A. (2004). A meme’s eye view of speech-language pathology. [PDFLanguage, Speech, and Hearing Services in Schools35, 105-112.