Posted on 9 Comments

Why Are My Child’s Test Scores Dropping?

“I just don’t understand,” says a parent bewilderingly, “she’s receiving so many different therapies and tutoring every week, but her scores on educational, speech-language, and psychological testing just keep dropping!”

I hear a variation of this comment far too frequently in both my private practice as well as outpatient school in hospital setting, from parents looking for an explanation regarding the decline of their children’s standardized test scores in both cognitive (IQ) and linguistic domains. That is why today I wanted to take a moment to write this blog post to explain a few reasons behind this phenomenon.

Children with language impairments represent a highly diverse group, which exists along a continuum.   Some children’s deficits may be mild while others far more severe. Some children may receive very little intervention  services and thrive academically, while others can receive inordinate amount of interventions and still very limitedly benefit from them.  To put it in very simplistic terms, the above is due to two significant influences – the interaction between the child’s (1) genetic makeup and (2) environmental factors.

There is a reason why language disorders are considered developmental.   Firstly, these difficulties are apparent from a young age when the child’s language just begins to develop.  Secondly, the trajectory of the child’s language deficits also develops along with the child and can progress/lag based on the child’s genetic predisposition, resiliency, parental input, as well as schooling and academically based interventions.

Let us discuss some of the reasons why standardized testing results may decline for select students who are receiving a variety of support services and interventions.

Ineffective Interventions due to Misdiagnosis 

Sometimes, lack of appropriate/relevant intervention provision may be responsible for it.  Let’s take an example of a misdiagnosis of alcohol related deficits as Autism, which I have frequently encountered in my private practice, when performing second opinion testing and consultations. Unfortunately, the above is not uncommon.  Many children with alcohol-related impairments may present with significant social emotional dysregulation coupled with significant externalizing behavior manifestations.  As a result, without a thorough differential diagnosis they may be frequently diagnosed with ASD and then provided with ABA therapy services for years with little to no benefit.

Ineffective Interventions due to Lack of Comprehensive Testing 

Let us examine another example of a student with average intelligence but poor reading performance.  The student may do well in school up to certain grade but then may begin to flounder academically.  Because only the student’s reading abilities ‘seem’ to be adversely impacted, no comprehensive language and literacy evaluations are performed.   The student may receive undifferentiated extra reading support in school while his scores may continue to drop.

Once the situation ‘gets bad enough’, the student’s language and literacy abilities may be comprehensively assessed.  In a vast majority of situations these type of assessments yield the following results:

  1. The student’s oral language expression as well as higher order language abilities are adversely affected and require targeted language intervention
  2. The undifferentiated reading intervention provided to the student was NOT targeting actual areas of weaknesses

As can be seen from above examples, targeted intervention is hugely important and, in a number of cases, may be responsible  for the student’s declining performance. However, that is not always the case.

What if it was definitively confirmed that the student was indeed diagnosed appropriately and was receiving quality services but still continued to decline academically. What then?

Well, we know that many children with genetic disorders (Down Syndrome, Fragile X, etc.) as well as intellectual disabilities (ID) can make incredibly impressive gains in a variety of developmental areas (e.g., gross/fine motor skills, speech/language, socio-emotional, ADL, etc.)  but their gains will not be on par with peers without these diagnoses.

The situation becomes much more complicated when children without ID (or with mild intellectual deficits) and varying degrees of language impairment, receive effective therapies, work very hard in therapy, yet continue  to be perpetually behind their peers when it comes to making academic gains.  This occurs because of a phenomenon known as Cumulative Cognitive Deficit (CCD).

The Effect of Cumulative Cognitive Deficit (CCD) on Academic Performance 

According to Gindis (2005) CCD “refers to a downward trend in the measured intelligence and/or scholastic achievement of culturally/socially disadvantaged children relative to age-appropriate societal norms and expectations” (p. 304). Gindis further elucidates by quoting Satler (1992): “The theory behind cumulative deficit is that children who are deprived of enriching cognitive experiences during their early years are less able to profit from environmental situations because of a mismatch between their cognitive schemata and the requirements of the new (or advanced) learning situation”  (pp. 575-576).

So who are the children potentially at risk for CCD?

One such group are internationally (and domestically) adopted as well as foster care children.  A number of studies show that due to the early life hardships associated with prenatal trauma (e.g., maternal substance abuse, lack of adequate prenatal care, etc.) as well as postnatal stress (e.g., adverse effect of institutionalization), many of these children have much poorer social and academic outcomes despite being adopted by well-to-do, educated parents who continue to provide them with exceptional care in all aspects of their academic and social development.

Another group, are children with diagnosed/suspected psychiatric impairments and concomitant overt/hidden language deficits. Depending on the degree and persistence of the psychiatric impairment, in addition to having intermittent access to classroom academics and therapy interventions, the quality of their therapy may be affected by the course of their illness. Combined with sporadic nature of interventions this may result in them falling further and further behind their peers with respect to social and academic outcomes.

A third group (as mentioned previously) are children with genetic syndromes, neurodevelopmental disorders (e.g., Autism) and intellectual disabilities. Here, it is very important to explicitly state that children with diagnosed or suspected alcohol related deficits (FASD) are particularly at risk due to the lack of consensus/training  regarding FAS detection/diagnosis. Consequently, these children may evidence a steady ‘decline’ on standardized testing despite exhibiting steady functional gains in therapy.

Brief Standardized Testing Score Tutorial:

When we look at norm-referenced testing results, score interpretation can be quite daunting. For the sake of simplicity,  I’d like to restrict this discussion to two types of scores: raw scores and standard scores.

The raw score is the number of items the child answered correctly on a test or a subtest. However, raw scores need to be interpreted to be meaningful.  For example, a 9 year old student can attain a raw score of 12 on a subtest of a particular test (e.g., Listening Comprehension Test-2 or LCT-2).  Without more information, the raw score has no meaning. If the test consisted of 15 questions, a raw score of 12 would be an average score. Alternatively, if the subtest had 36 questions, a raw score of 12 would be significantly below-average (e.g., Test of Problem Solving-3 or TOPS-3).

Consequently, the raw score needs to be converted to a standard score. Standard scores compare the student’s performance on a test to the performance of other students his/her age.  Many standardized language assessments have a mean of 100 and a standard deviation of 15. Thus, scores between 85 and 115 are considered to be in the average range of functioning.

Now lets discuss testing performance variation across time. Let’s say an 8.6 year old student took the above mentioned LCT-2 and attained poor standard scores on all subtests.   That student qualifies for services and receives them for a period of one year. At that time the LCT-2 is re-administered once again and much to the parents surprise the student’s standard scores appear to be even lower than when he had taken the test as an eight year old (illustration below).

Results of The Listening Comprehension Test -2 (LCT-2): Age: 8:4

Subtests Raw Score Standard Score Percentile Rank Description
Main Idea 5 67 2 Severely Impaired
Details 2 63 1 Severely Impaired
Reasoning 2 69 2 Severely Impaired
Vocabulary 0 Below Norms Below Norms Profoundly Impaired
Understanding Messages 0 <61 <1 Profoundly Impaired
Total Test Score 9 <63 1 Profoundly Impaired

(Mean = 100, Standard Deviation = +/-15)

Results of The Listening Comprehension Test -2 (LCT-2):  Age: 9.6

Subtests Raw Score Standard Score Percentile Rank Description
Main Idea 6 60 0 Severely Impaired
Details 5 66 1 Severely Impaired
Reasoning 3 62 1 Severely Impaired
Vocabulary 4 74 4 Moderately Impaired
Understanding Messages 2 54 0 Profoundly Impaired
Total Test Score 20 <64 1 Profoundly Impaired

(Mean = 100, Standard Deviation = +/-15)

However, if one looks at the raw score column on the far left, one can see that the student as a 9 year old actually answered more questions than as an 8 year old and his total raw test score went up by 11 points.

The above is a perfect illustration of CCD in action. The student was able to answer more questions on the test but because academic, linguistic, and cognitive demands continue to steadily increase with age, this quantitative improvement in performance (increase in total number of questions answered) did not result in qualitative  improvement in performance (increase in standard scores).

In the first part of this series I have introduced the concept of Cumulative Cognitive Deficit and its effect on academic performance. Stay tuned for part II of this series which describes what parents and professionals can do to improve functional performance of students with Cumulative Cognitive Deficit.

References:

  • Bowers, L., Huisingh, R., & LoGiudice, C. (2006). The Listening Comprehension Test-2 (LCT-2). East Moline, IL: LinguiSystems, Inc.
  • Bowers, L., Huisingh, R., & LoGiudice, C. (2005). The Test of Problem Solving 3-Elementary (TOPS-3). East Moline, IL: LinguiSystems.
  • Gindis, B. (2005). Cognitive, language, and educational issues of children adopted from overseas orphanages. Journal of Cognitive Education and Psychology, 4 (3): 290-315.
  • Sattler, J. M. (1992). Assessment of Children. Revised and updated 3rd edition. San Diego: Jerome M. Sattler.
Posted on 12 Comments

Special Education Disputes and Comprehensive Language Testing: What Parents, Attorneys, and Advocates Need to Know

Image result for evaluationSeveral years after I started my private speech pathology practice, I began performing comprehensive independent speech and language evaluations (IEEs).

For those of you who may be hearing the term IEE for the first time, an Independent Educational Evaluation is “an evaluation conducted by a qualified examiner who is not employed by the public agency responsible for the education of the child in question.” 34 C.F.R. 300.503. IEE’s can evaluate a broad range of functioning outside of cognitive or academic performance and may include neurological, occupational, speech language, or any other type of evaluations  as long as they bear direct impact on the child’s educational performance.

Independent evaluations can be performed for a wide variety of reasons, including but not limited to:

  • To determine the student’s present level of functioning
  • To determine whether the student presents with hidden, previously undiscovered deficits (e.g., executive function, social communication, etc.)
  • To determine whether the student’s educational classification requires a change
  • To determine if the student requires additional, previously not provided, related services (e.g., language therapy, etc.) or an increase in related services
  • To determine whether a student might benefit from an application of a particular therapy technique or program (e.g, Orton-Gillingham)
  • To determine whether a student with a severe impairment (e.g., severe emotional and behavioral disturbances, genetic syndrome, significant intellectual disability, etc.) is a good candidate for an out of district specialized school

Why can’t similar assessments be performed in school settings?

There are several reasons for that.

Why are IEE’s Needed?

The answer to that is simple:  “To strengthen the role of parents in the educational decision-making process.” According to one Disability Rights site: “Many disagreements between parents and school staff concerning IEP services and placement involve, at some stage, the interpretation of evaluation findings and recommendations. When disagreements occur, the Independent Educational Evaluation (IEE) is one option lawmakers make available to parents, to help answer questions about appropriate special education services and placement“.

Indeed, many of the clients who retain my services also retain the services of educational advocates as well as special education lawyers.  Many of them work on determining appropriate level of services as well as an out of district placement for the children with a variety of special education needs. However, one interesting reoccurring phenomenon I’ve noted over the years is that only a small percentage of special education lawyers, educational advocates, and even parents believed that children with autism spectrum disorders, genetic syndromes, social pragmatic deficits, emotional disturbances, or reading disabilities required a comprehensive language evaluation/reevaluation prior to determining an appropriate out of district placement or an in-district change of service provision.

So today I would like to make a case, in favor of comprehensive independent language evaluations being a routine component of every special education dispute involving a child with impaired academic performance. I will do so through the illustration of past case scenarios that clearly show that comprehensive independent language evaluations do matter, even when it doesn’t look like they may be needed.

Case A: “He is just a weak student”.

Several years ago I was contacted by a parent of a 12 year old boy, who was concerned with his son’s continuously failing academic performance. The child had not qualified for an IEP but was receiving 504 plan in school setting and was reported to significantly struggle due to continuous increase of academic demands with each passing school year.  An in-district language evaluation had been preformed several years prior. It showed that the student’s general language abilities were in the low average range of functioning due to which he did not qualify for speech language services in school setting. However, based on the review of available records it very quickly became apparent that many of the academic areas in which the student struggled (e.g., reading comprehension, social pragmatic ability, critical thinking skills, etc)  were simply not assessed by the general language testing. I had suggested to the parent a comprehensive language evaluation and explained to him on what grounds I was recommending this course of action.  That comprehensive 4 hour assessment broken into several testing sessions revealed that the student presented with severe receptive, expressive, problem solving and social pragmatic language deficits, as well as moderate executive function deficits, which required therapeutic intervention.

Prior to that assessment the parent, reinforced by the feedback from his child’s educational staff believed his son to be an unmotivated student who failed to apply himself in school setting.  However, after the completion of that assessment, the parent clearly understood that it wasn’t his child’s lack of motivation which was impeding his academic performance but rather a true learning disability was making it very difficult for his son to learn without the necessary related services and support. Several months after the appropriate related services were made available to the child in school setting on the basis of the performed IEE, the parent reported significant progress in his child academic performance.

Case B: “She’s just not learning because of her behavior, so there’s nothing we can do”.  

This case involved a six year old girl who presented with a severe speech – language disorder and behavioral deficits in school setting secondary to an intellectual disability of an unspecified origin.

In contrast to Case A scenario, this child had received a variety of assessments and therapies since a very early age; however, her parents were becoming significantly concerned regarding her regression of academic functioning in school setting and felt that a more specialized out of district program with a focus on multiple disabilities would be better suitable to her needs. Unfortunately the school disagreed with them and believed that she could be successfully educated in an in-district setting (despite evidence to the contrary).  Interestingly, an in-depth comprehensive speech language assessment had never been performed on this child because her functioning was considered to be “too low” for such an assessment.

Comprehensive assessment of this little girl’s abilities revealed that via an application of a variety of behavioral management techniques (of non-ABA origin), and highly structured language input, she was indeed capable of significantly better performance then she had exhibited in school setting.  It stood to reason that if she were placed in a specialized school setting composed of educational professionals who were trained in dealing with her complex behavioral and communication needs, her performance would continue to steadily improve.  Indeed, six months following a transfer in schools her parents reported a “drastic” change pertaining to a significant reduction in challenging behavioral manifestations as well as significant increase in her linguistic output.

Case C: “Your child can only learn so much because of his genetic syndrome”.  

This case scenario does not technically involve just one child but rather three different male students between 9 and 11 years of age with several ‘common’ genetic syndromes: Down, Fragile X, and Klinefelter.  All three were different ages, came from completely different school districts, and were seen by me in different calendar years.

However, all three boys had one thing in common, because of their genetic syndromes, which were marked by varying degrees of intellectual disability as well as speech language weaknesses, their parents were collectively told that there could be very little done for them with regards to expanding their expressive language as well as literacy development.

Similarly to the above scenarios, none of the children had undergone comprehensive language testing to determine their strengths, weaknesses, and learning styles. Comprehensive assessment of each student revealed that each had the potential to improve their expressive abilities to speak in compound and complex sentences. Dynamic assessment of literacy also revealed that it was possible to teach each of them how to read.

Following the respective assessments, some of these students had became my private clients, while others’s parents have periodically written to me, detailing their children’s successes over the years.  Each parent had conveyed to me how “life-changing”a comprehensive IEE was to their child.

Case D: “Their behavior is just out of control”

The final case scenario I would like to discuss today involves several students with an educational classification of “Emotionally Disturbed” (pg 71).  Those of you who are familiar with my blog and my work know that my main area of specialty is working with school age students with psychiatric impairments and emotional behavioral disturbances.  There are a number of reasons why I work with this challenging pediatric population. One very important reason is that these students continue to be grossly underserved in school setting. Over the years I have written a variety of articles and blog posts citing a number of research studies, which found that a significant number of students with psychiatric impairments and emotional behavioral disturbances present with undiagnosed linguistic impairments (especially in the area of social communication), which adversely impact their school-based performance.

Here, we are not talking about two or three students rather we’re talking about the numbers in the double digits of students with psychiatric impairments and emotional disturbances, who did not receive appropriate therapies in their respective school settings.

The majority of these students were divided into two distinct categories. In the first category, students began to manifest moderate-to-severe speech language deficits from a very early age. They were classified in preschool and began receiving speech language therapy. However by early elementary age their general language abilities were found to be within the average range of functioning and their language therapies were discontinued.   Unfortunately since general language testing does not assess all categories of linguistic functioning such as critical thinking, executive functions, social communication etc., these students continued to present with hidden linguistic impairments, which continued to adversely impact their behavior.

Students in the second category also began displaying emotional and behavioral challenges from a very early age. However, in contrast to the students in the first category the initial language testing found their general language abilities to be within the average range of functioning. As a result these students never received any language-based therapies and similar to the students in the first category, their hidden linguistic impairments continued to adversely impact their behavior.

Students in both categories ended up following a very similar pattern of behavior. Their behavioral challenges in the school continued to escalate. These were followed by a series of suspensions, out of district placements, myriad of psychiatric and neuropsychological evaluations, until many were placed on home instruction. The one vital element missing from all of these students’ case records were comprehensive language evaluations with an emphasis on assessing their critical thinking, executive functions and social communication abilities. Their worsening patterns of functioning were viewed as “severe misbehaving” without anyone suspecting that their hidden language deficits were a huge contributing factor to their maladaptive behaviors in school setting.

Conclusion:

So there you have it!  As promised, I’ve used four vastly different scenarios that show you the importance of comprehensive language evaluations in situations where it was not so readily apparent that they were needed.  I hope that parents and professionals alike will find this post helpful in reconsidering the need for comprehensive independent evaluations for students presenting with impaired academic performance.

Posted on Leave a comment

Spotlight on Syndromes: An SLPs Perspective on Fragile X Syndrome

Today’s guest post on Fragile X Syndrome comes from Happily SLPCarly Fowler. 

Fragile X is an inherited disorder that is associated with mental retardation and developmental disorder. This is a sex-linked disorder.  Fragile X is linked to the 23rd chromosomal pair; specifically the X chromosome. Physical characteristics of fragile X syndrome (FXS) in males are a long face, large ears, and macroorchidism (enlarged testicles).  Often individuals also have loose connective tissue, double jointed-ness and flat feet.  Many young children do not show these characteristics until they reach puberty (Abbeduto & Jenssen Hagerman, 1997). Continue reading Spotlight on Syndromes: An SLPs Perspective on Fragile X Syndrome