Category: Test Review

Posted on by — 5 Comments

Test Review: Test of Written Language-4 (TOWL-4)

Today due to popular demand I am reviewing The Test of Written Language-4 or TOWL-4. TOWL-4 assesses the basic writing readiness skills of students 9:00-17:11 years of age. The tests consist of two forms – A and B, (which contain different subtest content).

According to the manual, the entire test takes approximately  60-90 minutes to administer and examines 7 skill areas. Only the “Story Composition” subtest is officially timed (the student is given 15 minutes to write it and 5 minutes previous to that, to draft it). However, in my experience, each subtest administration, even with students presenting with mild-moderately impaired writing abilities, takes approximately 10 minutes to complete with average results (can you see where I am going with this yet?) 

For detailed information regarding the TOWL-4 development and standardization, validity and reliability, please see HERE. However, please note that the psychometric properties of this test are weak.

Below are my impressions (to date) of using this assessment with students between 11-14 years of age with (known) mild-moderate writing impairments.

Subtests:

1. Vocabulary – The student is asked to write a sentence that incorporates a stimulus word.  The student is not allowed to change the word in any way, such as write ‘running’ instead of run’. If this occurs, an automatic loss of points takes place. The ceiling is reached when the student makes 3 errors in a row.  While some of the subtest vocabulary words are perfectly appropriate for younger children (~9), the majority are too simplistic to assess the written vocabulary of middle and high schoolers. These words may work well to test the knowledge of younger children but they do not take into the account the challenging academic standards set forth for older students. As a result, students 11+ years of age may pass this subtest with flying colors but still present with a fair amount of difficulty using sophisticated vocabulary words in written compositions.

2/3.   Spelling and Punctuation (subtests 2 and 3). These two subtests are administered jointly but scored separately. Here, the student is asked to write sentences dictated by the examiner using appropriate rules for spelling and punctuation and capitalization. Ceiling for each subtest is reached separately. It  occurs when the student makes 3 errors in a row in each of the subtests.   In other words, if a student uses correct punctuation but incorrect spelling, his/her ceiling on the ‘Spelling’ subtest will be reached sooner then on the ‘Punctuation’ subtest and vise versa. Similar to the ‘Vocabulary‘ subtest I feel that the sentences the students are asked to write are far too simplistic to showcase their “true” grade level abilities.

The requirements of these subtests are also not too stringent.  The spelling words are simple and the punctuation requirements are very basic: a question mark here, an exclamation mark there, with a few commas in between. But I was particularly disappointed with the ‘Spelling‘ subtest.  Here’s why. I have a 6th-grade client on my caseload with significant well-documented spelling difficulties. When this subtest was administered to him he scored within the average range (Scaled Score of 8 and Percentile Rank of 25).  However, an administration of Spelling Performance Evaluation for Language and Literacy – SPELL-2, yielded 3 assessment pages of spelling errors, as well as 7 pages of recommendations on how to remediate those errors.  Had he received this assessment as part of an independent evaluation from a different examiner, nothing more would have been done regarding his spelling difficulties since the TOWL-4 revealed an average spelling performance due to its focus on overly simplistic vocabulary.

4. Logical Sentences – The student is asked to edit an illogical sentence so that it makes better sense. Ceiling is reached when the student makes 3 errors in a row. Again I’m not too thrilled with this subtest. Rather than truly attempting to ascertain the student’s grammatical and syntactic knowledge at sentence level a large portion of this subtest deals with easily recognizable semantic incongruities.

5. Sentence Combining – The student integrates the meaning of several short sentences into one grammatically correct written sentence. Ceiling is reached when the student makes 3 errors in a row.  The first few items contain only two sentences which can be combined by adding the conjunction “and”. The remaining items are a bit more difficult due to the a. addition of more sentences and b. increase in the complexity of language needed to efficiently combine them. This is a nice subtest to administer to students who present with difficulty effectively and efficiently expressing their written thoughts on paper. It is particularly useful with students who write down  a lot of extraneous information in their compositions/essays and frequently overuse run-on sentences. 

6. Contextual Conventions – The student is asked to write a story in response to a stimulus picture. S/he earn points for satisfying specific requirements relative to combined orthographic (E.g.: punctuation, spelling) and grammatical conventions (E.g.: sentence construction, noun-verb agreement).  The student’s written composition needs to contain more than 40 words in order for the effective analysis to take place.

The scoring criteria ranges from no credit or a score of 0 ( based on 3 or more mistakes), to partial credit, a score of 1 (based on 1-2 mistakes) to full a credit – a score of 3 (no mistakes). There are 21 scoring parameters which are highly useful for younger elementary-aged students who may exhibit significant difficulties in the domain of writing. However,  older middle school and high-school aged students as well as elementary aged students with moderate writing difficulties may attain average scoring on this subtest but still present with significant difficulties in this area as compared to typically developing grade level peers. As a result, in addition to this assessment, it is recommended that a functional assessment of grade-level writing also be performed in order to accurately identify the student’s writing needs.

7. Story Composition – The student’s story is evaluated relative to the quality of its composition (E.g.: vocabulary, plot, development of characters, etc.). The examiner first provides the student with an example of a good story by reading one written by another student.  Then, the examiner provides the student with an appropriate picture card and tell them that they need to take time to plan their story and make an outline on the (also provided) scratch paper.  The student has 5 minutes to plan before writing the actual story.  After the 5 minutes, elapses they 15 minutes to write the story.  It is important to note that story composition is the very first subtest administered to the student. Once they complete it they are ready to move on to the Vocabulary subtest. There are 11 scoring parameters that are significantly more useful for me to use with younger students as well as significantly impaired students vs. older students or students with mild-moderate writing difficulties. Again if your aim is to get an accurate picture of the older students writing abilities I definitely recommend the usage of clinical writing assessment rubrics based on the student’s grade level in order to have an accurate picture of their abilities.

OVERALL IMPRESSIONS:

Strengths:

  • A thorough assessment of basic writing areas for very severely impaired students with writing deficits
  • Flexible subtest administration (can be done on multiple occasions with students who fatigue easily)

Limitations:

  • Untimed testing administration (with the exception of story composition subtests) is NOT functional with students who present with significant processing difficulties. One 12-year-old student actually took ~40 minutes to complete each subtest.
  • Primarily  useful for students with severe deficits in the area of written expression
  • Not appropriate for students with mild-moderate needs (requires suplementation)
  • Lack of remediation suggestions based on subtest deficits
  • Weak psychometric properties

Overall, TOWL-4 can be a useful testing measure for ruling out weaknesses in the student’s basic writing abilities, with respect to simple vocabulary, sentence construction, writing mechanics, punctuation, etc.  If I identify previously unidentified gaps in basic writing skills I can then readily intervene, where needed, if needed. However, it is important to understand that the TOWL-4 is only a starting point for most of our students with complex literacy needs whose writing abilities are above severe level of functioning. Most students with mild-moderate writing difficulties will pass this test with flying colors but still present with significant writing needs. As a result I highly recommend a functional grade-level writing assessment as a supplement to the above-standardized testing.

References: 

Hammill, D. D., & Larson, S. C. (2009). Test of Written Language—Fourth Edition. (TOWL-4). Austin, TX: PRO-ED.

Disclaimer: The views expressed in this post are the personal impressions of the author. This author is not affiliated with PRO-ED in any way and was NOT provided by them with any complimentary products or compensation for the review of this product. 

Posted on by — 3 Comments

Review of Social Language Development Test Adolescent: What SLPs Need to Know

Product ImageA few weeks ago I reviewed the  Social Language Development Test Elementary  (SLDTE) and today I am reviewing the  Social Language Development Test Adolescent  (SLDTA) currently available from PRO-ED.

Basic overview

Release date: 2010
Age Range: 12-18
Authors:Linda Bowers, Rosemary Huisingh, Carolyn LoGiudice
Publisher: Linguisystems (PRO-ED as of 2014)

The Social Language Development Test: Adolescent (SLDT-A) assesses adolescent students’ social language competence. The test addresses the students ability to take on someone else’s perspective, make correct inferences, interpret social language, state and justify logical solutions to social problems, engage in appropriate social interactions, as well as interpret ironic statements.

The Making Inferences subtest of the SLDT-A assesses students’ ability to infer what someone in the picture is thinking as well as state what visual cues aided him/her in the making of that inference.

The first question asks the student to pretend to be a person in the photo and then to tell what the person is thinking by responding as a direct quote. The quote must be relevant to the person’s situation and the emotional expression portrayed in the photo.The second question asks the student to identify the relevant visual clues that he used to make the inference.

Targeted Skills include:

  1. detection of nonverbal and context clues
  2. assuming the perspective of a specific person
  3. inferring what the person is thinking and expressing the person’s thought
  4. stating the visual cues that aided with response production

A score of 1 or 0 is assigned to each response, based on relevancy and quality. However, in contrast to the SLDTE student must give a correct response to both questions to achieve a score of 1.

Errors can result due to limited use of direct quotes (needed for correct responses to indicate empathy/attention to task), poor interpretation of provided visual clues (attended to irrelevant visuals) as well as vague, imprecise, and associated responses.

The Interpreting Social Language subtest of the SLDT-A assesses students’ ability to demonstrate actions (including gestures and postures), tell a reason or use for an action, think and talk about language and interpret figurative language including idioms.

A score of 1 or 0 is assigned to each response, based on relevancy and quality. Student must give a correct response to both questions to achieve a score of 1.

Targeted Skills:

  1. Ability to demonstrate actions such as gestures and postures
  2. Ability to explain appropriate reasons or use for actions
  3. Ability to think and talk about language
  4.  Ability to interpret figurative language (e.g., idioms)

Errors can result due to vague, imprecise (off-target), or associated responses as well as lack of responses. Errors can result due to lack of knowledge of correct nonverbal gestures to convey meaning of messages.  Finally errors can result due to literal interpretations of idiomatic
expressions.

The Problem Solving subtest of the SLDT-A assesses students’ ability to offer a logical solution to a problem and explain why that would be a good way to solve the problem.

To receive a score of 1, the student has to provide an appropriate solution with relevant justification. A score of 0 is given if any of the responses to either question were incorrect or inappropriate.

Targeted Skills:

  1. Taking perspectives of other people in various social situations
  2. Attending to and correctly interpreting social cues
  3. Quickly and efficiently determining best outcomes
  4. Coming up with effective solutions to social problems
  5. Effective conflict negotiation

Errors can result due to illogical or irrelevant responses, restatement of the problem, rude solutions, or poor solution justifications.

The Social Interaction subtest of the SLDT-A assesses students’ ability to socially interact with others.

A score of 1 is given for an appropriate response that supports the situation. A score of 0 is given for negative, unsupportive, or passive responses as well as for ignoring the situation, or doing nothing.

Targeted Skills:

  1. Provision of appropriate, supportive responses
  2. Knowing when to ignore the situation

Errors can result due to inappropriate responses that were negative, unsupportive or illogical.

The Interpreting Ironic Statements subtest of the SLDT-A assesses sudents’ ability to recognize sarcasm and interpret ironic statements.

To get a score of 1, the student must give a response that shows s/he understands that the speaker is being sarcastic and is saying the opposite of what s/he means.  A score of 0 is given if the response is literal and ignores the irony of the situation.

Errors can result due to consistent provision of literal idiom meanings indicating lack of
understanding of the speaker’s intentions as well as “missing” the context of the situation. errors also can result due the the student identifying that the speaker is being sarcastic but being unable to explain the reason behind the speaker’s sarcasm (elaboration).

For example, one student was presented with a story of a brother and a sister who extensively labored over a complicated recipe. When their mother asked them about how it came out, the sister responded to their mother’s query: “Oh, it was a piece of cake”. The student was then asked: What did she mean?” Instead of responding that the girl was being sarcastic because the recipe was very difficult, student responded: “easy.”  When presented with a story of a boy who refused to help his sister fold laundry under the pretext that he was “digesting his food”, he was then told by her, “Yeah, I can see you have your hands full.” the student was asked: “What did she mean?” student provided a literal response and stated: “he was busy.”

goal-setting

The following goals can be generated based on the performance on this test:

  • Long Term Goals: Student will improve social pragmatic language skills in order to effectively communicate with a variety of listeners/speakers in all social and academic contexts
  • Short Term Goals
  1. Student will improve his/her ability to  make inferences based on social scenarios
  2. Student will improve his/her interpretation of facial expressions, body language, and gestures
  3. Student will improve his/her ability to interpret social language (demonstrate appropriate gestures and postures, use appropriate reasons for actions, interpret figurative language)
  4. Student will his/her ability to provide multiple interpretations of presented social situations
  5. Student will improve his/her ability to improve social interactions with peers and staff (provide appropriate supportive responses; ignore situations when doing nothing is the best option, etc)
  6. Student will improve his/her ability to  interpret abstract language (e.g., understand common idioms, understand speaker’s beliefs, judge speaker’s attitude, recognize sarcasm, interpret irony, etc)

Caution

A word of caution regarding testing eligibility: 

I would also not administer this test to the following adolescent populations:

  • Students with social pragmatic impairments secondary to intellectual disabilities (IQ <70)
  • Students with severe forms of Autism Spectrum Disorders
  • Students with severe language impairment and limited vocabulary inventories
  • English Language Learners (ELL) with suspected social pragmatic deficits 
  • Students from low SES backgrounds with suspected pragmatic deficits 

—I would not administer this test to Culturally and Linguistically Diverse (CLD)  students due to significantly increased potential for linguistic and cultural bias, which may result in test answers being marked incorrect due to the following:

  • Lack of relevant vocabulary knowledge will affect performance 
  • Lack of exposure to certain cultural and social experiences related to low SES status or lack of formal school instruction
    • How many of such students would know know the meaning of the word “sneer”?
    • —How many can actually show it?
  • Life experiences that the child simply hasn’t encountered yet
    • Has an —entire subtest devoted to idioms
  • —Select topics may be inappropriate for younger children
    • —Dieting
    • —Dating—
  • —Culturally biased when it comes to certain questions regarding friendship and personal values
    • —Individual vs. cooperative culture differences

What I like about this test: 

  • I like the fact that unlike the  CELF-5:M,  the test is composed of open-ended questions instead of offering orally/visually based multiple choice format as it is far more authentic in its representation of real world experiences
  • I really like how the select subtests (Making Inferences) require a response to both questions in order for the responder to achieve credit on the total subtest

Overall, when you carefully review what’s available in the area of assessment of social pragmatic abilities of adolescents this is an important test to have in your assessment toolkit as it provides very useful information for social pragmatic language treatment goal purposes.

Have YOU purchased SLDTA yet? If so how do you like using it? Post your comments, impressions and questions below.

Helpful Resources Related to Social Pragmatic Language Overview, Assessment  and Remediation:

Disclaimer: The views expressed in this post are the personal opinion of the author. The author is not affiliated with PRO-ED or Linguisystems in any way and was not provided by them with any complimentary products or compensation for the review of this product. 

Posted on by — 7 Comments

Review of Social Language Development Test Elementary: What SLPs Need to Know

sldtelAs the awareness of social pragmatic language disorders continues to grow, more and more speech language pathologists are asking questions regarding various sources of social pragmatic language testing.  Today I am reviewing one such test entitled:  Social Language Development Test Elementary  (SLDTE) currently available from PRO-ED.

Basic overview

Release date: 2008
Age Range: 6:00-11:11
Authors:Linda Bowers, Rosemary Huisingh, Carolyn LoGiudice
Publisher: Linguisystems (PRO-ED as of 2014)

This test assesses the students’ social language competence and addresses their ability to take on someone else’s perspective, make correct inferences, negotiate conflicts with peers, be flexible in interpreting situations and supporting friends diplomatically. 

The test is composed of 4 subtests, of which the first two subtests are subdivided into 2 and 3 tasks respectively.

The Making Inferences subtest (composed of 2 tasks) of the SLDT-E is administered to assess student will’s ability to infer what someone in the picture is thinking (task a) as well as state the visual cues that aided the student in the making of that inference (task b). 

On task /a/ errors can result due to student’s difficulty correctly assuming first person perspective (e.g., “Pretend you are this person. What are you thinking?”) and infering (guessing) what someone in the picture was thinking. Errors can also result due to vague, associated and unrelated responses which do not take into account the person’s context (surroundings) as well as emotions expressed by their body language.   

On task /b/ errors can result due to the student’s inability to coherently verbalize his/her responses which may result in the offer of vague, associated, or unrelated answers to presented questions, which do not take into account facial expressions and body language but instead may focus on people’s feelings, or on the items located in the vicinity of the person in the picture. 

student-think-bubble-clipart-thought-girl-color

The Interpersonal Negotiation subtest (composed of 3 tasks) of the SLDT-E is administered to assess the student’s ability to resolve personal conflicts in the absence of visual stimuli.  Student is asked to state the problem (task a) from first person perspective (e.g., pretend the problem is happening with you and a friend), propose an appropriate solution (task b), as well as explain why the solution she was proposing was a good solution (task c).

On task /a/ errors can result due to the student’s difficulty recognizing that a problem exists in the presented scenarios. Errors can also result due to the student’s difficulty stating a problem from a first person perspective, as a result of which they may initiate their responses with reference to other people vs. self (e.g., “They can’t watch both shows”; “The other one doesn’t want to walk”, etc.). Errors also can also result due to the student’s attempt to provide a solution to the presented problem without acknowledging that a problem exists. Here’s an example of how one student responded on this subtest. When presented with: “You and your friend found a stray kitten in the woods. You each want to keep the kitten as a pet. What is the problem?” A responded: “They can’t keep it.”  When presented with:  “You and your friend are at an afterschool center. You both want to play a computer game that is played by one person, but there’s only one computer. What is the problem?” A responded: “You have to play something else.”

On task /b/ errors can result due to provision of inappropriate, irrelevant, or ineffective solutions, which lack arrival to a mutual decision based on dialog.  

On task /c/ errors can result due to vague and inappropriate explanations as to why the solution proposed was a good solution.  

The Multiple Interpretations subtest assesses the student’s flexible thinking ability via the provision of two unrelated but plausible interpretations of what is happening in a photo. Here errors can result due to an inability to provide two different ideas regarding what is happening in the pictures. As a result the student may provide vague, irrelevant, or odd interpretations, which do not truly reflect the depictions in the photos. 

The Supporting Peers subtest assesses student’s ability to take the perspective of a person involved in a situation with a friend and state a supportive reaction to a friend’s situation (to provide a “white lie” rather than hurt the person’s feelings).  Errors on this subtest may result due to the student’s difficulty appropriately complementing, criticizing, or talking with peers.  Thus students who as a rule tend to be excessively blunt, tactless, or ‘thoughtless’ regarding the effect their words may have on others will do poorly on this subtest.   However, there could be situations when a high score on this subtest may also be a cause for concern (see the details on why that is HERE). That is because simply repeating the phrase “I like your ____” over and over again without putting much thinking into their response will earn the responder an average subtest score according to the SLDT-E subtest scoring guidelines.   However, such performance will not be reflective of true subtest competence and needs to be interpreted with significant caution. 

goal-setting

The following goals can be generated based on the performance on this test:

Long Term Goals: Student will improve social pragmatic language competence in order to effectively communicate with a variety of listeners/speakers in all conversational and academic contexts

Short Term Goals

  • Student will improve ability to  make inferences based on social scenarios
  • Student will improve ability to interpret facial expressions, body language, and gestures
  • Student will improve ability to recognize conflicts from a variety of perspectives (e.g., first person, mutual, etc.)
  • Student will improve ability to  resolve personal conflicts using effective solutions relevant to presented scenarios
  • Student will improve ability  to effectively  justify solutions to presented situational conflicts
  • Student will ability to provide multiple interpretations of presented social situations
  • Student will provide effective responses to appropriately support peers in social situations
  • Student will improve ability to engage in perspective taking (e.g., the ability to infer mental states of others and interpret their knowledge, intentions, beliefs, desires, etc.)

Caution

A word of caution regarding testing eligibility: 

I would also not administer this test to the following populations:

  • Students with social pragmatic impairments secondary to intellectual disabilities (IQ <70)
  • Students with severe forms of Autism Spectrum Disorders
  • Students with severe language impairment and limited vocabulary inventories
  • English Language Learners (ELL) with suspected social pragmatic deficits 
  • Students from low SES backgrounds with suspected pragmatic deficits 

—I would not administer this test to Culturally and Linguistically Diverse (CLD)  students due to significantly increased potential for linguistic and cultural bias, which may result in test answers being marked incorrect due to the following:

  • Lack of relevant vocabulary knowledge
  • Lack of exposure to certain cultural and social experiences related to low SES status or lack of formal school instruction
  • Life experiences that the child simply hasn’t encountered yet
    • For example the format of the Multiple Interpretations subtest may be confusing to students unfamiliar with being “tested” in this manner (asked to provide two completely different reasons for what is happening ina particular photo)

What I like about this test: 

  • I like the fact that the test begins at 6 years of age, so unlike some other related tests such as the CELF-5:M, which begins at 9 years of age or the informal  Social Thinking Dynamic Assessment Protocol® which can be used when the child is approximately 8 years of age, you can detect social pragmatic language deficits much earlier and initiate early intervention in order to optimize social language gains.
  • I like the fact that the test asks open-ended questions instead of offering orally/visually based multiple choice format as it is far more authentic in its representation of real-world experiences
  • I really like how the select subtests are further subdivided into tasks in order to better determine the students’ error breakdown

Overall, when you carefully review what’s available in the area of assessment of social pragmatic abilities this is an important test to have in your assessment toolkit as it provides very useful information for social pragmatic language treatment goal purposes.

Have YOU purchased SLDTE yet? If so how do you like using it?Post your comments, impressions and questions below.

NEW: Need an SLDTE Template Report? Find it HERE

Helpful Resources Related to Social Pragmatic Language Overview, Assessment  and Remediation:

 Disclaimer: The views expressed in this post are the personal opinion of the author. The author is not affiliated with PRO-ED or Linguisystems in any way and was not provided by them with any complimentary products or compensation for the review of this product. 

Posted on by — 4 Comments

Test Review of CELF-5 Metalinguistics: What SLPs Need to Know

In mid-2014, I purchased the Clinical Evaluation of Language Fundamentals®, Fifth Edition Metalinguistics (CELF®-5 Metalinguistics), which is a revision of the Test of Language Competence–Expanded.

Basic overview

Release date: 2014
Age Range: 9-21
Author: Elizabeth Wiig and Wayne Secord
Publisher: Pearson

Description: According to the manual CELF–5M was created to “identify students 9-21 years old who have not acquired the expected levels of communicative competence and metalinguistic ability for their age” (pg. 1).  In other words the test targets higher level language skills beyond the basic vocabulary and grammar knowledge and use.  The authors recommend using this test with students with “subtle language disorders” or “those on the autism spectrum”.

The test contains 5 subtests:

The Metalinguistics Profile subtest of the CELF-5:M is a questionnaire (filled out by caregiver or teacher) which targets three areas: Words, Concepts, and Multiple Meanings; Inferences and Predictions; as well as Conversational Knowledge and Use.  Its aim is to obtain information about a student’s metalinguistic skills in everyday educational and social contexts to complement the evidence of metalinguistic strengths and weaknesses identified by the other subtests that comprise the CELF-5:M test battery.

Questions address such topics as the child’s comprehension of idioms and abstract language, their predicting and inferencing abilities, their ability to deal with unpleasant situations, participate in group discussions, as well as understand jokes and sarcasm, just to name a few.  A maximum of four points  can be obtained on each of it 30 questions.  The following is the rating criteria:   a score of one  is obtained  when a child ‘never’ does something in a particular category (e.g., doesn’t get the punchline of jokes).  A score  of two  is given when a child is capable of  understanding or using  something ‘some of the time’. A score of three  is given when a child is able to understand or perform something ‘often’. Finally, a score of  four is given when a child is capable of comprehending something ‘always’ or ‘almost always’.

A word of caution,  when giving this profile  to either teachers or parents to fill out,  the SLP must ensure  that no overinflation or underestimation of scores takes place.  Frequently,  some parents may not have a clear understanding  of the extent of their child’s level of deficits.    Similarly, some teachers,  especially those who may not know the child very well,  or those who have worked with a child  for a very short period of time,  may overinflate the scores  when filling out the questionnaire.   However, the opposite may also occur.    A small group of  parents may  underestimate their children’s  abilities,   and provide poor scores   as a result  also not providing an objective picture  of the child’s level of deficits.  In such situations,  the best option may be for the SLP  to fill out the questionnaire   together  with the  parent  or teacher  in order to  provide explanations  of questions in a different categories.

The Making Inferences subtest of the CELF-5:M evaluates the student’s ability to identify and formulate logical inferences on the basis of existing causal relationships presented in short narrative texts. The student is visually and auditorily presented with a particular situation by the examiner. S/he is then asked to identify the best two out of four written answers for the ending and come up with her own additional reason other than the ones listed in the stimulus book.

On the multiple choice portion of the subtest errors can result due to provision of contradictory, unrelated and irrelevant responses. On the open ended questions portion of the subtest errors can result due to vague, confusing, incomplete, unlikely or illogical responses as well as due to contradictory and off topic answers.

 I must say that this is my least favorite subtest.   Here’s why.  In real life students are not provided with multiple choices  when asked to make  predictions or inferences.   That is why  I do not believe that performance on this subtest  is a true representation of the child’s ability in this area.

The Conversational Skills subtest of the CELF-5:M evaluates the student’s ability to initiate a conversation or respond in a way that is relevant and pragmatically appropriate to the context and audience while incorporating given words in semantically and syntactically correct sentences. S/he are presented with a picture scene that creates a conversational context and two or three words which are also printed above the pictured scene. S/he are then asked to formulate a conversationally and pragmatically appropriate sentence for the given context using all of the target words in the form (tense, number, etc.) provided.

Errors on this subtest can result due to pragmatic, semantic or syntactic errors. With respect to pragmatics errors can result due to illogical, nonsensical, vague or incomplete sentences as well as due to sentence formulation which does not take into account presented scenes. With respect to semantics errors can result due to missing or misused target words as well as due to vague, incorrect or misused verbiage. With respect to syntax errors can result due to use of sentence fragments, morphological misuse of target words (changing word forms) as well as syntact deviations on non-target words.

The Multiple Meanings subtest of the CELF-5:M evaluates the student’s ability to recognize and interpret different meanings of selected lexical (word level) and structural (sentence level) ambiguities. S/he are presented a sentence (orally and in text) that contained an ambiguity at either the word or sentence level. S/he are then asked to describe two meanings for each presented sentence.

Errors can result due to difficulty interpreting lexical and structural ambiguities as well as due to an inability to provide more than one interpretation to presented multiple meaning words.

The Figurative Language subtest of the CELF-5:M evaluates the student’s ability to interpret figurative expressions (idioms) within a given context and match each expression with another figurative expression of similar meaning given verbal and written support.

Errors on this subtest can result due to difficulty explaining the meanings of idiomatic expressions, as well as due to difficulty selecting the appropriate meaning from visually provided multiple choice answers containing related idiomatic expressions.

Based on testing the following long-term goal can be generated:

LTG: Student will improve his/her metalinguistic abilities (thinking about language) for academic and social purposes

It can also yield the following short-term goals

  1. Student will improve ability to make social inferences with an without written support
  2. Student will improve ability to to make social predictions with and without written support
  3. Student will produce (choose one/all: syntactically, semantically, pragmatically) appropriate compound and complex sentences with and without visual support
  4. Student will improve ability to explain context embedded multiple meaning words
  5. Student will improve ability to explain ambiguously worded language
  6. Student will improve ability to explain figurative language and idiomatic expressions

A word of caution regarding testing eligibility: 

What I am concerned about: 

  • It is rather costly with a sticker price of $376, which is far above other tests assessing similar abilities on the market.
  • Test administration begins at 9 years of age. However, metalinguistic abilities develop in children much earlier than nine years of age. Children and young as 6 years of age can present with glaring metalinguistic deficits but unless the examiner has access to another testing which could assess the children’s metalinguistic abilities we have to wait until the child is nine and is clearly behind his or her peers in their metalinguistic development in order to confirm the presence of deficits.
  • I also don’t understand the presence of visual and written stimuli on select testing subtests. Children are not provided with multiple-choice answers or written support in daily social and academic situations. As a result of the presence of these aids score overinflation may occur with those children who do well given compensatory strategies but who have difficulty generating novel spontaneous responses.
  • Similarly, I am concerned that higher functioning yet socially clueless students may be administered this test because the examiners may believe that it would accurately assess their higher functioning social pragmatic language abilities. However many higher functioning students will pass this test with flying colors, which is why I urge considerable caution when selecting student population for testing administration
    • Very Important: See the sensitivity and specificity details of CELF-5M above. 

Consequently the CELF-5: M administration is not for everyone. As mentioned before I would only administer portions of this test to higher functioning  (but not too high functioning) students undergoing language assessment for the first time or to higher functioning students receiving a re-evaluation, who have previously passed the Clinical Evaluation of Language Fundamentals-5 with ease. This test would not be appropriate for Severely Challenged and Challenged Social Communicators (see Winner, 2015)

I would also not administer this test to the following populations:

  • Students with intellectual disabilities
  • Students with severe language impairment and limited vocabulary inventories
  • English Language Learners (ELL) with suspected language deficits 
  • Students from low SES backgrounds*

I would not administer the CELF-5:M to the latter two groups of students due to significantly increased potential for linguistic and cultural bias stemming from lack of previous knowledge and exposure to popular culture as well as idiomatic expressions.

I would also not administer this test to Nuance Challenged Social Communicators (Winner, 2015). Specifically to Socially Anxious and Weak Interactive Social Communicators (Winner, 2015). These are the students with average or above average verbal language abilities most of whom did not have language delays when they were young. They have a ‘well-developed social radar’ and they’re highly aware of other people feelings and thoughts. However they have difficulties navigating subtle social cues of others. As a result this particular group of students tends to score quite on metalinguistic and social pragmatic testing of reduced complexity yet still present with pervasive social pragmatic language deficits.

Consequently, Clinical Assessment of Pragmatics (CAPs) administration would better suit their needs.

What I do like about this test:

This test allows me to identify more subtle language-based difficulties in verbal children with average to high average intelligence (or Emerging Social Communicators as per Winner, 2015) who present with metalinguistic and social pragmatic language weaknesses in the following areas:

  • Social predicting and inferencing
  • Conversational rules and breakdown repairs
  • Knowledge of high-level and abstract vocabulary words
  • Identification and usage of ambiguous and figurative language
  • Coherent and cohesive discourse and narrative formulation
  • Knowledge and use of multiple meaning words in a variety of conversational and text-embedded contexts

Overall, this is an nice test to have in your assessment toolkit. Consequently,if SLPs exercise caution in test candidate selection they can obtain very useful information for metalinguistic and social pragmatic language treatment goal purposes.

NEW: Need a CELF-5M Template Report? Find it HERE

3-1-19 Update: Since this review was written in October 2014, I have reviewed other tests, including the Clinical Assessment of Pragmatics (CAPs), which can be substituted and effectively used to delve into metalinguistic abilities of students with social communication difficulties. As such, while I still use the Multiple Meanings  and the Figurative Language subtests of the CELF-5M rather frequently due to its suitability for a select number of students that I assess, given its described limitations,  I would approach its purchase with caution, if it were the only test to be owned by the therapist for the purpose of assessment (it’s perfectly suitable as part of a battery but not as a standalone and only option).

Helpful Resources Related to Social Pragmatic Language Overview, Assessment  and Remediation:

 Disclaimer: The views expressed in this post are the personal opinion of the author. The author is not affiliated with Pearson in any way and was not provided by them with any complimentary products or compensation for the review of this product. 

Posted on by — 12 Comments

Articulation Assessment ToolKt

In February 2013 I did a review of the Sunny Articulation Test by Smarty Apps. At that time I really liked the test but felt that a few enhancements could really make it standout from other available articulation tests and test apps on the market. Recently, the developer, Barbara Fernandes, contacted me again and asked me to take a second look at the new and improved Sunny Articulation and Phonology Kit (SAPT-K), which is what I am doing today. Continue reading Articulation Assessment ToolKt

Posted on by — 8 Comments

The Executive Functions Test-Elementary (EFT-E): What SLPs and Parents Need to Know

Image result for Executive Functions Test: ElementaryRecently I’ve purchased the Executive Functions Test-Elementary (EFT-E) by Linguisystems  and used it with a few clients  in my private practice and outpatient hospital-based school program.  The EFT-E is a test of language skills that affect executive functions of working memory, problem solving, inferring, predicting outcomes, and shifting tasks. For those of you not familiar with executive functions (EFs), they are higher level cognitive processes involved in inhibition of thought, action and emotion, which are located in the prefrontal cortex of the frontal lobe of the brain.  Continue reading The Executive Functions Test-Elementary (EFT-E): What SLPs and Parents Need to Know