|
|
Identification and Assessment to Prevent Reading Failure in Young Children by Joseph K. Torgeson One of the most compelling findings from recent reading research is that children who get off to a poor start in reading rarely catch up. As several studies have now documented, the poor first-grade reader almost invariably continues to be a poor reader (Francis, Shaywitz, Stuebing, Shaywitz, & Fletcher, 1996; Torgesen & Burgess, 1998). And the consequences of a slow start in reading become monumental as they accumulate exponentially over time. As Stanovich (1986) pointed out in his well-known paper on the "Matthew effects" (the rich get richer and the poor get poorer) associated with failure to acquire early word reading skills, these consequences range from negative attitudes toward reading (Oka & Paris, 1986), to reduced opportunities for vocabulary growth (Nagy, Herman, & Anderson, 1985), to missed opportunities for development of reading comprehension strategies (Brown, Palinscar, & Purcell, 1986), to less actual practice in reading than other children receive (Arlington, 1984). The best solution to the problem of reading failure is to allocate resources for early identification and prevention. It is a tragedy of the first order that while we know clearly the costs of waiting too long, few school districts have in place a mechanism to identify and help children before failure takes hold. Indeed, in the majority of cases, there is no systematic identification until third grade, by which time successful remediation is more difficult and more costly. School-based preventive efforts should be engineered to maintain growth in critical word reading skills at roughly normal levels throughout the early elementary school period. Although adequate development of these skiffs in first grade does not guarantee that children will continue to maintain normal growth in second grade without extra help, to the extent that we allow children to fall seriously behind at any point during early elementary school, we are moving to a "remedial" rather than a "preventive" model of intervention. Once children fall behind in the growth of critical word reading skills, it may require very intensive interventions to bring them back up to adequate levels of reading accuracy (Allington & McGill-Franzen, 1994; Vaughn & Schumm, 1996), and reading fluency may be even more difficult to restore because of the large amount of reading practice that is lost by children each month and year that they remain poor readers (Rashotte,Torgesen, &Wagner, 1997). The purpose of this article is to provide practical advice about methods to prevent reading failure that is grounded in the new knowledge about reading we have acquired over the past two decades. My primary focus will be on early identification of children at risk for problems in learning to read as well as methods for monitoring the growth of critical early reading skills. The goal is to describe procedures that will allow educators to identify children who need extra help in reading before they experience serious failure and to monitor the early development of reading skill to identify children who may require extra help as reading instruction proceeds through elementary school. The advice provided in this article is based on the research my colleagues Richard Wagner, Carol Rashotte, and I have been conducting on both prediction and prevention of reading disabilities (Torgesen, Wagner, & Rashotte, 1994; 1997; Wagner, et al., 1994; 1997) as well as the work of many other researchers that was reviewed in an earlier issue of this magazine (Summer, 1995). It is guided by several important assumptions and facts about reading, reading growth, and reading failure that will be discussed first. Following this description of assumptions and a brief outline of some critical dimensions of preventive instruction, I will describe a number of specific measures and procedures that should prove useful as educators seek ways to focus more intensive instruction on children whose needs are greatest. Assumptions about reading, reading growth, and reading failure Most of the points that will be discussed in this section are not, in fact, mere assumptions about reading, but, rather, are well-established facts. However, I use the word assumption here to convey the sense either that the ideas are self-evident or that they are now assumed to be true based on consistent research findings.The first of these "assumptions" is, in fact, a self-evident value judgment.
Elements of an effective preventive program in reading The most critical elements of an effective program for the prevention of reading disability at the elementary school level are: (a) the right kind and quality of instruction delivered with the (b) right level of intensity and duration to the (c) right children at the (d) right time. I will briefly consider each of these elements in turn.
As stated earlier, the primary purpose of this article is to make some practical suggestions about procedures and tests that can be used to identify children for preventive reading or prereading instruction. From the outset, however, it is important to recognize that our ability to predict which children will have the most serious reading difficulties is still far from perfect. For example, in a recent comprehensive review of early identification research (1998), Scarborough pointed out that all studies continue to report substantial levels of two kinds of prediction errors. False positive errors are made when children who will eventually become good readers score below the cut-off score on the predictive instrument and are falsely identified as "at risk." In general, the proportion of this type of error has ranged between 20 percent and 60 percent, with an average of around 45 percent. That is, almost half of the children identified during kindergarten as "at risk" turn out not to have serious reading problems by the end of first grade. False negative errors occur when children who later exhibit reading problems are identified as not being at risk. Typical percentages of false negative errors range from 10 percent to 50 percent, with an average of around 22 percent. That is, on average, current procedures failed to identify about 22 percent of children who eventually end up with serious reading difficulties. In any given study, the relative proportion of false positive and false negative errors is somewhat arbitrary, since it depends on the level of the cut-off score. For example, we reported a significant reduction in the percentage of false negative errors within the same sample of children by doubling the number of children we identified as at risk (Torgesen, in press; Torgesen & Burgess, 1998). Our goal was to identify, during the first semester of kindergarten, the children most at risk to be in the bottom 10 percent in word reading ability by the beginning of second grade. When we selected the 10 percent of children who scored lowest on our predictive tests, our false negative rate was 42 percent (we missed almost half the children who became extremely poor readers). However, when we identified the 20 percent of children who scored lowest on our measures, the false negative rate was reduced to 8 percent. As a practical matter, if schools desire to maximize their chances for early intervention with the most impaired children, they should provide this intervention to as many children as possible.This is less of a waste of resources than it might seem at first glance, because, although many of the falsely identified children receiving intervention may not be among the most seriously disabled readers, most of them are likely to be below-average readers (Torgesen & Burgess, 1998). Two other pieces of information are relevant to the selection of procedures for early identification of children at risk for reading difficulties. First, prediction accuracy increases significantly the longer a child has been in school. Prediction of reading disabilities from tests given at the beginning of first grade is significantly more accurate than from tests administered during the first semester of kindergarten (Scarborough, 1998; Torgesen, Burgess, & Rashotte, 1996). Given the widely varying range of children's preschool learning opportunities, many children may score low on early identification instruments in the first semester of kindergarten simply because they have not had the opportunity to learn the skills. However, if prereading skills are actively taught in kindergarten, some of these differences may be reduced by the beginning of the second semester of school. Thus, I would recommend that the screening procedures described here not be administered until the beginning of the second semester of kindergarten, at which time they will be much more efficient in identifying children who will require more intensive preventive instruction in phonemic awareness and other early reading skills. Second, although batteries containing multiple tests generally provide better prediction than single instruments, the increase in efficiency of multi-test batteries is generally not large enough to warrant the extra time and resources required to administer them (Scarborough, 1998). Thus, I recommend an identification procedure involving administration of two tests: 1) a test of knowledge of letter names or sounds; and 2) a measure of phonemic awareness. Measures of letter knowledge continue to be the best single predictor of reading difficulties, and measures of phonemic awareness contribute additional predictive accuracy. In our experience, tests of letter name knowledge are most predictive for kindergarten children, and tests of letter-sound knowledge are most predictive for first graders. Since reading growth is influenced by noncognitive factors such as attention/motivation and home background (Torgesen, et al., 1998), as well as specific knowledge and skills, scores from these objective tests might profitably be supplemented with teacher ratings of behavior and attention to identify children most at risk for subsequent difficulties in learning to read. How should phonemic awareness be assessed? Since researchers first began to study phonological awareness in the early 1970s, more than twenty different tasks have been used to measure awareness of phonemes in words. These measures can be grouped into three broad categories: sound comparison, phoneme segmentation, and phoneme blending.
In general, these different kinds of phonemic awareness tasks all appear to be measuring essentially the same construct, or ability. Although some research (Yopp, 1988) has indicated that the tasks may involve different levels of intellectual complexity, and there may be some differences between segmentation and blending tasks at certain ages (Wagner, Torgesen, & Rashotte, 1994), for the most part, they all seem to be measuring growth in the same general ability (Holen, et al., 1995; Stanovich, Cunningham, & Cramer, 1984). Sound comparison measures are easiest and are sensitive to emergent levels of phonological awareness, while segmentation and blending measures are sensitive to differences among children during later stages of development involving refinements in explicit levels of awareness. Measures of sensitivity to rhyme ("Which word rhymes with cat - leg or mat?") are not included as measures of phonemic awareness because they appear to be measuring something a little different, and less predictive of reading disabilities, from those measure that ask children to attend to individual phonemes. For the same reason, measures of syllable awareness are not included in this group. Measures of phonemic awareness that are suited for early identification purposes include the following three widely used tests:
The measurement of letter knowledge In all of our research, we have measured letter knowledge in two ways. We measure letter name knowledge by presenting each letter in simple upper- case type on a single card and asking for its name. The score on this test is simply the number of letters for which the child can give the appropriate name. We measure letter-sound knowledge by presenting all letters in lower-case type and asking for the "sound the letter makes in words' " If a consonant letter can commonly represent two different sounds (i.e., c, g) we probe for the second sound, and we also ask for the long and short pronunciation of each vowel.The score is the total number of sounds the child can give. We have found that letter-name knowledge is a more sensitive predictor for kindergarten children, while letter- sound knowledge is a better predictor for children in first grade. Two tests that provide nationally standardized norms for performance on letter-name and letter- sound knowledge are:
Is it necessary for a test to be nationally standardized for it to be useful in early identification? This issue is important because of the potential expense of employing standardized measures in large-scale screening efforts. Nationally based norms are not required to identify which children within a given classroom or school are weakest in phonemic awareness and letter knowledge. However, the proportion of children who come to school with weak skills and knowledge in these areas will depend somewhat on specific aspects of their preschool language and literacy environment and will almost certainly vary from school to school across different communities. Tests with national norms can help to pinpoint classes or schools in which a special effort must be made to enhance phonological awareness in children prior to, or during, reading instruction. For example, a classroom in which 75 percent of the children performed below the 20th percentile (in the bottom 20 percent of all children), will require more instructional resources to prepare children for learning to read than a classroom in which only 10 percent of the children scored that low. Without norms, it is possible to identify weak children within a given class or school, but it is not possible to determine what proportion of children in the entire school may require intervention because of relatively weak prereading; skills and knowledge. On the one hand, if classroom resources allow extra help for only a fixed number of children (say, 20 percent to 30 percent), then measures without national norms can be used to identify the group of children within the classroom most in need of intervention. On the other hand, if the goal is to determine the amount of resources that may be needed to help all children with relatively weak skills in these areas, then normative measures will be required. The combination of letter knowledge and phonemic awareness tests I have recommended should take no more than ten to fifteen minutes per child to administer.The tests do not require highly trained personnel to administer them, although anyone who tests young children must be very familiar with the tests and be able to establish a supportive rapport. Monitoring growth in early reading skills Once reading instruction begins, the best predictor of future reading growth is current reading achievement, and the most critical indicators of good progress in learning to read during the early elementary period are measures of word reading skill. Children who end up as poor readers at the end of elementary school are almost invariably those who fail to make normal progress in these skills during the first years of elementary school. These children are most frequently impaired in both the ability to apply phonetic strategies in reading new words and in the ability to retrieve sight words from memory. They not only have difficulty becoming accurate in the application of these processes but also they frequently have special difficulties with becoming fluent in their application. Before discussing specific methods for the diagnostic assessment of these word reading skills, one general issue regarding reading assessment requires discussion. First, the assessment that will be recommended here is very different from the "authentic literacy assessment" that is currently advocated by many reading professionals (Paris, et al., 1992). Authentic assessment is different in at least two ways from the reading assessment measures we will be discussing. First, the goal of "authentic assessment" is to measure children's application of broad literacy skills to authentic tasks, like gathering information for a report, use of literacy as a medium for social interactions, or ability to read a selection and then write a response to it. It also seeks to measure children's enjoyment, ownership, and involvement in literacy activities both at school and at home. This kind of assessment is a clear complement to the type of assessments we will describe for monitoring growth in word level reading skills. All of the literacy outcomes that are part of authentic assessment are important parts of a total literacy assessment program. After all, if a child can read, but does not enjoy reading and does not apply important literacy skills to everyday tasks, then some important goals of literacy instruction have not been attained. However, since these procedures are focused on high-level reading outcomes, they cannot provide precise information about level of performance on important subskills in reading. If a child's overall performance on authentic literacy tasks is limited, it is frequently difficult to obtain a precise estimate of the specific component skills that are weak. The goal of the kind of assessments we will discuss here is to quantify the degree of skill a child possesses in word identification processes that have been shown to be a critical foundation for overall reading success. Commonly used diagnostic measures of word reading ability. It is beyond the scope of this article to identify all the available tests of word level reading skills. Rather, I will provide examples of measurement strategies from the most commonly used measures.
In an effort to provide measures of fluency and accuracy in word reading skills that are simple to administer and sensitive to individual differences across a broad range of reading skills, we are currently developing simple measures of Word Reading Efficiency and Non Word Efficiency (Torgesen & Wagner, 1997). In both of these measures, children are shown lists of increasingly difficult words and nonwords and asked to read as many words as possible in forty-five seconds. There are two forms to each test, and the child's score is simply the average number of words read in forty-five seconds. Initial evaluations indicate that these measures are very reliable (parallel form reliabilities vary between .97 and .98 for kindergarten through fifth grade).They are also highly correlated with corresponding measures from the Woodcock Reading Mastery Test-Revised at early grades (when children often run out of words they can read before they run out of time, correlations range from .89 to .94) and slightly less correlated (.86 to .88) at fourth grade, when fluency of word reading processes becomes more important to performance on the tests.These tests have been standardized nationally and will be available from PRO-ED publishing company in late summer 1998. If a single form of each test is administered, it will provide indices of growth in phonetic decoding and sight word reading that can be administered several times during the year and that take a very short amount of time to give. To summarize, adequate monitoring of the growth of children's word reading abilities should include out-of-context measures of word reading ability, phonetic decoding ability (as measured by ability to read nonwords), and word reading fluency. The fluency measures become more important after about second to third grade, when children have acquired a fund of word reading skills they can apply with reasonable accuracy. Measures that involve out-of-context word reading more directly assess the kinds of word reading skills that are particularly problematic for children with reading disabilities because they eliminate the contextual support on which these children rely heavily. To obtain a complete picture of overall reading development, however, it is also important to observe the way that the child integrates all sources of information about words in text, and this can only be estimated by carefully observing children as they read connected passages. About the Author: Joseph K Torgesen is currently a Distinguished Research Professor of psychology and education at Florida State University. For the last ten years, he has been part of the research effort sponsored by the National Institutes of Health to identify the nature, causes, and best approaches to instruction for children with moderate to severe reading problems. The research conducted at Florida State University that is cited in this article was supported by grants numbered HD23340 and HD30988 from the National Institute of Child Health and Human Development, and by grants from the National Center for Learning Disabilities and the Donald D. Hammill Foundation. Last Updated 01/27/2005 20:22:29 |