Skip to main content

The effect of tertiary surveys on missed injuries in trauma: a systematic review

Abstract

Background

Trauma tertiary surveys (TTS) are advocated to reduce the rate of missed injuries in hospitalized trauma patients. Moreover, the missed injury rate can be a quality indicator of trauma care performance. Current variation of the definition of missed injury restricts interpretation of the effect of the TTS and limits the use of missed injury for benchmarking. Only a few studies have specifically assessed the effect of the TTS on missed injury. We aimed to systematically appraise these studies using outcomes of two common definitions of missed injury rates and long-term health outcomes.

Methods

A systematic review was performed. An electronic search (without language or publication restrictions) of the Cochrane Library, Medline and Ovid was used to identify studies assessing TTS with short-term measures of missed injuries and long-term health outcomes. ‘Missed injury’ was defined as either: Type I) any injury missed at primary and secondary survey and detected by the TTS; or Type II) any injury missed at primary and secondary survey and missed by the TTS, detected during hospital stay. Two authors independently selected studies. Risk of bias for observational studies was assessed using the Newcastle-Ottawa scale.

Results

Ten observational studies met our inclusion criteria. None was randomized and none reported long-term health outcomes. Their risk of bias varied considerably. Nine studies assessed Type I missed injury and found an overall rate of 4.3%. A single study reported Type II missed injury with a rate of 1.5%. Three studies reported outcome data on missed injuries for both control and intervention cohorts, with two reporting an increase in Type I missed injuries (3% vs. 7%, P<0.01), and one a decrease in Type II missed injuries (2.4% vs. 1.5%, P=0.01).

Conclusions

Overall Type I and Type II missed injury rates were 4.3% and 1.5%. Routine TTS performance increased Type I and reduced Type II missed injuries. However, evidence is sub-optimal: few observational studies, non-uniform outcome definitions and moderate risk of bias. Future studies should address these issues to allow for the use of missed injury rate as a quality indicator for trauma care performance and benchmarking.

Background

Valid and reliable measures of trauma system performance are needed to guide improvement activities, benchmarking and research [1]. A common quality indicator in trauma care is missed injury, notwithstanding a systematic review finding limited validity and reliability [2].

Missed injuries occur in the time-critical and complex assessment of severely injured trauma patients in the Emergency Department (ED). Altered level of consciousness (from central nervous system injury, intoxication or sedation), distracting injury, or need for emergent surgery may impede adequate and detailed assessment of the patient. These initial examinations may therefore lead to injuries going undetected past the time when their management would avoid morbidity [314] or even mortality [5, 79, 15, 16].

The trauma tertiary survey (TTS) is the proposed solution. It is an assessment undertaken after the episode of emergency care (including primary and secondary survey, emergency surgery and interventional radiology) and includes a comprehensive general physical re-examination and review of all investigations (diagnostic imaging and blood results) within 24 hours of admission [8, 11, 12], and repeated later when the patient is conscious, cooperative and mobilised [3, 8, 13].

Missed injury is most commonly defined as an injury missed at initial assessment up to 24 hours (including both primary and secondary survey and emergency intervention) [3, 12, 13]. With the TTS becoming part of standard trauma care, a second definition refers to injuries that were missed despite TTS performance [11]. Clearly then, the impact of a TTS on missed injuries will depend on which definition of missed injuries is used. An increase in detected injuries would be expected by the first definition, but a decrease of missed injuries by the second.

The TTS should be a useful tool for missed injury benchmarking. However, any benefits from performing routine TTS might be outweighed by excessive use of resources, or over-diagnosis (in which a TTS-identified injury has little or no effect on clinically relevant, long-term outcomes) [17]. Although the TTS should, by simple intuition, improve trauma care, we set out to test this empirically by systematically reviewing the literature. By doing so, we expect to facilitate the use of missed injury as a useful quality indicator in the future.

Aims

The aim of this study was to systematically review the literature to determine the effect of the TTS in hospitalized trauma patients on both types of missed injury rates (Type I - missed at initial management, but detected by TTS; Type II - missed at initial management and by TTS, detected during hospital stay) and long-term health outcomes.

Methods

Study eligibility

We considered any study assessing a TTS using randomized or quasi-randomized trials, observational studies such as cohort, case–control and before-and-after design studies. Subjects were trauma patients admitted to any hospital, with no limits regarding age, gender, or severity of trauma.

We included any study that used the TTS as an intervention alone or as part of a larger intervention (such as a change in hospital trauma system). The TTS was defined as a review of the admitted patient within 24 hours (or after regaining consciousness) and included at least a repeated full physical examination.

The primary outcome was missed injury, defined as Type I) any injury missed at initial management (primary and secondary survey and emergency intervention) and detected by TTS, or Type II) any injury missed at initial management and TTS, detected during hospital stay. The missed injury rate was the proportion of patients with a missed injury within the study population. Secondary outcomes included long-term health outcomes including rates of injuries detected after hospital discharge and ability to return to pre-injury functional status. Eligible studies had to include either the primary or secondary outcome.

Search strategy and information sources

Relevant studies were identified using electronic searches of MEDLINE (1966 to December 2010) and OVID (1980 to December 2010) and the Cochrane Library Central Registry of controlled trials, without language restrictions. The following key words were used to conduct the search: tertiary survey, trauma survey, traumatology, diagnostic errors, delayed diagnosis, missed diagnosis, missed injury, prognosis and long-term outcomes. The full search strategy is contained in Additional file 1.

Selection of studies

Two reviewers (GK and GG) independently assessed all titles and abstracts for potential relevant articles, with any disagreement adjudicated by a third reviewer (LG). We retrieved the full-text article of any reference that appeared to meet the inclusion criteria. The eligibility of the full-text articles was assessed against the criteria of a standardized form.

Data extraction and management

The following data were extracted from the studies: title, year of publication, country of study, study design, number of participants, age and gender of participants, injury severity score (median ISS, proportion with ISS>15), mechanism of trauma (blunt vs. penetrating), presence of an altered level of consciousness and admission to intensive care unit (ICU). The outcome parameters on missed injury rates and long-term outcomes were collected when available. Authors were contacted in order to obtain missing data. We attempted meta-analysis to quantify and summarize results, but due to the inherent bias of the studies and the extent of the heterogeneity [18, 19], meta-analysis was deemed invalid and hence not reported. Primary and secondary outcomes were all proportions. Results of studies were pooled using simple weighted averages. Chi-square test was used to test for differences in proportions.

Since we anticipated possible differences in outcomes for certain demographic groups, we defined potential subgroups for analysis a priori, which included; age, gender, ISS (ISS>15), injury mechanism (blunt vs. penetrating), altered level of consciousness and ICU admission.

Assessment of risk of bias

Two of us (GK and GG) independently used the Newcastle-Ottawa Scale [20] to assess the quality of non-randomized observational studies (Additional file 2). We classified studies to either low, moderate or high risk of bias if there were respectively up to 1, 2–3 or >3 inadequate items.

This systematic review was conducted to conform to the PRISMA standard (http://www.prisma-statement.org).

Results

Our search identified a total of 4,659 of potentially relevant references. We discarded 4,615 after examining their Title or Abstract. The full-text articles of the remaining 44 were retrieved: 10 studies [3, 1113, 2125] were included in the review, (of which three were suitable for meta-analysis, Figure 1; Table 1). None were randomized or quasi-randomized trials, that is, all 10 included studies were observational, (seven prospective cohort studies [8, 12, 13, 2225]; one prospective cohort study with historical comparison [1]; and two cohort studies with a before-and-after design [11, 21]).

Figure 1
figure 1

Selection of studies.

Table 1 Description of included studies

The risk of bias was low for two studies [11, 21] and moderate in the remaining eight (Additional file 2). The selection of participants in all studies was by consecutively admitted trauma patients, ensuring appropriate representativeness and minimizing selection bias. All ten studies used either medical records or a special form to determine whether a TTS had occurred. Seven studies did not have a comparison cohort (i.e. a cohort without TTS performed), increasing their risk of bias [8, 12, 13, 2225]. There was insufficient information to assess the comparability section of the Newcastle-Ottawa scale for eight studies. The remaining two studies [11, 21] had comparable demographics for exposed and non-exposed cohorts. One study had a higher admission rate to the trauma ICU in the cohort receiving the TTS compared to those in the cohort who did not (30% vs. 20% admission rate) [11].

Missed injury rate – in patients receiving TTS

Nine [3, 12, 13, 2125] of the included studies used Type I missed injury as outcome (missed at primary and secondary survey and detected by TTS), with the remaining single other study [11] utilizing Type II missed injury (injury missed by both initial assessment and the TTS).

Type I missed injury rate – in patients receiving TTS

The overall Type I missed injury rate in cohorts with a TTS conducted was 4.3% (Table 2). The two largest studies [12, 23] had similar Type I missed injury rates (1.3% and 1.6%, respectively), while a medium-sized study [21] had a Type I missed injury rate of 6.2% (unpublished data provided by author). The remaining studies reported Type I missed injury rates varying from 9.3 to 19.3%, with one small study [8] being an outlier (65%). In this study, a dedicated trauma surgery fellow aware of the purpose of the study performed all tertiary surveys.

Table 2 Outcomes – Type I missed injury rates

Type II missed injury rate – in patients receiving TTS

Only one study reported Type II missed injury, with a rate of 1.51% after TTS introduction [11] Table 3.

Table 3 Outcomes – Type II missed injury rates

Type I and II missed injury rate – before and after introduction of TTS

Two studies [3, 21] compared Type I missed injury and one study [11] compared Type II missed injury using before and after studies. Type I missed injuries increased as a result of the TTS (3% vs. 7%, P < 0.01), and type II missed injuries decreased (2.4% vs. 1.5%, P = 0.01).

Clinical relevance of missed injuries

Table 4 summarizes the anatomical areas of missed injury, change in management and resultant morbidity or mortality as reported by the individual studies. There was a large variation in anatomical distribution of missed injuries, with orthopaedic extremity injuries, spine related injuries and facial injuries most commonly reported. The proportion of patients with missed injury requiring surgical intervention varied between 10-30%, which equates to 0.1-5% of the total population of these studies [3, 8, 12, 13, 22, 23]. Only two deaths were reported specifically as a result of a missed injury [8].

Table 4 Description of missed injuries

Subgroup analyses

Only one study investigated a difference in missed injury rates after introduction of a TTS for any of the pre-defined subgroups [11]. It reported a decrease in Type II missed injuries in patients admitted to a trauma intensive care unit (5.7% vs. 3.4%, P < 0.05). Another reported a paediatric trauma population (Type I missed injury rate: 15.8%), but did not specifically investigate age as a factor of interest [13]. A third study reported a lower mortality trend (5.4% vs. 4.1%, P = 0.17) associated with a higher detection of Type I missed injuries by TTS, introduced as part of a trauma service (3.6% vs. 6.2%, P < 0.01, via author communication) [21].

No other included study assessed differences in (any type of) missed injury rate after introduction of a TTS for the other pre-defined subgroups (age, gender, ISS, mechanism of injury or altered level of consciousness).

Long-term health outcomes

No studies that assessed the effect of the TTS on long-term health outcome were identified.

Completeness of data

Data for the two studies included in the analysis of the systematic review (using missed injury rate at initial assessment, detected by TTS) were not complete in the original publications. One quoted a historical overall missed injury rate of 2% (without data on sample size) [3] and another did not report missed injury data in the published manuscript [21]: we obtained this information by writing to the authors directly.

Discussion

This systematic review found empirical evidence that the TTS improves trauma care by increasing Type I missed injuries and reducing Type II missed injuries.

Limitations

Our findings were based on weak evidence: there were no relevant randomized studies, so only observational studies with their inherent risk of bias were available. Meta-analysis was attempted, but due to few studies being eligible and being prone to bias as well as substantial heterogeneity, we have not reported this. We were unable to assess the effect of TTSs on morbidity, so any improvement in patient outcomes consequent on reduction in missed injuries has to be inferred.

Other shortcomings included variation in the trauma patient populations (one study including paediatric trauma patients only [13]); geography (with one study conducted in Uganda [24] where trauma patterns and trauma care may be different from those of the other studies); and in the intervention (differently defined in two studies - one study [22] aimed to decrease missed injuries by formalizing the radiology review component of the TTS, while another [21] assessed the effect of implementing a complete trauma service, of which a TTS was a component).

The definition of missed injury varied between studies: one study defined missed injury as any injury that escaped detection at time of the TTS [11], (i.e. Type II). The other nine studies, including two before-and-after studies, used the more commonly used ‘any injury missed by primary and secondary survey, and detected as a result of the TTS’ (i.e. Type I), which really represents a delayed diagnosis (or increase in injury detection). For example, in one study [21] the TTS was associated with increased missed injury rate, but reduced mortality. This seems counter-intuitive until one realises this is related to Type I missed injuries, leading to more frequent detection at 24 hours by TTS.

This systematic review highlights several issues. Firstly missed injury needs a consistent, clear and expanded definition to facilitate future research and provide a tool for benchmarking. The use of these differences in definition precludes overall comparison of studies and need to be made explicit in order to legitimately compare studies. We propose a classification of missed injuries (Table 5). It is likely that the third group in this proposed classification (Type III: missed injury detected after hospital discharge) has been under-reported, since there are no published data.

Table 5 Missed injury classification

Secondly, for the nine studies using the Type I missed injury definition, a mean injury detection rate of 4.3% was found. This can be used as a yardstick to compare future studies assessing Type I missed injuries. This may yet be an over-estimation of Type I missed injuries (or rather, delayed diagnoses), since the reported missed injury rate was approximately 1.5% in the two larger studies that together included more than 9,000 subjects and where investigator bias would have been minimal.

Furthermore, we summarized the anatomical distribution of missed injuries and how this changed management as reported by the individual studies (Table 4). This relates to the clinical relevance of these injuries, since it would be reasonable to expect at least delayed recovery or even prolonged morbidity without these interventions. Very few deaths as a result of a missed injury were reported and need for a change in management in the form of surgical intervention was variable or not reported. None of the studies included in this systematic review pre-defined clinical significance in the design of the study. Three studies discussed clinical relevance of missed injuries, with the common denominator being whether the missed injury would have lead to morbidity or mortality as judged by expert opinion (Table 6). Interestingly, one study defined a clinically significant missed injury as any change in management, including ordering further imaging [22]. We did not pre-define clinically relevant missed injury as an outcome of this systematic review. The available data suggests that the current literature does not have a widely agreed definition for clinically significant missed injury, evidenced by the variable reporting and outcomes. A more consistent and reproducible approach to this issue is warranted. Very few studies related the TTS to morbidity and mortality and as such we cannot comment on the effect the TTS had on patient outcomes.

Table 6 Definitions of clinically significant missed injury amongst included studies

Lastly, we found no reporting of long-term outcomes after TTS. Studies have reported long-term outcomes for the multiple injured patients [26] or subgroups of patients with specific injuries [27], but not the effect of the TTS per se.

Conclusions

In cohorts with a TTS conducted, the Type I missed injury rate was 4.3% and Type II missed injury rate was 1.5%. The TTS increased Type I missed injuries (or injury detection by TTS), and decreased Type II missed injuries (less injuries missed by TTS). This is based on few studies with risk of bias, and as such the clinical effect of TTS is not fully known. This review emphasizes the lack of studies reporting long-term outcomes after a TTS. This may be due to assumed benefits of the TTS. Quantifying the actual effect on longer-term health outcomes, including missed injuries after hospital discharge, may support a more structured and widespread use of the TTS. Future studies using consistent outcome definitions are warranted to allow for the use of missed injury rate as a quality indicator for trauma care performance and benchmarking.

References

  1. Gruen RL, Gabbe BJ, Stelfox HT, Cameron PA: Indicators of the quality of trauma care and the performance of trauma systems. Br J Surg. 2012, 99 (Suppl 1): 97-104.

    Article  PubMed  Google Scholar 

  2. Stelfox HT, Straus SE, Nathens A, Bobranska-Artiuch B: Evidence for quality indicators to evaluate adult trauma care: a systematic review. Crit Care Med. 2011, 39: 846-859. 10.1097/CCM.0b013e31820a859a.

    Article  PubMed  Google Scholar 

  3. Enderson BL, Reath DB, Meadors J, Dallas W, DeBoo JM, Maull KI: The tertiary trauma survey: a prospective study of missed injury. J Trauma. 1990, 30: 666-670. 10.1097/00005373-199006000-00002.

    Article  CAS  PubMed  Google Scholar 

  4. Frawley PA: Missed injuries in the multiply traumatized. Aust N Z J Surg. 1993, 63: 935-939. 10.1111/j.1445-2197.1993.tb01722.x.

    Article  CAS  PubMed  Google Scholar 

  5. Aaland MO, Smith K: Delayed diagnosis in a rural trauma center. Surgery. 1996, 120: 774-779. 10.1016/S0039-6060(96)80030-4.

    Article  CAS  PubMed  Google Scholar 

  6. Robertson R, Mattox R, Collins T, Parks-Miller C, Eidt J, Cone J: Missed injuries in a rural trauma center. Am J Surg. 1996, 172: 564-567. 10.1016/S0002-9610(96)00247-4.

    Article  CAS  PubMed  Google Scholar 

  7. Furnival RA, Woodward GA, Schunk JE: Delayed diagnosis of injury in pediatric trauma. Pediatrics. 1996, 98: 56-62.

    CAS  PubMed  Google Scholar 

  8. Janjua KJ, Sugrue M, Deane SA: Prospective evaluation of early missed injuries and the role of tertiary trauma survey. J Trauma. 1998, 44: 1000-1007. 10.1097/00005373-199806000-00012.

    Article  CAS  PubMed  Google Scholar 

  9. Buduhan G, Donna I, McRitchie: Missed injuries in patients with multiple trauma. J Trauma. 2000, 49: 600-605. 10.1097/00005373-200010000-00005.

    Article  CAS  PubMed  Google Scholar 

  10. Houshian S, Larsen MS, Holm C: Missed injuries in a level I trauma center. J Trauma. 2002, 52: 715-719. 10.1097/00005373-200204000-00018.

    Article  PubMed  Google Scholar 

  11. Biffl WL, Harrington DT, Cioffi WG: Implementation of a tertiary trauma survey decreases missed injuries. J Trauma. 2003, 54: 38-44. 10.1097/00005373-200301000-00005.

    Article  PubMed  Google Scholar 

  12. Vles WJ, Veen EJ, Roukema JA, Meeuwis JD, Leenen LP: Consequences of delayed diagnoses in trauma patients: a prospective study. J Am Coll Surg. 2003, 197: 596-602. 10.1016/S1072-7515(03)00601-X.

    Article  PubMed  Google Scholar 

  13. Soundappan SV, Holland AJ, Cass DT: Role of an extended tertiary survey in detecting missed injuries in children. J Trauma. 2004, 57: 114-118. 10.1097/01.TA.0000108992.51091.F7.

    Article  CAS  PubMed  Google Scholar 

  14. Brooks A, Holroyd B, Riley B: Missed injury in major trauma patients. Injury. 2004, 35: 407-410. 10.1016/S0020-1383(03)00219-5.

    Article  PubMed  Google Scholar 

  15. Albrektsen SB, Thomsen JL: Detection of injuries in traumatic deaths: the significance of medico-legal autopsy. Forensic Sci Int. 1989, 42: 135-143. 10.1016/0379-0738(89)90206-5.

    Article  CAS  PubMed  Google Scholar 

  16. Stothert JC, Gbaanador GB, Herndon DN: The role of autopsy in death resulting from trauma. J Trauma. 1990, 30: 1021-1026. 10.1097/00005373-199008000-00012.

    Article  PubMed  Google Scholar 

  17. Welch HG, Schwartz LM, Woloshin S: Overdiagnosed. Making people sick in the pursuit of health. 2011, Boston Mass: Beacon Press

    Google Scholar 

  18. Higgins JP, Thompson SG: Quantifying heterogeneity in a meta-analysis. Stat Med. 2002, 21: 1539-1558. 10.1002/sim.1186.

    Article  PubMed  Google Scholar 

  19. Higgins JP, Thompson SG, Deeks JJ, Altman DG: Measuring inconsistency in meta-analyses. BMJ. 2003, 327: 557-560. 10.1136/bmj.327.7414.557.

    Article  PubMed Central  PubMed  Google Scholar 

  20. Wells GA, Shea B, O’Connell D, Peterson J, Welch V, Losos M, Tugwell P: The Newcastle-Ottawa Scale (NOS) for assessing the quality of non-randomised studies in metaanalyses. 2011,http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp,

    Google Scholar 

  21. Ursic C, Curtis K, Zou Y, Black D: Improved trauma patient outcomes after implementation of a dedicated trauma admitting service. Injury. 2007, 38: 112-117. 10.1016/j.injury.2006.07.044.

    Article  Google Scholar 

  22. Hoff WS, Sicoutris CP, Lee SY, Rotondo MF, Holstein JJ, Gracias VH, Pryor JP, Reilly PM, Doroski KK, Schwab WC: Formalized radiology rounds: the final component of the tertiary survey. J Trauma. 2004, 56: 291-295. 10.1097/01.TA.0000105924.37441.31.

    Article  PubMed  Google Scholar 

  23. Huynh TT, Blackburn AH, McMiddleton-Nyatui D, Moran KR, Thomason MH, Jacobs DG: An initiative by midlevel providers to conduct tertiary surveys at a level I trauma center. J Trauma. 2010, 68: 1052-1058. 10.1097/TA.0b013e3181d87789.

    Article  PubMed  Google Scholar 

  24. Okello CR, Ezati IA, Gakwaya AM: Missed injuries: a Ugandan experience. Injury. 2007, 38: 112-117. 10.1016/j.injury.2006.07.044.

    Article  PubMed  Google Scholar 

  25. Howard J, Sundararajan R, Thomas SG, Walsh M, Sundararajan M: Reducing missed injuries at a level II trauma center. J Trauma Nurs. 2006, 13: 89-95.

    Article  PubMed  Google Scholar 

  26. Steel J, Youssef M, Pfeifer R, Ramirez JM, Probst C, Sellei R, Zelle BA, Sittaro NA, Khalifa F, Pape HC: Health-related quality of life in patients with multiple injuries and traumatic brain injury 10+ years postinjury. J Trauma. 2010, 69: 523-530. 10.1097/TA.0b013e3181e90c24. Discussion 530–1

    Article  PubMed  Google Scholar 

  27. McCarthy ML, MacKenzie EJ, Durbin DR, Aitken ME, Jaffe KM, Paidas CM, Slomine BS, Dorsch AM, Christensen JR, Ding R: Children’s health after trauma study group. Arch Pediatr Adolesc Med. 2006, 160: 252-260. 10.1001/archpedi.160.3.252.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Assistant Professor Michael Steele for statistical advice.

Queensland Emergency Medicine Research Foundation (QEMRF).

Meetings: Accepted for to ESTES (Basel, May 2012) and ICEM (Dublin, June 2012).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gerben B Keijzers.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

Design and concept (all authors), literature search (GK and GG), data extraction (GK and GG), data adjudication (LG), data analysis (GK), data interpretation (GK, LG, CdM), manuscript drafts and approval of final manuscript (All authors), responsibility for paper as a whole (GK). All authors read and approved the final manuscript.

Electronic supplementary material

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Keijzers, G.B., Giannakopoulos, G.F., Del Mar, C. et al. The effect of tertiary surveys on missed injuries in trauma: a systematic review. Scand J Trauma Resusc Emerg Med 20, 77 (2012). https://doi.org/10.1186/1757-7241-20-77

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1757-7241-20-77

Keywords