Sports and Exercise Medicine

Open journal

ISSN 2379-6391

Retrospective Designs in Sports Injury Surveillance Studies: All is not Lost

Swarup Mukherjee*

Swarup Mukherjee, MD, PhD

Assistant Professor, Department of Physical Education and Sports Science, National Institute of Education, Nanyang Technological University, 50 Nanyang Ave, Singapore; E-mail: swarup.mukherjee@nie.edu.sg

Epidemiological research on sports injury and illness has significantly grown over the past two decades with increased recognition and support from sports governing bodies and international sports organizations. Collective evidence from different sports is suggestive that sports-related injuries can be prevented.1,2,3,4 Epidemiological studies are important to gain insights on the magnitude of the problem in terms of incidence rates, risk, severity and causes and subsequently to develop effective, sports-specific and sustainable injury prevention strategies. Therefore, sports injury surveillance methodologies should be appropriate to the sport as well as to the specific context especially in terms of age, gender, level of participation, tournament or season-based, cross-sectional or longitudinal and if a prevention program needs to be implemented.

Study designs that help address clinical research questions are broadly categorized into experimental and observational types. In sports injury research observational studies are most commonly either prospective or retrospective in nature. Retrospective studies collect historical data over a fixed period of time whereas prospective studies follow a cohort over a set future period of time.5 Prospective studies are generally considered to be of higher reliability as they can generate real-time knowledge of developments, closely monitor the exposure time, injury outcome and provide more accurate estimation of the risk and incidence. Retrospective injuries on the other hand mostly involve self-reported data based on athlete’s memory to recall the events. This can introduce memory recall bias6 with usually the major injuries being recalled leading to underestimation of the actual injury incidence and thus increasing the risk the retrospective contamination. These issues may actually discourage many sports injury researchers to consider retrospective study designs.

While it is certainly preferable to plan a prospective approach to sports injury surveillance, they can be time-consuming, resource requiring and expensive to undertake owing to the length of data collection and the degree of monitoring involved.7 Retrospective studies on the other hand are time and resource efficient and may also encourage greater athlete participation compliance especially with team sports and elite athlete populations. Therefore, the value of retrospective designs cannot be undermined. A well-planned retrospective study design can have elements of reliability, validity and credibility to generate systematic high-quality data that may be valuable to provide insights into injury risk factors and mechanisms and develop injury prevention strategies. However, the issues with retrospective study designs should be pre-empted and methods appropriately conceived and implemented.

The key issue with retrospective study designs is memory recall bias. While it may not be possible to avoid it altogether, certain approaches in the methods can be used to minimize its extent. A recent study on competitive Dragon Boating,8 a traditional sport similar to rowing provides a good example of approaches to minimize the extent of recall bias in retrospective sports injury surveillance studies.

DEVELOP CONTEXT-SPECIFIC INJURY SURVEILLANCE QUESTIONNAIRE

Apparently most retrospective studies are based on self-reported data that is dependent on the athlete’s ability to correctly recall the events. This may lead to recall bias and consequently invalid conclusions about injury epidemiology and the association between past and future injuries.9 An effective approach to provide a systematic and structured form to self-reported data would be to develop a context-specific injury surveillance questionnaire. This ensures consistency in reporting injuries. Many organizations have developed sports-specific injury surveillance systems10,11 that can serve as a credible basis to develop a customized questionnaire for retrospective injury data acquisition. Ascertaining the reliability and the validity of the questionnaire prior to its implementation can further add to the robustness of the method.

DELIVERY OF THE QUESTIONNAIRES

It is without doubt that physical distribution of questionnaires lead to 100% response rates and a higher likelihood of complete responses.8 Moreover, the physical presence of the research team members during distribution can serve to ensure completion and correctness of all data fields, clarify questions or doubts related to the type, nature and onset of injury, and exclude the non-sport related injuries. This increases the validity of the responses. However, physical distribution is a time and resource intensive exercise. Now-a-days, online options using the internet provide convenient and cost-free method of delivering the questionnaire to maximum number of recipients over a large geographical area. However, online survey methods in knowledge-based studies have reported low response rates.12 Online methods are yet to be used on a large scale especially in retrospective sports injury surveillance studies. A few studies have used online survey methods in community-based sports but no information has been provided on the response rates.13 Moreover, certain barriers related to time, technical issues, data entry and adjustments to the new system have been reported while implementing online surveillance tools.14

LIMIT THE LENGTH OF RECALL TIME

While retrospective studies can gather data over any length of time in the past, limiting the length of time over which the athletes are asked to recall the events can reduce the recall bias.15 It is reasonable to speculate that a longer time frame has lesser likelihood of the accuracy of the recall. While the time frame of recall accuracy and validity is yet to be established, it is logical that shorter time frames have higher recall accuracy. However, evidence suggests a fair degree of success using a 12 month recall period.8,9,16 It therefore seems advisable to limit the recall time to 12 months in retrospective injury surveillance studies. This also implies that for season-based studies, the data should be collected as soon as possible on completion of the season.

PROVIDE CLEAR INJURY DEFINITION

The potential sources of error in injury surveillance data are unclear and inconsistent injury definitions, misinterpretations of injury types and misdiagnoses.17 These issues can be substantially minimized using the surveillance questionnaire. Providing clear and context-specific injury definition can facilitate better recall of the events through specific prompts.18 This strategy can also be used to provide clearly stated criteria for new/acute, recurrent, aggravation and overuse injuries8 thus enhancing the scope of the study. In addition to injury definition, additional information like providing a brief description of the onset and progress of the injury and if the injury led to missing training and competition likely to result in better recall and better elucidation of the details of the injury and thus enhance the validity of data interpretation. In addition, clear prompts regarding medical attention and time loss in the questionnaire can make it simpler for the athletes to provide information on the severity categorization of the injuries.

ANATOMICAL LOCATION OF INJURY

Many athletes may not be able to clearly distinguish and recall specific body parts. For example, the athlete may report upper limb injury but not able to specifically state whether it was the forearm, elbow or the shoulder. However, body part distribution of injuries is important information to explain the nature and mechanism of injury as some parts like the shoulder and lower back are more susceptible to overuse injuries. Providing an outline sketch of front and back of the human body and the list of different body parts in the questionnaire can stimulate better recall of the specific part injured. In this respect the presence of research team members during the occasion can also be helpful as the athlete can seek help to respond accurately.

USE DIVERSE SOURCES OF INFORMATION

It is quite natural that the athlete may not be able to recall all the injuries sustained in the past over a particular time frame. However, the accuracy of recall may be improved by asking the teammates, team captains, parents, trainers and coaches. In addition, many athletes tend to maintain regular training and event logs. Many a times the athletes also retain copies of medical documents in their diaries. These personal periodic logs and other relevant documents can serve as valuable references during injury documentation to improve the accuracy of the data and should be made use of in retrospective injury surveillance studies.

In summary, retrospective sports injury surveillance studies have the advantage of being time, cost and resource efficient and encourage greater participant compliance. However, the element of recall bias can significantly affect the validity of the data. It is therefore critical for sports injury researchers to pre-empt this possibility and adopt context-specific measures to maximize the accuracy, reliability and validity of the data.

1. Steffen K, Myklebust G, Olsen O, et al. Preventing injuries in female youth football – a cluster-randomized controlled trial. Scand J Med Sci Sports. 2008; 18: 605-614. doi: 10.1111/j.16000838.2007.00703.x

2. Gabbett T. Reductions in pre-season training loads reduce training injury rates in rugby league players. Br J Sports Med. 2004; 38: 743-749. doi: 10.1136/bjsm.2003.008391

3. Emery CA, Rose MS, McAllister JR, et al. A prevention strategy to reduce the incidence of injury in high school basketball: A cluster randomized controlled trial. Clin J Sport Med. 2007; 17: 17-24. doi: 10.1097/jsm.0b013e31802e9c05

4. Olsen O, Myklebust G, Engebretsen L, et al. Exercises to prevent lower limb injuries in youth sports: Cluster randomised controlled trial. BMJ. 2005; 330: 449. doi: 10.1136/bmj.38330.632801.8F

5. Palmer-Green D. Epidemiology of sports injury and illnesses. In: Whyte GP, Loosemore M, Williams C, eds. ABC of Sports and Exercise Medicine. 4th Ed. Wiley Blackwell, West Sussex, UK, 2015: 2.

6. Rothman K. Epidemiology: an introduction. Oxford University Press. New York, 2002: 98.

7. McNeil D. Epidemiological research methods. John Wiley and Sons Inc. Chichester, 1996: 1-27.

8. Mukherjee S, Leong HF, Chen S, et al. Injuries in competitive dragon boating. Orthop J Sp Med. 2014; 2: doi: 10.1177/2325967114554550

9. Gabbe BJ, Finch CF, Bennel KL, Wajswelner H. How valid is a self reported 12 month sports injury history? Br J Sp Med. 2003; 37: 545-547. doi: 10.1136/bjsm.37.6.545

10. Dick R, Agel J, Marshall SW. National college athletic association injury surveillance system commentaries: Introduction and methods. J Athl Tr. 2007; 42: 173-182.

11. Fuller CW, Ekstrand J, Junge A, et al. Consensus statement on injury definitions and data collection procedures in studies of football (soccer) injuries. Br J Sports Med. 2006; 40: 193-201. doi: 10.1136/bjsm.2005.025270

12. Mazerolle SM, Scruggs IC, Casa D, et al. Current knowledge, attitudes, and practice of certified athletic trainers regarding recognition and treatment of exertional heat stroke. J Ath Tr. 2010; 45: 170-180. doi: 10.4085/1062-6050-45.2.170

13. Yard EE, Collins CL, Comstock RD. A comparison of high school injury surveillance data reporting by certified athletic trainers and coaches. J Ath Tr. 2009; 44: 645-652. doi: 10.4085/1062-6050-44.6.645

14. Ekegren CL, Donaldson A, Gabbe BJ, Finch CF. Implementing injury surveillance systems alongside injury prevention programs: Evaluation of an online surveillance system in a community setting. Injury Epidemiol. 2014; 1: 19. doi: 10.1186/s40621-014-0019-y

15. Jenkins P, Earle-Richardson G, Tucker-Slingerland D, et al. Time dependent memory decay. Am J Ind Med. 2002; 41: 98-101. doi: 10.1002/ajim.10035

16. Twellar M, Verstappen F, Huson A. Is prevention of sports injuries a realistic goal? A four-year prospective investigation of sports injuries among physical education students. Am J Sp Med. 1996; 28: 528-534. doi: 10.1177/036354659602400419

17. Ekegren CL, Gabbe BJ, Finch CF. Sports injury surveillance systems: A review of methods and data quality. Sp Med. 2015. doi: 10.1007/s40279-015-0410-z

18. Askling T, Lund H, Saartok T, et al. Self-reported hamstring injuries in student dancers. Scand J Med Sci Sport. 2002; 12: 230-235. doi: 10.1034/j.1600-0838.2002.00237.x

LATEST ARTICLES

Unraveling the Mysteries of Type-A Aortic Dissection Using POCUS/Echocardiography

Syeda Rukh*, Sathyanarayana Machani and Milind Awale

doi.

Blood Sample from the Patient

Hypertriglyceridemia-Induced Pancreatitis: A Case Report and Literature Review

Maarten Bulterys, Melvin Willems* and Agnes Meersman

doi.

From Neck Pain to a Life-Threatening Condition: A Case Report

Floris Vandewoude* and Sören Verstraete

doi.

LATEST ARTICLES