- Research article
- Open Access
Development of a Health-Related Quality of Life Questionnaire (HRQL) for patients with Extremity Soft Tissue Infections (ESTI)
BMC Infectious Diseases volume 6, Article number: 148 (2006)
Past clinical trials of antimicrobial treatment in soft tissue infections have focused on non-standardized clinical and physiological outcome variables, and have not considered the subjective experience of patients. The objective of this study was to develop a health-related quality of life questionnaire (HRQL) for patients with extremity soft tissue infections (ESTI) for future use in clinical trials.
The design of this study followed published guidelines and included item generation, item reduction, and questionnaire preparation. Study subjects were consenting English-speaking adults with acute ESTI requiring prescription of at least two days of outpatient intravenous antibiotic therapy.
A list of 49 items that adversely impact the quality of life of patients with ESTI was generated by literature review, informal health professional feedback, and semi-structured interviews with twenty patients. A listing of these items was then administered to 95 patients to determine their relative importance on quality of life. A questionnaire was prepared that included the twenty most important items with a 5-point Likert scale response. Questionnaire domains included physical symptoms, problems performing their activities of daily living, impairment of their emotional functioning, and difficulties in their social interactions as related to their ESTI. The final questionnaire was pre-tested on a further ten patients and was named the ESTI-Score.
The ESTI-Score is a novel instrument designed to quantify the impact of ESTI on quality of life. Future study is required to determine its validity and responsiveness before use as an outcome measure in clinical trials.
Soft tissue infections (STI) are among the most common infectious diseases requiring antibiotic treatment [1, 2]. Despite their prevalence and importance, the optimal treatment of STI's has not been well defined and considerable practice variation exists with respect to their management. Although a wide variety of different antibiotic classes, doses, durations, and methods of delivery have been compared in clinical trials, few studies have shown superiority of a given treatment . While this may represent true clinical equipoise, it may also at least in part reflect the insensitivity of outcome measures used. These most commonly are non-standardized, disease-oriented, physician assessments that may not adequately assess the effect of therapy on the patient's subjective treatment responses.
The use of Health Related Quality of Life (HRQL) scales have been developed and demonstrated to be useful and valid primary outcome measures in clinical trials in a number of diseases not limited to asthma, rhinoconjunctivitis, polycystic ovarian syndrome, and sleep apnea [4–8]. Although quality of life measures have been developed for chronic skin diseases, no HRQL clinical instrument has been previously developed for acute extremity soft tissue infections (ESTI) [9, 10]. The objective of this study was therefore to develop a disease-specific instrument to measure the HRQL in patients with ESTI for future use in clinical trials.
The study methodology followed previously published guidelines for development of HRQL instruments [11, 12]. This process included item generation, item reduction, questionnaire preparation, and questionnaire pre-testing. The study protocol was reviewed and approved by the Conjoint Health Research Ethics Board of the University of Calgary. All subjects provided written informed consent prior to participation. In addition to questionnaire specific data, information was also collected on patient demographics, co-morbidities, and the treatments prescribed.
Patients with ESTI were enrolled from the Home Parenteral Therapy Program (HPTP) clinic at the Peter Lougheed Centre, Calgary, Alberta, Canada . The HPTP is an ambulatory clinic that serves patients with a variety of infectious diseases requiring parenteral antimicrobial therapy. It is attended by fully certified infectious disease specialists. Between November 2003 and May 2005 a convenience sample of patients was screened for inclusion in the study. Patients were eligible for the study if they met all of the following: 1) age at least eighteen at the time of enrollment, 2) a diagnosis of ESTI made by an HPTP physician, and 3) judged to require two or more days of parenteral antibiotics by the HPTP physician. Patients were excluded if they had any of the following: 1) a chronic ulcer with no evidence of acute infection, 2) inability to speak and read English, 3) they were expected to have poor adherence to the study protocol, or 4) they were ineligible for the outpatient HPTP clinic (eg: admitted to hospital). Patients were otherwise included in the study irrespective of the severity of their illness, their co-morbidities, or specific treatment regimen prescribed.
The goal of this phase was to identify all possible items that might adversely impact the quality of life of patients with ESTI. These items were identified using four standard methods: 1) a review of the published literature on the clinical features of soft tissue infections, 2) a review of HRQL scales in other medical conditions, 3) semi-structured interviews with a group of patients, and 4) the collective experience of the study investigators and clinic staff. The patient interviews were performed by trained research nurses and took approximately 30 minutes. The interview used open-ended questions to identify all possible areas of dysfunction (including physical symptoms, activities of daily living, social and emotional well being) that might be adversely affected by their ESTI.
The purpose of this phase was to identify the most important items for patients with ESTI. Study participants independently completed a questionnaire containing the items identified in the item generation phase. They were asked to identify which of the items were problems for them. For items identified as being a problem, they were asked to rate how important it was on a 5-point Likert scale (ranging 1, not very important, to 5, extremely important). The overall importance of each item was determined by calculating its frequency importance product (FIP). This was done by multiplying the frequency that a particular item was reported as a problem by the mean importance assigned to it .
Final questionnaire preparation
The twenty items with the highest FIPs were incorporated into the final questionnaire. It was pre-tested on another group of consenting patients to ensure that it was free of grammatical errors and that individual items and the overall format were easily understood.
Sample sizes were chosen a priori to be 20 patients for item generation and 100 patients for item reduction based on the guidelines of Kirshner and Guyatt . All statistical analysis was performed using Stata 8.0 (StataCorp, College Station, Texas). Medians with interquartile ranges (IQR) were used to describe non-normally distributed variables and means with standard deviations (SD) for normally distributed variables. Group means were compared using Fisher's t-test. A p-value <0.05 was deemed to represent statistical significance.
Through interviews with twenty consenting patients with ESTI, a review of the relevant literature, and the collective experience of the study investigators, a list of 49 items was generated for inclusion in the item reduction questionnaire and these are shown in Table 1.
Ninety-five patients were ultimately included in this stage. One hundred and three patients were initially enrolled but eight patients were subsequently excluded because they did not maintain enrollment criteria. In six patients the reason for exclusion was an alternate final diagnosis [osteomyelitis (three); gout (two); deep venous thrombosis (one)]. One patient was subsequently excluded because he was recognized later to be seventeen years of age at the time of enrollment. One patient was inadvertently enrolled into the study on two separate occasions and as such only the first presentation was analyzed.
The characteristics of the 95 analyzed patients and their infections are summarized in Table 2. The patients were most commonly middle-aged men with uncomplicated cellulitis who were referred from the emergency department.
The overall importance of each of the items was calculated as frequency-importance-products and reported in Table 1.
Final questionnaire preparation
The twenty highest ranked items identified in item reduction (Table 1) were grouped into domains and included in the final questionnaire. They were presented in a similar fashion as in the item reduction questionnaire. These twenty items represent each of the HRQL domains including symptoms (seven items), daily functioning (seven items), emotional functioning (five items), and social interactions (one item). The final questionnaire was pre-tested on a group of ten patients. After filling out the survey independently they reviewed it with one of the study investigators. No patient reported any difficulty in completing the questionnaire or interpreting the items.
The ESTI Score
The final ESTI-Score for a patient was calculated by adding their scores for each item. The minimum and maximum possible scores are zero and one hundred respectively. The ESTI-Score was post hoc calculated for each of the patients in the item reduction cohort. The mean ESTI-Score was 47.2 ± 21.1 points and their distribution is shown in Figure 1. No significant differences in mean scores were observed overall between men and women, cellulitis versus other ESTI, or upper versus lower extremity site of infection.
We report the development of the first HRQL indicator for use in patients with ESTI. This tool was developed using established methodological guidelines and included a diverse cohort of ambulatory adult patients with a variety of soft tissue infections. It incorporated items representing multiple areas of quality of life impairment including physical symptoms, activities of daily living, emotional and social functioning. When pre-tested on another group of patients the final questionnaire was found to be straightforward and easy to independently complete in less than 10 minutes. In a post hoc analysis, of our patient cohort, the ESTI-Score produced a broad range of near-normally distributed values, potentially reflecting the range of severity of ESTI in our patients.
Clinical trials of ESTI reported to date have largely used a variety of disease-oriented outcome measures. Often a categorical assessment such as "cure" or "failure", "resolution of infection", or "improvement" is assigned by a study investigator based on a non-standardized clinical assessment [14–22]. Another approach has been to use "microbiological eradication" or "microbiological persistence" as an outcome measure [16, 18–20]. The utility of such an outcome measure is hampered by the fact that the majority of soft tissue infections are culture negative or will rapidly become culture negative even if sub-optimally managed [23, 24]. Others have attempted to quantify improvement based on measurements of areas of inflammation although this has not been validated and may not be closely related to patients' symptoms . While patients' subjective experiences are often included in a composite clinical assessment by a physician or study investigator, the use of a HRQL measure allows actual quantification of these experiences and the effect of treatment.
Generic health measures such as the Medical Outcomes Study 36-Item Short-Form Health Survey (SF-36) , and the Nottingham Health Profile (NHP) , have been developed to measure quality of life in a broad range of illnesses. They may not, however, be able to detect the subtle effects on quality of life specific to a particular disease. Specific HRQL scales have been developed and validated for other diseases and have been used as outcome measures in clinical trials [4–8]. Tools, such as the "Skindex," have been developed to evaluate the HRQL in chronic dermatologic conditions but are not applicable to acute soft tissue infections [9, 10]. The ESTI-Score represents the first standardized clinical instrument to measure the areas of HRQL impairment important to patients with ESTI.
As a result of the ESTI-Score being developed using a cohort of patients, it does have face and content validity. However, there are a number of limitations of the current study. First, it requires further prospective assessment in another cohort of ESTI patients prior to being used as a primary outcome measure in clinical trials. Areas to be assessed include its reproducibility in patients with a stable disease state, its responsiveness to changes in infection severity, and its relationship to other markers of disease severity. Second, the ESTI-Score was derived from a group of North American adult patients receiving parenteral antibiotics at a single outpatient parenteral therapy clinic. Patients with mild disease were excluded based on the requirement for at least two days of parenteral therapy and only English speaking patients were studied. Whether it will be generalizable to adult patients in other outpatient settings in other regions remains to be seen. Third, while ESTI may have subsequent chronic impairment on quality of life, they typically are acute conditions that resolve over weeks or months and in most cases will not have a major effect on an individual's quality of life during their lifetime. The ESTI-Score may therefore represent more of an acute comprehensive disease severity index than a traditional measure of quality of life.
We report the development of the ESTI-Score that is designed to quantify patients subjective experiences associated with having an ESTI. Future studies are needed to validate this HRQL instrument in another cohort of adult ESTI patients so that it may be used as an important outcome measure in future clinical trials evaluating management strategies for ESTI.
Extremity Soft Tissue Infections
Frequency importance product
Health-Related Quality of Life Questionnaire
Home Parenteral Therapy Program
Medical Outcomes Study 36-Item Short-Form Health Survey
Nottingham Health Profile
Soft tissue infections
Gottlieb T, Atkins BL, Shaw DR: 7: Soft tissue, bone and joint infections. Med J Aust. 2002, 176: 609-615.
Stulberg DL, Penrod MA, Blatny RA: Common bacterial skin infections. Am Fam Physician. 2002, 66: 119-124.
Sharpe JN, Shively EH, Polk HCJ: Clinical and economic outcomes of oral linezolid versus intravenous vancomycin in the treatment of MRSA-complicated, lower-extremity skin and soft-tissue infections caused by methicillin-resistant Staphylococcus aureus. Am J Surg. 2005, 189: 425-428. 10.1016/j.amjsurg.2005.01.011.
Juniper EF, Guyatt GH, Epstein RS, Ferrie PJ, Jaeschke R, Hiller TK: Evaluation of impairment of health related quality of life in asthma: development of a questionnaire for use in clinical trials. Thorax. 1992, 47 (2): 76-83.
Guyatt GH, Naylor CD, Juniper E, Heyland DK, Jaeschke R, Cook DJ: Users' guides to the medical literature. XII. How to use articles about health-related quality of life. Evidence-Based Medicine Working Group. Jama. 1997, 277: 1232-1237. 10.1001/jama.277.15.1232.
Juniper EF, Guyatt GH, Epstein RS, Ferrie PJ, Jaeschke R, Hiller TK: Evaluation of impairment of health related quality of life in asthma: development of a questionnaire for use in clinical trials. Thorax. 1992, 47: 76-83.
Juniper EF, Guyatt GH: Development and testing of a new measure of health status for clinical trials in rhinoconjunctivitis. Clin Exp Allergy. 1991, 21: 77-83. 10.1111/j.1365-2222.1991.tb00807.x.
Cronin L, Guyatt G, Griffith L, Wong E, Azziz R, Futterweit W, Cook D, Dunaif A: Development of a health-related quality-of-life questionnaire (PCOSQ) for women with polycystic ovary syndrome (PCOS). J Clin Endocrinol Metab. 1998, 83: 1976-1987. 10.1210/jc.83.6.1976.
Flemons WW, Reimer MA: Development of a disease-specific health-related quality of life questionnaire for sleep apnea. Am J Respir Crit Care Med. 1998, 158: 494-503.
Chren MM, Lasek RJ, Quinn LM, Mostow EN, Zyzanski SJ: Skindex, a quality-of-life measure for patients with skin disease: reliability, validity, and responsiveness. J Invest Dermatol. 1996, 107: 707-713. 10.1111/1523-1747.ep12365600.
Anderson RT, Rajagopalan R: Development and validation of a quality of life instrument for cutaneous diseases. J Am Acad Dermatol. 1997, 37: 41-50. 10.1016/S0190-9622(97)70210-X.
Guyatt GH, Bombardier C, Tugwell PX: Measuring disease-specific quality of life in clinical trials. Cmaj. 1986, 134: 889-895.
Kirshner B, Guyatt G: A methodological framework for assessing health indices. J Chronic Dis. 1985, 38: 27-36. 10.1016/0021-9681(85)90005-0.
Laupland KB, Gill MJ, Schenk L, Goodwin D, Davies HD: Outpatient parenteral antibiotic therapy: evolution of the Calgary adult home parenteral therapy program. Clin Invest Med. 2002, 25: 185-190.
Fabian TC, File TM, Embil JM, Krige JE, Klein S, Rose A, Melnick D, Soto NE: Meropenem versus imipenem-cilastatin for the treatment of hospitalized patients with complicated skin and skin structure infections: results of a multicenter, randomized, double-blind comparative study. Surg Infect (Larchmt). 2005, 6: 269-282. 10.1089/sur.2005.6.269.
Arbeit RD, Maki D, Tally FP, Campanaro E, Eisenstein BI: The safety and efficacy of daptomycin for the treatment of complicated skin and skin-structure infections. Clin Infect Dis. 2004, 38: 1673-1681. 10.1086/420818.
Siami FS, LaFleur BJ, Siami GA: Clinafloxacin versus piperacillin/tazobactam in the treatment of severe skin and soft-tissue infections in adults at a Veterans Affairs medical center. Clin Ther. 2002, 24: 59-72. 10.1016/S0149-2918(02)85005-6.
Graham DR, Lucasti C, Malafaia O, Nichols RL, Holtom P, Perez NQ, McAdams A, Woods GL, Ceesay TP, Gesser R: Ertapenem once daily versus piperacillin-tazobactam 4 times per day for treatment of complicated skin and skin-structure infections in adults: results of a prospective, randomized, double-blind multicenter study. Clin Infect Dis. 2002, 34: 1460-1468. 10.1086/340348.
Tarshis GA, Miskin BM, Jones TM, Champlin J, Wingert KJ, Breen JD, Brown MJ: Once-daily oral gatifloxacin versus oral levofloxacin in treatment of uncomplicated skin and soft tissue infections: double-blind, multicenter, randomized study. Antimicrob Agents Chemother. 2001, 45: 2358-2362. 10.1128/AAC.45.8.2358-2362.2001.
Wasilewski MM, Wilson MG, Sides GD, Stotka JL: Comparative efficacy of 5 days of dirithromycin and 7 days of erythromycin in skin and soft tissue infections. J Antimicrob Chemother. 2000, 46: 255-262. 10.1093/jac/46.2.255.
Bucko AD, Hunt BJ, Kidd SL, Hom R: Randomized, double-blind, multicenter comparison of oral cefditoren 200 or 400 mg BID with either cefuroxime 250 mg BID or cefadroxil 500 mg BID for the treatment of uncomplicated skin and skin-structure infections. Clin Ther. 2002, 24: 1134-1147. 10.1016/S0149-2918(02)80024-8.
Grayson ML, Gibbons GW, Habershaw GM, Freeman DV, Pomposelli FB, Rosenblum BI, Levin E, Karchmer AW: Use of ampicillin/sulbactam versus imipenem/cilastatin in the treatment of limb-threatening foot infections in diabetic patients. Clin Infect Dis. 1994, 18: 683-693.
Hepburn MJ, Dooley DP, Skidmore PJ, Ellis MW, Starnes WF, Hasewinkle WC: Comparison of short-course (5 days) and standard (10 days) treatment for uncomplicated cellulitis. Arch Intern Med. 2004, 164: 1669-1674. 10.1001/archinte.164.15.1669.
Leppard BJ, Seal DV, Colman G, Hallas G: The value of bacteriology and serology in the diagnosis of cellulitis and erysipelas. Br J Dermatol. 1985, 112: 559-567.
Swartz MN: Clinical practice. Cellulitis. N Engl J Med. 2004, 350: 904-912. 10.1056/NEJMcp031807.
Brown G, Chamberlain R, Goulding J, Clarke A: Ceftriaxone versus cefazolin with probenecid for severe skin and soft tissue infections. J Emerg Med. 1996, 14: 547-551. 10.1016/S0736-4679(96)00126-6.
Ware JEJ, Sherbourne CD: The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992, 30: 473-483. 10.1097/00005650-199206000-00002.
Hunt SM, McEwen J, McKenna SP: Measuring health status: a new tool for clinicians and epidemiologists. J R Coll Gen Pract. 1985, 35: 185-188.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2334/6/148/prepub
We thank Drs. Ward Flemons and H. Dele Davies for their input and advice regarding the design of this study, Sandra Vaz-Gonsalvez and Brendan Byrne for assistance with patient interviews, and Lisa Wilson and the HPTP nurses for administrative assistance and support of the study. This study was funded by an unrestricted educational grant from Bristol-Myers Squibb Canada. The author's had complete autonomy in the design and conduct of the study and the decision to publish.
None of the authors have personal, professional, or financial conflicts of interest that would influence the conduct or reporting of this study.
AJS collected data, analyzed results, and drafted the manuscript. KL conceived and designed the study, enrolled patients, analyzed data, and contributed to the manuscript drafting. RRR, MWM, JMG, DN, and TJL enrolled patients and collected data. All authors contributed to revision of and approval of the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Storck, A.J., Laupland, K.B., Read, R.R. et al. Development of a Health-Related Quality of Life Questionnaire (HRQL) for patients with Extremity Soft Tissue Infections (ESTI). BMC Infect Dis 6, 148 (2006). https://doi.org/10.1186/1471-2334-6-148
- Soft Tissue Infection
- Final Questionnaire
- Disease Severity Index
- Item Reduction
- English Speak Patient