Objective: Many statistical approaches have been applied to compare health care providers’ performance, but few studies have examined how the outlier status of providers depends on the choice between risk-adjustment techniques. Study Design and Setting: We analyzed the recourse to breast-conserving surgery (BCS) for breast carcinoma across 31 hospitals of the Veneto Region (Italy). The following methods were compared: the ratio of observed to expected events (O/E ), regression models with provider effects introduced as dummy variables obtained by standard or weighted effect coding, and multilevel analysis. Results: The O/E method classified seven hospitals (one with high and six with low BCS rates) as outliers. The regression model with the weighted parameterization gave similar results, whereas through standard effect coding all odds ratios shifted and different outliers were identified. Multilevel analysis was quite conservative in identifying small hospitals with BCS rates lower than the regional mean. Conclusion: Whenever feasible, results obtained through different statistical methodologies should be compared. If providers are modeled as dummy variables obtained by effect coding, departures of the model intercept from the regional mean should be checked. The increasing use of multilevel models could entail a lower sensitivity in identifying low-quality outliers if a volumeeoutcome relationship exists.

The choice between different statistical approaches to risk-adjustment influenced the identification of outliers

ROSATO, Rosalba;
2007-01-01

Abstract

Objective: Many statistical approaches have been applied to compare health care providers’ performance, but few studies have examined how the outlier status of providers depends on the choice between risk-adjustment techniques. Study Design and Setting: We analyzed the recourse to breast-conserving surgery (BCS) for breast carcinoma across 31 hospitals of the Veneto Region (Italy). The following methods were compared: the ratio of observed to expected events (O/E ), regression models with provider effects introduced as dummy variables obtained by standard or weighted effect coding, and multilevel analysis. Results: The O/E method classified seven hospitals (one with high and six with low BCS rates) as outliers. The regression model with the weighted parameterization gave similar results, whereas through standard effect coding all odds ratios shifted and different outliers were identified. Multilevel analysis was quite conservative in identifying small hospitals with BCS rates lower than the regional mean. Conclusion: Whenever feasible, results obtained through different statistical methodologies should be compared. If providers are modeled as dummy variables obtained by effect coding, departures of the model intercept from the regional mean should be checked. The increasing use of multilevel models could entail a lower sensitivity in identifying low-quality outliers if a volumeeoutcome relationship exists.
2007
60
858
862
FEDELI U; BROCCO S; ALBA N; ROSATO R; SPOLAORE P
File in questo prodotto:
File Dimensione Formato  
jce07_rosato.pdf

Accesso riservato

Tipo di file: POSTPRINT (VERSIONE FINALE DELL’AUTORE)
Dimensione 101.38 kB
Formato Adobe PDF
101.38 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/104929
Citazioni
  • ???jsp.display-item.citation.pmc??? 2
  • Scopus 7
  • ???jsp.display-item.citation.isi??? 6
social impact