Development and validation of the scan of postgraduate educational environment domains (SPEED): a brief Instrument to assess the educational environment in postgraduate medical education

Johanna Schönrock-Adema, Maartje Visscher, A.N. Janet Raat, Paul L P Brand

Onderzoeksoutput: ArticleAcademicpeer review

Uittreksel

INTRODUCTION: Current instruments to evaluate the postgraduate medical educational environment lack theoretical frameworks and are relatively long, which may reduce response rates. We aimed to develop and validate a brief instrument that, based on a solid theoretical framework for educational environments, solicits resident feedback to screen the postgraduate medical educational environment quality.

METHODS: Stepwise, we developed a screening instrument, using existing instruments to assess educational environment quality and adopting a theoretical framework that defines three educational environment domains: content, atmosphere and organization. First, items from relevant existing instruments were collected and, after deleting duplicates and items not specifically addressing educational environment, grouped into the three domains. In a Delphi procedure, the item list was reduced to a set of items considered most important and comprehensively covering the three domains. These items were triangulated against the results of semi-structured interviews with 26 residents from three teaching hospitals to achieve face validity. This draft version of the Scan of Postgraduate Educational Environment Domains (SPEED) was administered to residents in a general and university hospital and further reduced and validated based on the data collected.

RESULTS: Two hundred twenty-three residents completed the 43-item draft SPEED. We used half of the dataset for item reduction, and the other half for validating the resulting SPEED (15 items, 5 per domain). Internal consistencies were high. Correlations between domain scores in the draft and brief versions of SPEED were high (>0.85) and highly significant (p<0.001). Domain score variance of the draft instrument was explained for ≥80% by the items representing the domains in the final SPEED.

CONCLUSIONS: The SPEED comprehensively covers the three educational environment domains defined in the theoretical framework. Because of its validity and brevity, the SPEED is promising as useful and easily applicable tool to regularly screen educational environment quality in postgraduate medical education.

Originele taal-2English
TijdschriftPLOS one
Volume10
Nummer van het tijdschrift9
DOI's
StatusPublished - 2015
Extern gepubliceerdJa

Keywords

  • medisch onderwijs

Citeer dit

@article{25697ae754ff42e3bfaa8b561597db78,
title = "Development and validation of the scan of postgraduate educational environment domains (SPEED): a brief Instrument to assess the educational environment in postgraduate medical education",
abstract = "INTRODUCTION: Current instruments to evaluate the postgraduate medical educational environment lack theoretical frameworks and are relatively long, which may reduce response rates. We aimed to develop and validate a brief instrument that, based on a solid theoretical framework for educational environments, solicits resident feedback to screen the postgraduate medical educational environment quality.METHODS: Stepwise, we developed a screening instrument, using existing instruments to assess educational environment quality and adopting a theoretical framework that defines three educational environment domains: content, atmosphere and organization. First, items from relevant existing instruments were collected and, after deleting duplicates and items not specifically addressing educational environment, grouped into the three domains. In a Delphi procedure, the item list was reduced to a set of items considered most important and comprehensively covering the three domains. These items were triangulated against the results of semi-structured interviews with 26 residents from three teaching hospitals to achieve face validity. This draft version of the Scan of Postgraduate Educational Environment Domains (SPEED) was administered to residents in a general and university hospital and further reduced and validated based on the data collected.RESULTS: Two hundred twenty-three residents completed the 43-item draft SPEED. We used half of the dataset for item reduction, and the other half for validating the resulting SPEED (15 items, 5 per domain). Internal consistencies were high. Correlations between domain scores in the draft and brief versions of SPEED were high (>0.85) and highly significant (p<0.001). Domain score variance of the draft instrument was explained for ≥80{\%} by the items representing the domains in the final SPEED.CONCLUSIONS: The SPEED comprehensively covers the three educational environment domains defined in the theoretical framework. Because of its validity and brevity, the SPEED is promising as useful and easily applicable tool to regularly screen educational environment quality in postgraduate medical education.",
keywords = "medical education, evaluation studies, medisch onderwijs",
author = "Johanna Sch{\"o}nrock-Adema and Maartje Visscher and Raat, {A.N. Janet} and Brand, {Paul L P}",
year = "2015",
doi = "10.1371/journal.pone.0137872",
language = "English",
volume = "10",
journal = "PLOS one",
issn = "1932-6203",
publisher = "Public Library of Science",
number = "9",

}

Development and validation of the scan of postgraduate educational environment domains (SPEED) : a brief Instrument to assess the educational environment in postgraduate medical education. / Schönrock-Adema, Johanna; Visscher, Maartje; Raat, A.N. Janet; Brand, Paul L P.

In: PLOS one, Vol. 10, Nr. 9, 2015.

Onderzoeksoutput: ArticleAcademicpeer review

TY - JOUR

T1 - Development and validation of the scan of postgraduate educational environment domains (SPEED)

T2 - a brief Instrument to assess the educational environment in postgraduate medical education

AU - Schönrock-Adema, Johanna

AU - Visscher, Maartje

AU - Raat, A.N. Janet

AU - Brand, Paul L P

PY - 2015

Y1 - 2015

N2 - INTRODUCTION: Current instruments to evaluate the postgraduate medical educational environment lack theoretical frameworks and are relatively long, which may reduce response rates. We aimed to develop and validate a brief instrument that, based on a solid theoretical framework for educational environments, solicits resident feedback to screen the postgraduate medical educational environment quality.METHODS: Stepwise, we developed a screening instrument, using existing instruments to assess educational environment quality and adopting a theoretical framework that defines three educational environment domains: content, atmosphere and organization. First, items from relevant existing instruments were collected and, after deleting duplicates and items not specifically addressing educational environment, grouped into the three domains. In a Delphi procedure, the item list was reduced to a set of items considered most important and comprehensively covering the three domains. These items were triangulated against the results of semi-structured interviews with 26 residents from three teaching hospitals to achieve face validity. This draft version of the Scan of Postgraduate Educational Environment Domains (SPEED) was administered to residents in a general and university hospital and further reduced and validated based on the data collected.RESULTS: Two hundred twenty-three residents completed the 43-item draft SPEED. We used half of the dataset for item reduction, and the other half for validating the resulting SPEED (15 items, 5 per domain). Internal consistencies were high. Correlations between domain scores in the draft and brief versions of SPEED were high (>0.85) and highly significant (p<0.001). Domain score variance of the draft instrument was explained for ≥80% by the items representing the domains in the final SPEED.CONCLUSIONS: The SPEED comprehensively covers the three educational environment domains defined in the theoretical framework. Because of its validity and brevity, the SPEED is promising as useful and easily applicable tool to regularly screen educational environment quality in postgraduate medical education.

AB - INTRODUCTION: Current instruments to evaluate the postgraduate medical educational environment lack theoretical frameworks and are relatively long, which may reduce response rates. We aimed to develop and validate a brief instrument that, based on a solid theoretical framework for educational environments, solicits resident feedback to screen the postgraduate medical educational environment quality.METHODS: Stepwise, we developed a screening instrument, using existing instruments to assess educational environment quality and adopting a theoretical framework that defines three educational environment domains: content, atmosphere and organization. First, items from relevant existing instruments were collected and, after deleting duplicates and items not specifically addressing educational environment, grouped into the three domains. In a Delphi procedure, the item list was reduced to a set of items considered most important and comprehensively covering the three domains. These items were triangulated against the results of semi-structured interviews with 26 residents from three teaching hospitals to achieve face validity. This draft version of the Scan of Postgraduate Educational Environment Domains (SPEED) was administered to residents in a general and university hospital and further reduced and validated based on the data collected.RESULTS: Two hundred twenty-three residents completed the 43-item draft SPEED. We used half of the dataset for item reduction, and the other half for validating the resulting SPEED (15 items, 5 per domain). Internal consistencies were high. Correlations between domain scores in the draft and brief versions of SPEED were high (>0.85) and highly significant (p<0.001). Domain score variance of the draft instrument was explained for ≥80% by the items representing the domains in the final SPEED.CONCLUSIONS: The SPEED comprehensively covers the three educational environment domains defined in the theoretical framework. Because of its validity and brevity, the SPEED is promising as useful and easily applicable tool to regularly screen educational environment quality in postgraduate medical education.

KW - medical education

KW - evaluation studies

KW - medisch onderwijs

UR - http://www.embase.com/search/results?subaction=viewrecord&from=export&id=L606828431 http://dx.doi.org/10.1371/journal.pone.0137872

UR - http://www.mendeley.com/research/development-validation-scan-postgraduate-educational-environment-domains-speed-brief-instrument-asse

U2 - 10.1371/journal.pone.0137872

DO - 10.1371/journal.pone.0137872

M3 - Article

VL - 10

JO - PLOS one

JF - PLOS one

SN - 1932-6203

IS - 9

ER -