Improving the validity of facility management research by use of interrater agreement

Onderzoeksoutput: Contribution to conference proceedingAcademicpeer review

1 Downloads (Pure)

Uittreksel

In research methodology, epistemology is concerned with the question how humans generate knowledge. In facility management (FM) research, for instance, it deals with the evaluation criteria such as validity and reliability by which researchers discriminate good knowledge from bad. The objective of this paper is to add to the scholarly methodological aspects in FM research. The paper takes a postpositivist stance and pre-supposes that scholars are able to discover what happens in FM through the categorization and scientific measurement of affective responses. It applies a method by which scholars are able to develop good knowledge and by which talented bachelor students are involved in FM research.
In this study 26 semi-structured interviews were conducted at nine different organizations in the Netherlands. Interviews, which focused on office environments and productivity, were conducted in pairs by Honours students. This paper reports on methodological issues of this study. Data collection and analysis by different researchers revealed serious threats to validity and reliability. Consequently an interrater agreement (IRA), measuring the degree of agreement between raters, was introduced to reveal and overcome differences in interpretations.
In this paper the difficulties of achieving good agreement were considered. Adjustment between raters and clear demarcation of constructs are necessary. A synopsis of usage and reporting of qualitative interview approaches is shown.
Originele taal-2English
Titel12th EuroFM Research Symposium
SubtitelFM for a Sustainable Future
RedacteurenK. Alexander
UitgeverijEuroFM: European Facility Management Network
Pagina's175-188
ISBN van geprinte versie978-94-90694-02-9
StatusPublished - 2013

Publicatie series

NaamInternational Journal of Facilities Management
UitgeverijEuroFM

Vingerafdruk

management
bachelor
interview
qualitative interview
honor
epistemology
data analysis
Netherlands
student
productivity
threat
interpretation
methodology
evaluation

Keywords

  • facility management
  • interrater agreement
  • kwalitatief onderzoek
  • onderzoekstriangulatie
  • semi-gestructureerd interviews

Citeer dit

Lechner, S., & Mobach, M. P. (2013). Improving the validity of facility management research by use of interrater agreement. In K. Alexander (editor), 12th EuroFM Research Symposium: FM for a Sustainable Future (blz. 175-188). (International Journal of Facilities Management). EuroFM: European Facility Management Network.
Lechner, Stefan ; Mobach, Mark P. / Improving the validity of facility management research by use of interrater agreement. 12th EuroFM Research Symposium: FM for a Sustainable Future. redacteur / K. Alexander. EuroFM: European Facility Management Network, 2013. blz. 175-188 (International Journal of Facilities Management).
@inproceedings{6ca23123775342b89b5d0783333c7472,
title = "Improving the validity of facility management research by use of interrater agreement",
abstract = "In research methodology, epistemology is concerned with the question how humans generate knowledge. In facility management (FM) research, for instance, it deals with the evaluation criteria such as validity and reliability by which researchers discriminate good knowledge from bad. The objective of this paper is to add to the scholarly methodological aspects in FM research. The paper takes a postpositivist stance and pre-supposes that scholars are able to discover what happens in FM through the categorization and scientific measurement of affective responses. It applies a method by which scholars are able to develop good knowledge and by which talented bachelor students are involved in FM research.In this study 26 semi-structured interviews were conducted at nine different organizations in the Netherlands. Interviews, which focused on office environments and productivity, were conducted in pairs by Honours students. This paper reports on methodological issues of this study. Data collection and analysis by different researchers revealed serious threats to validity and reliability. Consequently an interrater agreement (IRA), measuring the degree of agreement between raters, was introduced to reveal and overcome differences in interpretations.In this paper the difficulties of achieving good agreement were considered. Adjustment between raters and clear demarcation of constructs are necessary. A synopsis of usage and reporting of qualitative interview approaches is shown.",
keywords = "facility management, interrater agreement, qualitative research, researcher triangulation, semi-structured interviews, facility management, interrater agreement, kwalitatief onderzoek, onderzoekstriangulatie, semi-gestructureerd interviews",
author = "Stefan Lechner and Mobach, {Mark P.}",
year = "2013",
language = "English",
isbn = "978-94-90694-02-9",
series = "International Journal of Facilities Management",
publisher = "EuroFM: European Facility Management Network",
pages = "175--188",
editor = "K. Alexander",
booktitle = "12th EuroFM Research Symposium",

}

Lechner, S & Mobach, MP 2013, Improving the validity of facility management research by use of interrater agreement. in K Alexander (redactie), 12th EuroFM Research Symposium: FM for a Sustainable Future. International Journal of Facilities Management, EuroFM: European Facility Management Network, blz. 175-188.

Improving the validity of facility management research by use of interrater agreement. / Lechner, Stefan; Mobach, Mark P.

12th EuroFM Research Symposium: FM for a Sustainable Future. redactie / K. Alexander. EuroFM: European Facility Management Network, 2013. blz. 175-188 (International Journal of Facilities Management).

Onderzoeksoutput: Contribution to conference proceedingAcademicpeer review

TY - GEN

T1 - Improving the validity of facility management research by use of interrater agreement

AU - Lechner, Stefan

AU - Mobach, Mark P.

PY - 2013

Y1 - 2013

N2 - In research methodology, epistemology is concerned with the question how humans generate knowledge. In facility management (FM) research, for instance, it deals with the evaluation criteria such as validity and reliability by which researchers discriminate good knowledge from bad. The objective of this paper is to add to the scholarly methodological aspects in FM research. The paper takes a postpositivist stance and pre-supposes that scholars are able to discover what happens in FM through the categorization and scientific measurement of affective responses. It applies a method by which scholars are able to develop good knowledge and by which talented bachelor students are involved in FM research.In this study 26 semi-structured interviews were conducted at nine different organizations in the Netherlands. Interviews, which focused on office environments and productivity, were conducted in pairs by Honours students. This paper reports on methodological issues of this study. Data collection and analysis by different researchers revealed serious threats to validity and reliability. Consequently an interrater agreement (IRA), measuring the degree of agreement between raters, was introduced to reveal and overcome differences in interpretations.In this paper the difficulties of achieving good agreement were considered. Adjustment between raters and clear demarcation of constructs are necessary. A synopsis of usage and reporting of qualitative interview approaches is shown.

AB - In research methodology, epistemology is concerned with the question how humans generate knowledge. In facility management (FM) research, for instance, it deals with the evaluation criteria such as validity and reliability by which researchers discriminate good knowledge from bad. The objective of this paper is to add to the scholarly methodological aspects in FM research. The paper takes a postpositivist stance and pre-supposes that scholars are able to discover what happens in FM through the categorization and scientific measurement of affective responses. It applies a method by which scholars are able to develop good knowledge and by which talented bachelor students are involved in FM research.In this study 26 semi-structured interviews were conducted at nine different organizations in the Netherlands. Interviews, which focused on office environments and productivity, were conducted in pairs by Honours students. This paper reports on methodological issues of this study. Data collection and analysis by different researchers revealed serious threats to validity and reliability. Consequently an interrater agreement (IRA), measuring the degree of agreement between raters, was introduced to reveal and overcome differences in interpretations.In this paper the difficulties of achieving good agreement were considered. Adjustment between raters and clear demarcation of constructs are necessary. A synopsis of usage and reporting of qualitative interview approaches is shown.

KW - facility management

KW - interrater agreement

KW - qualitative research

KW - researcher triangulation

KW - semi-structured interviews

KW - facility management

KW - interrater agreement

KW - kwalitatief onderzoek

KW - onderzoekstriangulatie

KW - semi-gestructureerd interviews

M3 - Contribution to conference proceeding

SN - 978-94-90694-02-9

T3 - International Journal of Facilities Management

SP - 175

EP - 188

BT - 12th EuroFM Research Symposium

A2 - Alexander, K.

PB - EuroFM: European Facility Management Network

ER -

Lechner S, Mobach MP. Improving the validity of facility management research by use of interrater agreement. In Alexander K, redacteur, 12th EuroFM Research Symposium: FM for a Sustainable Future. EuroFM: European Facility Management Network. 2013. blz. 175-188. (International Journal of Facilities Management).