Improving the validity of facility management research by use of interrater agreement

Research output: Chapter in Book/Report/Conference proceedingContribution to conference proceedingAcademicpeer-review

1 Downloads (Pure)

Abstract

In research methodology, epistemology is concerned with the question how humans generate knowledge. In facility management (FM) research, for instance, it deals with the evaluation criteria such as validity and reliability by which researchers discriminate good knowledge from bad. The objective of this paper is to add to the scholarly methodological aspects in FM research. The paper takes a postpositivist stance and pre-supposes that scholars are able to discover what happens in FM through the categorization and scientific measurement of affective responses. It applies a method by which scholars are able to develop good knowledge and by which talented bachelor students are involved in FM research.
In this study 26 semi-structured interviews were conducted at nine different organizations in the Netherlands. Interviews, which focused on office environments and productivity, were conducted in pairs by Honours students. This paper reports on methodological issues of this study. Data collection and analysis by different researchers revealed serious threats to validity and reliability. Consequently an interrater agreement (IRA), measuring the degree of agreement between raters, was introduced to reveal and overcome differences in interpretations.
In this paper the difficulties of achieving good agreement were considered. Adjustment between raters and clear demarcation of constructs are necessary. A synopsis of usage and reporting of qualitative interview approaches is shown.
Original languageEnglish
Title of host publication12th EuroFM Research Symposium
Subtitle of host publicationFM for a Sustainable Future
EditorsK. Alexander
PublisherEuroFM: European Facility Management Network
Pages175-188
ISBN (Print)978-94-90694-02-9
Publication statusPublished - 2013

Publication series

NameInternational Journal of Facilities Management
PublisherEuroFM

Keywords

  • facility management
  • interrater agreement
  • qualitative research
  • researcher triangulation
  • semi-structured interviews

Cite this

Lechner, S., & Mobach, M. P. (2013). Improving the validity of facility management research by use of interrater agreement. In K. Alexander (Ed.), 12th EuroFM Research Symposium: FM for a Sustainable Future (pp. 175-188). (International Journal of Facilities Management). EuroFM: European Facility Management Network.
Lechner, Stefan ; Mobach, Mark P. / Improving the validity of facility management research by use of interrater agreement. 12th EuroFM Research Symposium: FM for a Sustainable Future. editor / K. Alexander. EuroFM: European Facility Management Network, 2013. pp. 175-188 (International Journal of Facilities Management).
@inproceedings{6ca23123775342b89b5d0783333c7472,
title = "Improving the validity of facility management research by use of interrater agreement",
abstract = "In research methodology, epistemology is concerned with the question how humans generate knowledge. In facility management (FM) research, for instance, it deals with the evaluation criteria such as validity and reliability by which researchers discriminate good knowledge from bad. The objective of this paper is to add to the scholarly methodological aspects in FM research. The paper takes a postpositivist stance and pre-supposes that scholars are able to discover what happens in FM through the categorization and scientific measurement of affective responses. It applies a method by which scholars are able to develop good knowledge and by which talented bachelor students are involved in FM research.In this study 26 semi-structured interviews were conducted at nine different organizations in the Netherlands. Interviews, which focused on office environments and productivity, were conducted in pairs by Honours students. This paper reports on methodological issues of this study. Data collection and analysis by different researchers revealed serious threats to validity and reliability. Consequently an interrater agreement (IRA), measuring the degree of agreement between raters, was introduced to reveal and overcome differences in interpretations.In this paper the difficulties of achieving good agreement were considered. Adjustment between raters and clear demarcation of constructs are necessary. A synopsis of usage and reporting of qualitative interview approaches is shown.",
keywords = "facility management, interrater agreement, qualitative research, researcher triangulation, semi-structured interviews, facility management, interrater agreement, kwalitatief onderzoek, onderzoekstriangulatie, semi-gestructureerd interviews",
author = "Stefan Lechner and Mobach, {Mark P.}",
year = "2013",
language = "English",
isbn = "978-94-90694-02-9",
series = "International Journal of Facilities Management",
publisher = "EuroFM: European Facility Management Network",
pages = "175--188",
editor = "K. Alexander",
booktitle = "12th EuroFM Research Symposium",

}

Lechner, S & Mobach, MP 2013, Improving the validity of facility management research by use of interrater agreement. in K Alexander (ed.), 12th EuroFM Research Symposium: FM for a Sustainable Future. International Journal of Facilities Management, EuroFM: European Facility Management Network, pp. 175-188.

Improving the validity of facility management research by use of interrater agreement. / Lechner, Stefan; Mobach, Mark P.

12th EuroFM Research Symposium: FM for a Sustainable Future. ed. / K. Alexander. EuroFM: European Facility Management Network, 2013. p. 175-188 (International Journal of Facilities Management).

Research output: Chapter in Book/Report/Conference proceedingContribution to conference proceedingAcademicpeer-review

TY - GEN

T1 - Improving the validity of facility management research by use of interrater agreement

AU - Lechner, Stefan

AU - Mobach, Mark P.

PY - 2013

Y1 - 2013

N2 - In research methodology, epistemology is concerned with the question how humans generate knowledge. In facility management (FM) research, for instance, it deals with the evaluation criteria such as validity and reliability by which researchers discriminate good knowledge from bad. The objective of this paper is to add to the scholarly methodological aspects in FM research. The paper takes a postpositivist stance and pre-supposes that scholars are able to discover what happens in FM through the categorization and scientific measurement of affective responses. It applies a method by which scholars are able to develop good knowledge and by which talented bachelor students are involved in FM research.In this study 26 semi-structured interviews were conducted at nine different organizations in the Netherlands. Interviews, which focused on office environments and productivity, were conducted in pairs by Honours students. This paper reports on methodological issues of this study. Data collection and analysis by different researchers revealed serious threats to validity and reliability. Consequently an interrater agreement (IRA), measuring the degree of agreement between raters, was introduced to reveal and overcome differences in interpretations.In this paper the difficulties of achieving good agreement were considered. Adjustment between raters and clear demarcation of constructs are necessary. A synopsis of usage and reporting of qualitative interview approaches is shown.

AB - In research methodology, epistemology is concerned with the question how humans generate knowledge. In facility management (FM) research, for instance, it deals with the evaluation criteria such as validity and reliability by which researchers discriminate good knowledge from bad. The objective of this paper is to add to the scholarly methodological aspects in FM research. The paper takes a postpositivist stance and pre-supposes that scholars are able to discover what happens in FM through the categorization and scientific measurement of affective responses. It applies a method by which scholars are able to develop good knowledge and by which talented bachelor students are involved in FM research.In this study 26 semi-structured interviews were conducted at nine different organizations in the Netherlands. Interviews, which focused on office environments and productivity, were conducted in pairs by Honours students. This paper reports on methodological issues of this study. Data collection and analysis by different researchers revealed serious threats to validity and reliability. Consequently an interrater agreement (IRA), measuring the degree of agreement between raters, was introduced to reveal and overcome differences in interpretations.In this paper the difficulties of achieving good agreement were considered. Adjustment between raters and clear demarcation of constructs are necessary. A synopsis of usage and reporting of qualitative interview approaches is shown.

KW - facility management

KW - interrater agreement

KW - qualitative research

KW - researcher triangulation

KW - semi-structured interviews

KW - facility management

KW - interrater agreement

KW - kwalitatief onderzoek

KW - onderzoekstriangulatie

KW - semi-gestructureerd interviews

M3 - Contribution to conference proceeding

SN - 978-94-90694-02-9

T3 - International Journal of Facilities Management

SP - 175

EP - 188

BT - 12th EuroFM Research Symposium

A2 - Alexander, K.

PB - EuroFM: European Facility Management Network

ER -

Lechner S, Mobach MP. Improving the validity of facility management research by use of interrater agreement. In Alexander K, editor, 12th EuroFM Research Symposium: FM for a Sustainable Future. EuroFM: European Facility Management Network. 2013. p. 175-188. (International Journal of Facilities Management).