Assessing time use in long-term institutional care: development, validity and inter-rater reliability of the Groningen Observational instrument for Long-Term Institutional Care (GO-LTIC)

Astrid Tuinman, Mathieu de Greef, Roos Nieweg, Wolter Paans, Petrie Roodbol

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

BACKGROUND: Limited research has examined what is actually done in the process of care by nursing staff in long-term institutional care. The applied instruments employed different terminologies, and psychometric properties were inadequately described. This study aimed to develop and test an observational instrument to identify and examine the amount of time spent on nursing interventions in long-term institutional care using a standardized language.

METHODS: The Groningen Observational instrument for Long-Term Institutional Care (GO-LTIC) is based on the conceptual framework of the Nursing Interventions Classification. Developmental, validation, and reliability stages of the GO-LTIC included: 1) item generation to identify potential setting-specific interventions; 2) examining content validity with a Delphi panel resulting in relevant interventions by calculating the item content validity index; 3) testing feasibility with trained observers observing nursing assistants; and 4) calculating inter-rater reliability using (non) agreement and Cohen's kappa for the identification of interventions and an intraclass correlation coefficient for the amount of time spent on interventions. Bland-Altman plots were applied to visualize the agreement between observers. A one-sample student T-test verified if the difference between observers differed significantly from zero.

RESULTS: The final version of the GO-LTIC comprised 116 nursing interventions categorized into six domains. Substantial to almost perfect kappa's were found for interventions in the domains basic (0.67-0.92) and complex (0.70-0.94) physiological care. For the domains of behavioral, family, and health system interventions, the kappa's ranged from fair to almost perfect (0.30-1.00). Intraclass correlation coefficients for the amount of time spent on interventions ranged from fair to excellent for the physiological domains (0.48-0.99) and poor to excellent for the other domains (0.00-1.00). Bland Altman plots indicated that the clinical magnitude of differences in minutes was small. No statistical significant differences between observers (p > 0.05) were found.

CONCLUSIONS: The GO-LTIC shows good content validity and acceptable inter-rater reliability to examine the amount of time spent on nursing interventions by nursing staff. This may provide managers with valuable information to make decisions about resource allocation, task allocation of nursing staff, and the examination of the costs of nursing services.

Original languageEnglish
Pages (from-to)13
JournalBMC nursing
Volume15
Issue number1
DOIs
Publication statusPublished - 29 Feb 2016

Keywords

  • documentation
  • nursing
  • instrument development
  • elderly care

Cite this

@article{5409cdd7c7984deaad0b536708172851,
title = "Assessing time use in long-term institutional care: development, validity and inter-rater reliability of the Groningen Observational instrument for Long-Term Institutional Care (GO-LTIC)",
abstract = "BACKGROUND: Limited research has examined what is actually done in the process of care by nursing staff in long-term institutional care. The applied instruments employed different terminologies, and psychometric properties were inadequately described. This study aimed to develop and test an observational instrument to identify and examine the amount of time spent on nursing interventions in long-term institutional care using a standardized language.METHODS: The Groningen Observational instrument for Long-Term Institutional Care (GO-LTIC) is based on the conceptual framework of the Nursing Interventions Classification. Developmental, validation, and reliability stages of the GO-LTIC included: 1) item generation to identify potential setting-specific interventions; 2) examining content validity with a Delphi panel resulting in relevant interventions by calculating the item content validity index; 3) testing feasibility with trained observers observing nursing assistants; and 4) calculating inter-rater reliability using (non) agreement and Cohen's kappa for the identification of interventions and an intraclass correlation coefficient for the amount of time spent on interventions. Bland-Altman plots were applied to visualize the agreement between observers. A one-sample student T-test verified if the difference between observers differed significantly from zero.RESULTS: The final version of the GO-LTIC comprised 116 nursing interventions categorized into six domains. Substantial to almost perfect kappa's were found for interventions in the domains basic (0.67-0.92) and complex (0.70-0.94) physiological care. For the domains of behavioral, family, and health system interventions, the kappa's ranged from fair to almost perfect (0.30-1.00). Intraclass correlation coefficients for the amount of time spent on interventions ranged from fair to excellent for the physiological domains (0.48-0.99) and poor to excellent for the other domains (0.00-1.00). Bland Altman plots indicated that the clinical magnitude of differences in minutes was small. No statistical significant differences between observers (p > 0.05) were found.CONCLUSIONS: The GO-LTIC shows good content validity and acceptable inter-rater reliability to examine the amount of time spent on nursing interventions by nursing staff. This may provide managers with valuable information to make decisions about resource allocation, task allocation of nursing staff, and the examination of the costs of nursing services.",
keywords = "documentation, nursing, instrument development, elderly care, verpleegkunde",
author = "Astrid Tuinman and {de Greef}, Mathieu and Roos Nieweg and Wolter Paans and Petrie Roodbol",
year = "2016",
month = "2",
day = "29",
doi = "10.1186/s12912-016-0133-y",
language = "English",
volume = "15",
pages = "13",
journal = "BMC nursing",
issn = "1472-6955",
publisher = "BioMed Central",
number = "1",

}

TY - JOUR

T1 - Assessing time use in long-term institutional care

T2 - development, validity and inter-rater reliability of the Groningen Observational instrument for Long-Term Institutional Care (GO-LTIC)

AU - Tuinman, Astrid

AU - de Greef, Mathieu

AU - Nieweg, Roos

AU - Paans, Wolter

AU - Roodbol, Petrie

PY - 2016/2/29

Y1 - 2016/2/29

N2 - BACKGROUND: Limited research has examined what is actually done in the process of care by nursing staff in long-term institutional care. The applied instruments employed different terminologies, and psychometric properties were inadequately described. This study aimed to develop and test an observational instrument to identify and examine the amount of time spent on nursing interventions in long-term institutional care using a standardized language.METHODS: The Groningen Observational instrument for Long-Term Institutional Care (GO-LTIC) is based on the conceptual framework of the Nursing Interventions Classification. Developmental, validation, and reliability stages of the GO-LTIC included: 1) item generation to identify potential setting-specific interventions; 2) examining content validity with a Delphi panel resulting in relevant interventions by calculating the item content validity index; 3) testing feasibility with trained observers observing nursing assistants; and 4) calculating inter-rater reliability using (non) agreement and Cohen's kappa for the identification of interventions and an intraclass correlation coefficient for the amount of time spent on interventions. Bland-Altman plots were applied to visualize the agreement between observers. A one-sample student T-test verified if the difference between observers differed significantly from zero.RESULTS: The final version of the GO-LTIC comprised 116 nursing interventions categorized into six domains. Substantial to almost perfect kappa's were found for interventions in the domains basic (0.67-0.92) and complex (0.70-0.94) physiological care. For the domains of behavioral, family, and health system interventions, the kappa's ranged from fair to almost perfect (0.30-1.00). Intraclass correlation coefficients for the amount of time spent on interventions ranged from fair to excellent for the physiological domains (0.48-0.99) and poor to excellent for the other domains (0.00-1.00). Bland Altman plots indicated that the clinical magnitude of differences in minutes was small. No statistical significant differences between observers (p > 0.05) were found.CONCLUSIONS: The GO-LTIC shows good content validity and acceptable inter-rater reliability to examine the amount of time spent on nursing interventions by nursing staff. This may provide managers with valuable information to make decisions about resource allocation, task allocation of nursing staff, and the examination of the costs of nursing services.

AB - BACKGROUND: Limited research has examined what is actually done in the process of care by nursing staff in long-term institutional care. The applied instruments employed different terminologies, and psychometric properties were inadequately described. This study aimed to develop and test an observational instrument to identify and examine the amount of time spent on nursing interventions in long-term institutional care using a standardized language.METHODS: The Groningen Observational instrument for Long-Term Institutional Care (GO-LTIC) is based on the conceptual framework of the Nursing Interventions Classification. Developmental, validation, and reliability stages of the GO-LTIC included: 1) item generation to identify potential setting-specific interventions; 2) examining content validity with a Delphi panel resulting in relevant interventions by calculating the item content validity index; 3) testing feasibility with trained observers observing nursing assistants; and 4) calculating inter-rater reliability using (non) agreement and Cohen's kappa for the identification of interventions and an intraclass correlation coefficient for the amount of time spent on interventions. Bland-Altman plots were applied to visualize the agreement between observers. A one-sample student T-test verified if the difference between observers differed significantly from zero.RESULTS: The final version of the GO-LTIC comprised 116 nursing interventions categorized into six domains. Substantial to almost perfect kappa's were found for interventions in the domains basic (0.67-0.92) and complex (0.70-0.94) physiological care. For the domains of behavioral, family, and health system interventions, the kappa's ranged from fair to almost perfect (0.30-1.00). Intraclass correlation coefficients for the amount of time spent on interventions ranged from fair to excellent for the physiological domains (0.48-0.99) and poor to excellent for the other domains (0.00-1.00). Bland Altman plots indicated that the clinical magnitude of differences in minutes was small. No statistical significant differences between observers (p > 0.05) were found.CONCLUSIONS: The GO-LTIC shows good content validity and acceptable inter-rater reliability to examine the amount of time spent on nursing interventions by nursing staff. This may provide managers with valuable information to make decisions about resource allocation, task allocation of nursing staff, and the examination of the costs of nursing services.

KW - documentation

KW - nursing

KW - instrument development

KW - elderly care

KW - verpleegkunde

UR - http://www.mendeley.com/research/assessing-time-longterm-institutional-care-development-validity-interrater-reliability-groningen-obs

U2 - 10.1186/s12912-016-0133-y

DO - 10.1186/s12912-016-0133-y

M3 - Article

VL - 15

SP - 13

JO - BMC nursing

JF - BMC nursing

SN - 1472-6955

IS - 1

ER -