Inter-rater Reliability Workshop

Inter-rater Reliability Workshop

A formal programme of Inter-rater Reliability (IRR) testing for all acuity-rating departments is a key component of the successful administration of the TrendCare System to ensure data integrity remains at a high level.

It is essential that an IRR workshop is completed post implementation and IRR testing continued annually thereafter.  If annual IRR testing has not been completed for all staff or new staff are not tested within 2 weeks of commencing work, data accuracy rates will decrease. Periodic IRR workshops assist in maintaining a sufficient number of TrendCare ward champions for annual testing.

Workshop Description

This one-day workshop consolidates basic acuity concepts, introduces the theory and reasoning behind IRR testing and allows the participants to practically undertake the testing process in the clinical environment. It also enables workshop participants to move to the next step of formalising a plan to undertake IRR testing.

Recommended Attendees

  • Directors of Nursing and Midwifery

  • Associate Directors of Nursing and Midwifery

  • Ward Managers

  • TrendCare Coordinators

  • TrendCare Champions

Learning Outcomes

  • Improved understanding of the theory and concepts of the TrendCare acuity tool.

  • Understanding of the objectives and importance of Inter-rater Reliability testing to ensure the accuracy of individual nurse raters and identify staff knowledge deficits in the use of the TrendCare acuity tool.

  • Developing confidence and capability to train new champion testers, plan ward testing and annually test all ward staff who complete patient acuity categorisations.

  • Improved ability to verify the integrity of patient acuity data used to design and re-engineer rosters, achieve and maintain staffing efficiency, and assist with the costing of patient care.

Workshop Delivery Methods

The workshop consists of a classroom theory component and data review session followed by ward visits for practical, hands-on testing. It is best delivered on site, to get the most out of ward/department visits and practical demonstrations. However, if required this workshop can also be delivered remotely over several 3hour sessions.

Organisational Potential Outcomes

  • Improved accuracy of acuity data

  • Confidence in the measures of demand for nursing hours using the TrendCare acuity tool.

  • Ability to develop accurate nursing cost weights

  • Ability to accurately measure nursing intensity required per DRG