NUR 640 Module 4 Rubric Paper Example

Designing and Calibrating an Analytic Rubric for a Medical-Surgical Nursing Care Plan

[Student Name]

Southern New Hampshire University

NUR 640: Assessment and Evaluation in Nursing Education

Module Four Rubric Paper

[Instructor Name]

[Date]

Designing and Calibrating an Analytic Rubric for a Medical-Surgical Nursing Care Plan

A rubric is a promise to students that their work will be judged against stated criteria rather than a grader's mood. In the composite Lakemont College of Nursing, the care plan for the second-semester medical-surgical course was scored with a checklist: points for listing a nursing diagnosis, three goals, five interventions with rationales and an evaluation. A student could earn full marks with a plan built on the wrong priority problem, and faculty grades on the same plan varied by as much as fifteen points. This paper designs an analytic rubric to replace the checklist and plans how faculty will learn to apply it consistently. It argues that criteria tied to outcomes, descriptors that describe quality, formative use by students and calibration with measured agreement are what make a rubric valid and reliable.

Why an Analytic Rubric

A holistic rubric gives one overall score, which is quick but offers students little guidance. An analytic rubric scores each criterion separately, which takes longer but shows students where their work is strong or weak and lets faculty see patterns across a class. Because the care plan is a learning assignment in the middle of the program, feedback matters more than speed, so an analytic format was chosen. The criteria were derived from two course outcomes: prioritizing patient problems using assessment data and planning safe, evidence-based interventions. Each criterion had to map to one of these outcomes, which removed items such as formatting that do not reflect clinical reasoning; APA formatting is checked separately as a pass or revise requirement.

The Rubric

Each descriptor describes what the work does, not how much of it there is. The difference between Proficient and Developing on priority problem, for example, is whether the student chose the right problem, not how many problems were listed. One rule overrides the levels: an intervention that would harm the patient places the interventions criterion at Beginning regardless of other strengths, and the student must revise the plan. Criteria are weighted, with priority problem and interventions counting double, because these reflect the most important outcomes.

Table 1. Analytic Rubric for the Medical-Surgical Care Plan

Note. Descriptors change in quality from level to level rather than in the number of items included, and any unsafe intervention caps that criterion at Beginning.

Using the Rubric for Learning

A rubric used only to justify a grade misses much of its value. Panadero and Jonsson (2013) reviewed studies of rubrics used formatively and found that sharing rubrics with students can improve performance, apparently by making expectations transparent, reducing anxiety, supporting feedback and helping students regulate their own work, and that the benefits are greater when rubrics are combined with self-assessment or exemplars. Lakemont students will receive the rubric with the assignment, score two anonymous plans from a previous term in class and discuss why faculty rated them as they did. When they submit, they will attach a self-assessment on the rubric, and faculty feedback will address differences between the student's ratings and the faculty ratings.

Calibrating the Raters

Reddy and Andrade (2010) reviewed rubric use in higher education and found that rubrics can clarify expectations and support learning but that studies rarely reported the reliability or validity of the rubrics themselves. A rubric's consistency cannot be assumed. Before the term, three faculty members will independently score ten anonymized care plans from the previous term that range from weak to strong. For each criterion, exact percent agreement and Cohen's kappa will be calculated. Percent agreement is easy to understand but is inflated by chance, especially when most plans fall into one or two levels, while kappa corrects for the agreement expected by chance alone (Cohen, 1960).

The faculty group has set a local target of at least 70% exact agreement and 90% agreement within one level on every criterion. Where agreement falls short, the three raters will discuss the plans on which they differed, identify which words in the descriptors they read differently and revise those words. The goals criterion is expected to need the most work, because faculty disagree about how measurable a goal must be. After revision, five new plans will be scored to confirm improvement.

Validity Beyond Agreement

Consistent scores are not necessarily accurate ones. Three raters can agree on the wrong judgment. To support validity, two experienced medical-surgical nurses from the clinical partner will review the rubric to confirm that the criteria and descriptors reflect what safe planning looks like in practice. Scores on the priority problem criterion will also be compared with student performance on clinical judgment items about prioritization on the unit exam; if the two do not relate, the rubric may be measuring writing ability more than reasoning.

Fairness and Practicality

The rubric was also reviewed for fairness. Descriptors avoid rewarding polished prose over sound reasoning, since multilingual students may plan care safely while writing less fluently; grammar is addressed through feedback and the separate formatting requirement rather than inside the clinical criteria. Plans will be scored with student names removed where the learning management system allows, reducing the chance that expectations about a student color the score.

A rubric that takes too long to use will be applied carelessly. During calibration, each rater will record the time spent per plan. If scoring averages more than twenty minutes, the group will look for descriptors that can be shortened or criteria that can be combined without losing information, and a comment bank linked to each descriptor will be built so that feedback stays specific without adding time.

Conclusion

The checklist told students what to include; the rubric tells them what good clinical reasoning looks like. Criteria tied to course outcomes, descriptors that describe quality, a safety override, formative use with self-assessment and calibration measured with percent agreement and kappa together give Lakemont faculty a care plan score that means the same thing whichever instructor assigns it.

References

Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37-46. https://doi.org/10.1177/001316446002000104

Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research Review, 9, 129-144. https://doi.org/10.1016/j.edurev.2013.01.002

Reddy, Y. M., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35(4), 435-448. https://doi.org/10.1080/02602930902862859