U.S. flag

An official website of the United States government, Department of Justice.

Measuring “What Matters” in 21st-century Policing: Partnering with Civilian Oversight to Assess Procedurally Just Policing in Philadelphia

NCJ Number
309921
Journal
Police Practice and Research Volume: Online Dated: December 2024
Date Published
December 2024
Annotation

This paper reports on an evaluation of procedurally just policing through the use of a systematic social observation of body-worn-camera footage of more than 200 randomly selected traffic stops in Philadelphia, Pennsylvania.

Abstract

Police oversight bodies routinely audit body-worn camera (BWC) footage for binary policy compliance (e.g., Was the camera activated per policy?), and police performance assessments traditionally focus on quantifiable outputs. In both cases, the ‘process domain’ that reflects service quality is largely ignored, resulting in impoverished metrics. In partnership with the Philadelphia Police Department and the Citizens Police Oversight Commission, the authors conducted a systematic social observation (SSO) of BWC footage from 233 randomly selected traffic stops to evaluate a protocol for measuring procedurally just policing (PJP). Rater consistency and validity assessments showed that coders provided reliable ratings, capturing elements of participation, dignity/respect, and trustworthy motives, with lower correlations for neutrality. Mean PJP scores varied with suspect tone, supporting predictive validity and aligning with procedural justice theory. The PJP protocol enables oversight entities to assess service quality and alignment with democratic policing values, though refinements are needed to address the range of police–citizen interactions. The authors discuss their findings and implications for automation. (Published Abstract Provided)

Date Published: December 1, 2024