38. CASE: A SOLUTION FOR ADVERSE IMPACT
I. OVERVIEW
A federal government agency has recently had complaints regarding the selection procedures for
one of its entry-level law enforcement jobs. Presently, applicants must successfully complete a written
test and an unstructured interview. Although their current sta1ng practice had been adopted ten years
ago, the agency had not recently checked the selection rates for adverse impact. From the Uniform
Guidelines, it is suggested that the four-45hs rule be used to iden)fy instances of adverse impact. A5er
finding evidence of adverse impact for both women and minori)es, Bob Santa (personnel specialist for
the agency) conducts a job analysis to ensure that the new selection procedures will meet the valida)on
requirements of the Uniform Guidelines. The job analysis method chosen was the critical incident
technique and the result was an inventory of critical behaviors for successful and unsuccessful
performance for this job. This led to the generation of knowledge, skills, abili)es, and other
characteristic (KSAO’s) and a new test and a structured interview. Finally, the agency considers the
appropriateness of content validity versus criterion-related validity in this situation. The topics covered
in this case include selection methods, job analysis, valida)on methods, and adverse impact in employee
selection.
II. OBJECTIVES
1. To recognize and iden)fy instances of adverse impact.
2. To demonstrate the importance of doing an appropriate job analysis with
documenta)on.
3. To understand the difference between content and criterion-related validity.
4. To demonstrate the importance of structure and job relatedness in the development
of the selection interview.
III. DISCUSSION
The agency, acknowledging that its sta1ng practice must be updated to reBect the Uniform
Guidelines has to critically evaluate its present selection procedures for adverse impact. Once adverse
impact has been found, the agency must react appropriately by either eliminating the adverse impact,
providing suitable validity evidence to jus)fy the adverse impact, or finding alternative selection
procedures with less adverse impact. The organization, in this case, decides that its practice require
modi4ca)on. The decision involves a job analysis, documenta)on, new and modi4ed procedures, and
validity evidence.
In reality, the decision between content and criterion-related validity was an interesting one. At
first it was thought that the selection procedures represented a sample of the observable work
behaviors. However, this evidence is generally based on expert judgment rather than empirical
evidence. Due to the type of job and the process used, it was thought that a predic)ve validity study
should be carried out. Why? Content validity is somewhat controversial. In some jobs where the test
(e.g., typing test) assesses a representative sample of observable work behaviors, the inferen)al leap
between judging what the selection procedure measures and the content of the job is likely to be small.
When using a semi-structured interview where some of the KSAOs (i.e., judgment) are not directly
83