The Writing Skills Assessment is a premium offering in which applicants provide a free text response to a prompt. Their response is then automatically scored by a computer software application. The application scoring engine is trained using a sample of responses that are hand-scored by human raters using detailed scoring rubrics. Custom and off-the-shelf versions of the assessment are available that can be integrated into an agency’s hiring process.
Leveraging Technology to Measure Critical Writing Competency
The Writing Skills Assessment utilizes a sophisticated scoring engine that employs methods used in automatic speech recognition and computational linguistics. The combination of methods results in a state-of-the-art and psychometrically sound approach to evaluating text that simulates human understanding. Elements of “good writing” such as a vocabulary, grammar, and sentence structure is taken into account, as well as an understanding of text meaning, much like that of a human rater.
Advantages of Machine Scoring
-
Reduced Resource Requirements – One thousand computer-scored assessments saves an average of 450 person hours.
-
Increased Detail Orientation – A computer can compare every assessment and perform complex analyses that humans are incapable of computing without assistance.
-
Scoring Consistency – A computer is completely consistent in its evaluation from assessment to assessment.
-
Objectivity – A computer is free of the reasoning and judgment errors, myths, false beliefs, and value biases that plague human judgments.
-
Increased Scoring Speed – Assessment scores are produced in seconds as opposed to days or months.
For Additional Information
Contact the USA Hire Program Office or your USA Staffing Account Manager for more information.
Email the USA Hire Program Office