U.S. flag

An official website of the United States government, Department of Justice.

NCJRS Virtual Library

The Virtual Library houses over 235,000 criminal justice resources, including all known OJP works.
Click here to search the NCJRS Virtual Library

EVALUATING LARGE SCALE SOCIAL SERVICE SYSTEMS IN CHANGING ENVIRONMENTS - DRAFT

NCJ Number
16897
Author(s)
R B COATES; A D MILLER
Date Published
1972
Length
47 pages
Annotation
A METHOD FOR EVALUATING SYSTEMS IN THE PROCESS OF CHANGE INCLUDING A RATIONALE FOR THIS TYPE OF EVALUATION, A DISCUSSION OF THE PROBLEMS IN EVALUATING CHANGING SYSTEMS AND A PROPOSED THREE-LEVEL EVALUATION MODEL.
Abstract
THE AUTHORS STATE THAT NORMAL EVALUATIONS REQUIRE STABLE CONDITIONS, WITHOUT AGENCY REFORMS OR CHANGES, UNTIL THE RESULTS OF THE EVALUATION ARE DETERMINED. THE IMPOSITION OF SUCH REQUIREMENTS IS SEEN AS A HINDRANCE TO PROGRAM IMPROVEMENTS AND A NEW, MORE FLEXIBLE EVALUATION METHOD IS PROPOSED. THIS SYSTEM-MODEL APPROACH, AS OPPOSED TO A GOAL-MODEL APPROACH, ATTEMPTS TO INCREASE THE NUMBER OF VARIABLES UNDER CONSIDERATION IN ORDER TO DEPICT THE INTERRELATIONSHIPS OF PROGRAMS BEING EVALUATED WITHIN THE LARGER SOCIAL SERVICE SYSTEM AND OTHER IMPINGING SYSTEMS. IMPORTANT FACTORS IN THIS TYPE OF EVALUATION ARE THE DEVELOPMENT OF A MORE SYSTEMATIC CONCEPTUAL SCHEME FOR PROGRAM EVALUATION, AND THE MAINTENANCE OF CLOSE TIES BETWEEN THE EVALUATION STAFF AND THE PROGRAM STAFF TO ALLOW FOR AWARENESS OF PROCESSES OF THE PROGRAM AND EXTERNAL POLITICAL PRESSURES ON THE PROGRAM. A GENERALIZED TRI-LEVEL EVALUATION MODEL IS OUTLINED, WHICH CONSIDERS IMMEDIATE, SHORT-RUN, AND LONG RUN CONCERNS OF THE PROGRAM. THIS MODEL SHOULD EXPAND THE KIND OF CRITERIA USED FOR ADDRESSING THE ISSUE OF SUCCESS, AND IT SHOULD FACILITATE DOING EVALUATION RESEARCH IN THE CONTEXT OF A CHANGING SYSTEM BECAUSE IT ENABLES THE EVALUATOR TO LOOK AT A WIDE VARIETY OF CRITERIA WHICH REFLECT NOT ONLY CHANGE OCCURRING WITHIN THE CLIENT BUT ALSO CHANGE OCCURRING WITHIN THE SYSTEM AND SYSTEM LINKAGES WHICH AFFECT CLIENT OUTCOMES. AN OUTLINE OF THE MODEL WITH EXAMPLES OF OPERATIONAL INDICATORS IS PROVIDED. (AUTHOR ABSTRACT MODIFIED)