<continued from previous page>

The Review Process

What happens after a program is submitted for review? According to Ms. Schwinn, each program is first assessed by the NREPP team to ensure that everything is in order for a complete review. Developers may not simply submit a narrative description of their program, but must offer scientific data supporting their claims.

Once the submission packet is complete, the program is assigned to a review team of experts. Reviewers independently review and rate the program on a number of factors and assess both its integrity and its utility.

“Integrity refers to the overall level of confidence that the reviewer can place in project findings based on research design and implementation,” explains SAMHSA’s Science to Service Coordinator Kevin Hennessy. “A high score means that the reviewer believes that the research findings are sound.”

“Utility refers to the overall usefulness of project findings for informing prevention theory and practice,” he continued. “For example, a program may be very well-designed in terms of research, but have very little overall value to the community.”

Programs are rated according to a five point scale:

• Effective programs are those with a score of 4.0–5.0 on both integrity and utility. Effective programs are those that are found to be well-implemented, well-evaluated, and to produce a consistent pattern of positive results.
• Promising programs are those with a score of 3.33–3.99 on both integrity and utility. Promising programs are those that have been implemented and evaluated sufficiently and have demonstrated positive outcomes. However, they have not yet been shown to have sufficient rigor and/or consistently positive outcomes required for effective program status.
• Insufficient Current Support is the designation used for programs with a score of 1.0–3.32 on integrity and utility.

Model Programs

Once a program has been identified as an effective program by reviewers, it is invited to be recognized as a SAMHSA model program.
A model program is an effective program that can be taken to scale for national dissemination. The program’s developers have agreed to participate in SAMHSA’s dissemination efforts and are able to provide supporting materials, training, and technical assistance to others.

As Ms. Schwinn explains, “Every model program has been designated an effective program, but not every effective program achieves model program status. Some developers simply aren’t in the position to disseminate their program nationwide. Perhaps they have moved on to a different area of scientific research, or their office is not equipped to handle a large number of calls. In order to be recognized as a model program, developers need to be able to provide intensive technical assistance. It can be quite demanding.”

Model programs receive promotional support from SAMHSA in the form of fact sheets, recognition on the model programs Web site, and invitations to present at national conferences.

<continued on next page>