Community Support

Integrating Process and Outcome Evaluations

Table of Contents

I. INTRODUCTION AND OVERVIEW
Project-Level Databases, Meta-Analysis and Case Studies
Organization of this toolkit

II. WHAT IS A PROJECT-LEVEL DATABASE?
Ways of looking at a project-level database
Deciding when to use a project-level database
Does a project-level database meet your needs?

III. SELECTING AND STRUCTURING VARIABLES FOR PROJECT-LEVEL DATABASE
Information at the program or "project level"
Community and organizational context
Program logic, component structure, or program theory
Program implementation and changes over time: measures, key events, dates
Other guidance: "Program Templates"
Appropriate data sources

IV. CODING VARIABLES FOR A PROJECT-LEVEL DATABASE
Identifying members of a project-level database team
Initial identification of data elements and structures
Additional nominations of data elements are solicited
Developing and refining appropriate instruments
Mailings, meetings, discussions to finalize coding schemes
Managing the coding process

V. DEVELOPING A COMPUTERIZED DATABASE

VI. PREPARING FOR ANALYTIC USES OF THE DATABASE
Cross-site descriptive analysis of multi-site demonstrations
Multi-level analyses of project and participant-level data
A Simple Illustration of Multi-Level Analysis: Implementation and outcomes of NIAAA Homeless Projects
Extensions of PDB use to meta-analysis of implementation and
outcome evaluations: Comparison bases for individual projects

REFERENCES

APPENDIX

APPENDIX A: Description of the NIAAA Cooperative Agreement Program
APPENDIX B: NIAAA Project-Level Database Coding Form
APPENDIX C: Cross-Case Displays from the NIAAA Project-Level Database