Tracking and Evaluation
Methods and Measuring Outcomes
Meaningful measurements and data collection are important steps in program evaluation. The Tracking and Evaluation team utilizes mixed methods to monitor success, including data surveillance, surveys, and specific aim reports (key performance indicators). In addition, we collect qualitative feedback from program faculty, staff, and investigators to identify areas needing immediate or drastic improvement. Tracking and Evaluation employs classic methodologies to assess CTM effects on investigators and trainees (customers), program components (contributors), and the larger system (clinical and translational science as a whole).
Tracking and Evaluation methods and measures are two-fold. First, there is a focus on each individual CTM component to assist in promoting user-defined specific aims and metrics to determine success. The Tracking and Evaluation team and CTM component leaders work together to create metrics used to demonstrate measurable progress and success of individual specific aims. These metrics are revised year-to-year as the grant progresses based on their effectiveness and usefulness. Metrics and progress reports on specific aims are collected using a quarterly tracking system, which allows for data maintenance throughout the year.
The second focus is in seeking to bridge internal gaps between components to facilitate dynamic improvement, analyzing performance data from different sources to inform cross-functional metrics.
The CTM is required to report to the NIH all publications associated with projects that receive services, resources, or other funding from the CTM. The Tracking and Evaluation team assists investigators with properly citing CTM grants when a manuscript is submitted to a journal as well as ensuring that papers accepted for publication are deposited in the NIH Manuscript Submission system for their release to PubMed Central.
CTSA Evaluation Methodology Publications and Important Links
- Factor Analysis of the Clinical Research Appraisal Inventory (CRAI)
- Institute Of Medicine Report - The CTSA Program at NIH: Opportunities for Advancing Clinical and Translational Research
- Evaluation Guidelines for the Clinical and Translational Science Awards (CTSAs)
- Evaluating Translational Research: A Process Marker Model
- Common Metrics to Assess the Efficiency of Clinical Research
- Evaluation Metrics for Biostatistical and Epidemiological Collaborations
- Evaluating and Giving Feedback to Mentors: New Evidence-Based Approaches
- Assessing Research Self-Efficacy in the Physician-Scientists: The Clinical Research Appraisal Inventory
- A Shortened Version of the Clinical Research Appraisal Inventory: CRAI-12
- Google Wave: Have CTSA-Minded Institutions Caught It?
- Using Research Metrics to Improve Timelines: Proceedings from the 2nd Annual CTSA Clinical Research Management Workshop