To elicit feedback on the Multi-Year Report and its usefulness to individuals and their roles in their hubs.
The Common Metrics Initiative (CMI) Multi-Year Data Report: 2015-2018 was released by the Center for Leading Innovation and Collaboration (CLIC) to hub-specific web pages on the CLIC website on February 27, 2020. Hubs were required to use a federated log in to access their individual reports.
The CMI Multi-Year Report included visualizations for Longitudinal data for each of the common metrics (Median IRB Review Duration, Pilot Funding and Publications, and Careers in Clinical and Translational Research – both TL1 and KL2), and Year-to-Year Comparison data 2017-2018. It also included: Data Stratification (by region, hub maturity, and hub award size); Featured Hub TTC Plans for the Careers Metric; a description of the data cleaning process; and the methodology used to generate the report. PowerPoint slides for each of the metric visualizations were provided to the hubs.
The Multi-Year Common Metrics Feedback Survey was sent on March 23, 2020 via email, to the principal investigators, evaluators and administrators at each hub throughout the consortium. Those receiving the survey were instructed that there was no limit to the number of surveys that their hubs could submit. The survey was closed on April 7, 2020.
A total of 64 surveys were received from 52 unique hubs. This report includes the quantitative and qualitative results in their entirety.
Key Considerations:
Based on the survey responses in these feedback areas, there is agreement to continue to reflect the following areas in future reports and planned activities:
- Report longitudinal data
- Report year-to-year comparison data
- Data stratification
- Conduct webinar(s) that explain how reports are generated
- Provide PowerPoint slides for each of the visualizations
Hubs responded that the data stratifications were useful; but that they hope that the data are stratified differently in future reports. The CLIC is developing a mechanism for the featured hubs to share their practices with others across the consortium.
Almost all survey respondents (96.8%) indicated that they either had or were planning to discuss the report with their hub metric teams. In addition, 83.3% of the respondents indicated that they had or were planning to discuss their report with their NCATS Program Officer.