Innovative Metrics to Evaluate R&D

Abstract:
Hear from speakers that are using innovative metrics and methods, including combining information and data from various sources, to make R&D investment decisions and to understand impacts of their R&D investments. Hear how agencies are coordinating the use of these metrics and methods within and across agencies.

Presentations:

Jeff Dowd,

DOE:

will discuss a suite of metrics toward building an evidence culture in DOE’s Office of Energy Efficiency and Renewable Energy.

[presenter materials]

Monica Linnenbrink,

EPA:

will discuss a pilot project that tracks the use of traditional and alternative metrics.

[presenter materials]

George Santangelo,

NIH:

will discuss the use of AI/ML and agency coordination.

Discussion Questions:

• How can altmetrics be used for decision making?
• What are best practices to minimize the inappropriate use of metrics?
• How should the optimal mix of AI/ML and human intervention be determined for decision making?
• What are best practices and lessons learned for obtaining assurance that the use of the information derived from metrics is actually being used in decision making?
• In the determination of impact and ROI, what are the considerations for determining what would have happened had the intervention not taken place?