"Measuring the Impacts of Federal Investments in Research" ed. by Steve Olson, Stephen Merrill

The workshop sought to assemble the range of work that has been done in measuring research outcomes and to provide a forum to discuss its method. The workshop discussed a variety of complex and interconnected issues, such as the short-term and long-term economic and non-economic impact of federal research funding, factors that determine whether federally funded research discoveries result in economic benefits, and quantification of the impacts of research on national security, the environment, health, education, public welfare, and decision making.

CONTENTS
1 INTRODUCTION AND OVERVIEW
2 THE USES AND MISUSES OF PERFORMANCE MEASURES
The Promise and the Limits of Measuring the Impact of Federally Supported Research
Innovation as an Ecosystem.
Overcoming the Challenges of Research Measures
Discussion
3 IMPACTS ON THE U.S. ECONOMY AND QUALITY OF LIFE
Federal Research and Productivity
Indirect Economic Benefits of Research
Beyond Citations and Patent Reference Counts
Discussion
4 IMPACTS ON BIOMEDICAL AND HEALTH RESEARCH
Reviewing the Literature on Health Impacts
The Volatility of Federal R and D Support
Medical Device Innovation
Making Decisions in the Pharmaceutical Industry
Research and Outcomes Case Study: Pediatric HIV
Discussion
5 MIXED MARKET AND NON-MARKET IMPACTS OF RESEARCH
Measuring Progress toward Goals in Agricultural Productivity
Investment Decisions at DuPont
Challenges in Quantifying Research Value in Agriculture
Measuring Success in Conservation
National Security Benefits
Public Problem Solving
Discussion
6 IMPACTS OF RESEARCH ON THE LABOR MARKET AND CAREER DEVELOPMENT
R and D Spending and the R and D Workforce
Surveys of Graduate Students and Postdoctoral Fellows
The Complex Network of Skills and Investments
Discussion
7 INTERNATIONAL PERSPECTIVES ON MEASURING
RESEARCH IMPACTS
Medical Research Council Evaluation System
Measuring Impacts of Research Funding In the European Union
Measuring Impacts of Science, Technology, and Innovation Investments in Brazil
Discussion
8 EMERGING METRICS AND MODELS
Assessing Research at NSF
The STAR Metrics Project
Reconstructing Networks of Discovery
Creating Knowledge from Data
Measuring the Impact of Star Scientists
Visual Analytics
Considerations in Building Comprehensive Databases
Discussion
9 PITFALLS, PROGRESS, AND OPPORTUNITIES
Pitfalls on the Road to Understanding
Progress in Understanding the Issues
Opportunities Posed by Greater Understanding
Concluding Remarks
REFERENCES
A WORKSHOP AGENDA
B BIOGRAPHICAL INFORMATION
C THE PROMISES AND LIMITATIONS OF PERFORMANCE MEASURES, Irwin Feller
D THE IMPACT OF PUBLICLY FUNDED BIOMEDICAL AND HEALTH RESEARCH: A REVIEW, Bhaven Sampat