Thursday 12 October 2017

8.45-9.15am Registration open
9.15-9.30am Welcome to Transforming Research
 9.30-11.15am Session 1: Assessing Broader Impact and Innovation Across The Disciplines

Our understanding of concepts of broader impact and impact innovation is frequently affected by observer bias: this session will open up some innovations for the audience to discuss, and apply to their own areas of expertise.Three expert speakers present three very different perspectives on understanding broader impact and will be exploring some of the nuances that are involved. Concepts such as discipline perspective, topic modeling and the role of certainty and uncertainty in understanding research outcomes will be explored by our three expert speakers.

Chair: William Gunn, Mendeley


  • Recent Progress in Research Portfolio Analysis – Dick Klavans, Map of Science
  • Professor Kiarri N Kershaw, Feinberg School of Medicine
11:15-11:30am Coffee
11:30-12:30pm Session 1: Assessing Broader Impact and Innovation Across The Disciplines…

Chair: William Gunn, Mendeley


  • The Types and Roles of Uncertainty in Science: Implications on Research Metrics and Beyond – Professor Chaomei Chen, Drexel University
 12.30-1.30pm Lunch
 1.30-4:30pm Session 2: Making Metrics Work Better For Decision-Makers

Oft-used evaluation metrics such as number of papers published, h-indices, and grant dollars awarded, tell evaluators surprisingly little about the actual quality and impact of an investigator’s work or a funded research portfolio. At best, these metrics are rough proxies to actual impact. In this session, funders, research administrators, and department chairs will discuss the challenges of relying solely on traditional metrics, and discuss the evolution of their evaluation strategies to address metric limitations.  Panelists will share ways they have tailored or modified traditional metrics, and discuss development or integration of new metrics into their evaluation strategies. Key considerations for the development of new evaluation metrics to provide more timely and context-based indicators of impact, and the challenges to implementing these new metrics in practice will be discussed.

Chair: Rachel Witsaman, PCORI


  • Stacy Konkiel, Altmetric
  • George M. Santangelo, National Institutes of Health
  • Kari Wojtanik, Susan G. Komen Foundation
4.30-5pm Coffee break


Session 3: Metrics and Precision Medicine – vendors show how their tools are driving this field forwards

Vendors from Altmetric, Elsevier (PlumX and SciVal), Clarivate, GrowKudos and UberResearch will make focused presentations on trends in ‘precision medicine’, and how their tools and metrics can be used to explore the data and understand this fast-changing field.

Chair: Anne Stone


  • Altmetric – Sara Rouhi
  • Clarivate Analytics – Amy Braden
  • Elsevier/PLUM – Marianne Parkhill
  • Kudos – Charlie Rapple
  • UberResearch – Mike Taylor/Aaron Sorenson

This session will be followed by drinks and networking (6-7 pm) – all attendees are warmly invited


Friday 13 October 2017

 9.15-9.30 am

Announcements, Framing the Day


Session 4: Developing and Assessing Broader Research Impacts – Examples from the Community

Chair: Professor Kristi Holmes, Northwestern University


  • Empowering researchers through values-driven evidence by Heather Coates, IUPUI University Library Center for Digital Scholarship
  • Formalizing an institutional wide Journal Club and Research Seminar Elective by Fatima Barnes, Howard University, and Lynwood McAllister, Howard University Hospital
  • Altmetric-Citation Disequilibria in Alzheimer-Disease Papers — Can Such Discrepancies Be Used to Differentiate between Investigators with Similar Citation-based Statistics? by Aaron Sorensen, Digital Science Consultancy
  • Capturing, Showcasing, and Measuring Research Impact among Biomedical Researchers by Robyn Reed, Sarah Bronson, and Joan Concilio, Penn State College of Medicine
  • Telling Your Science Story: The Power of Showcasing Qualitative Impact by Patty Smith, Northwestern University
  • VIVO Dashboard: A Drupal-based application for analyzing publication metadata by Michael Bales and Paul Albert, Weill Cornell Medicine


Coffee break



Session 5: The Map Versus The Territory: Exploring the Relationship between Research and Metrics

What do we measure and why do we measure it, and what values cannot be measured? Who constitutes our community, and what are our future research directions? Three leading thinkers will introduce some provoking ideas that will confront those of us involved in research evaluation.

Chair: Professor Robert Frodeman


  • Measuring Research Value in Time – Professor Steve Fuller, University of Warwick
  • Transforming Research Metrics – Professor J. Britt Holbrook, New Jersey Institute of Technology
  • Strangelovian Metrics – Professor Robert Frodeman, University of North Texas


Conclusions and Closing

1:15-2:30 pm

Lunch, with option to join open planning session for future Transforming Research events (all are welcome)


If you would like more information about this programme please email

Leave a Reply

Your email address will not be published. Required fields are marked *