Program Session

3 - Implementing the Vision: Making Research Evaluation Services a Reality

Monday, May 29
11:05 AM - 11:20 AM
Room: 603

Objectives: The increased demand for evaluation of research has led many libraries to consider providing evaluation support services. This paper discusses the different service models adopted by seven institutions, representing four medical libraries, one federal library, and one academic library and a funding support agency. Each model is described in detail with historical context, current service offerings, and future plans.

Methods: It can be very helpful to build a network of colleagues for support and discussion when implementing or augmenting services offered by the library. A group of seven libraries have consistently come together as colleagues to discuss advances in bibliometrics and new directions in research assessment. These seven institutions developed a narrative that describes their experiences building evaluation support services, reflects upon past evaluation-based projects, and discusses their future plans. This narrative serves as a trusted blueprint for any library considering these services and as a reliable companion for those already in the field.

Results: In implementing any new service, what works for one library may not for another. Some libraries have formal research evaluation services that exist as either a department or specialized group within the library, while others have adopted a decentralized approach where librarians provide services for their users on an as needed basis. Some libraries provide complimentary access to all of their services, while others have suggested providing a menu of options outlining complimentary and fee-based services. Seven institutions share their methods to demonstrate how libraries can offer these services and utilize only those aspects that make sense in their context.

Conclusion: The implementation of increasingly sophisticated literature databases, repositories, and research networking platforms means that libraries now have access to large quantities of digital data. This data is both qualitative and quantitative and include bibliographic data; gray literature; social media data; grant funding data, and new software applications that allow for visualization of data. Librarians can harness these data because of their expertise in capturing, describing, curating and visualizing data for a variety of purposes. Librarians can serve as neutral but active participants in research evaluation by advising on reliable measures, providing appropriate data, and promoting responsible use of metrics.

Keywords: research evaluation, research assessment, bibliometrics, library services, research support, research information systems

Program Session

Karen Gutzman

Impact and Evaluation Librarian
Galter Health Sciences Library
Chicago, Illinois

As the Impact and Evaluation Librarian at Galter Health Sciences Library at Northwestern University, Karen supports individuals and groups in their understanding, assessment, visualization, and reporting of impactful outcomes of research and clinical care efforts. Karen was a U.S. National Library of Medicine Associate Fellow where she completed the second year of the fellowship program through her work with the Bernard Becker Medical Library at Washington University in St. Louis. She is interested in providing information support to basic science researchers and graduate students. She also is learning more about how to evaluate and visualize research impact using bibliometric data. Karen received her MS degree in Library Science in 2012 from the University of North Texas with an emphasis in Health Informatics.


Send Email for Karen Gutzman

Michael E. Bales

Research Impact and Evaluation Informationist
Samuel J. Wood Library
New York, New York

Michael Bales, MPH, PhD is the Research Impact and Evaluation Informationist at the Samuel J. Wood Library at Weill Cornell Medicine (WCM). A graduate of the Department of Biomedical Informatics at Columbia University, Michael has authored articles on scientific social networking, geographic information systems, and autism genomics. Prior to his doctoral studies he obtained a Master of Public Health in Epidemiology at the University of Minnesota, then completed a Public Health Informatics Fellowship at the U.S. Centers for Disease Control and Prevention. His work at WCM focuses on publication data management, scholarly impact assessment, and informatics policy. Michael also serves as an informationist in the Clinical and Translational Science Center, a WCM multi-institutional consortium.


Send Email for Michael Bales

Christopher W. Belter

NIH Library
Silver Spring, MD

Chris Belter (MLS) is a bibliometrics informationist at the NIH Library. He joined the NIH Library in May 2014 from the Central Library of the National Oceanic and Atmospheric Administration, where he managed and analyzed publications from the agency’s intramural and extramural research programs. He has an undergraduate degree in Religion from Shenandoah University and an MLS from the University of Maryland. At the NIH Library, Chris provides services related to bibliometrics, portfolio analysis, and data visualization.


Send Email for Christopher Belter

Liza Chan

Research Librarian
J. W. Scott Health Sciences Library
Edmonton, AB, Canada


Send Email for Liza Chan

Kristi L. Holmes

Library Director and Associate Professor of Preventive Medicine, Health and Biomedical Informatics Division
Galter Health Sciences Library
Chicago, Illinois

Kristi Holmes, PhD is the Director of Galter Health Sciences Library and an Associate Professor in the Department of Preventative Medicine (Health and Biomedical Informatics) and the Department of Medical Education at Northwestern University’s Feinberg School of Medicine. Dr. Holmes directs the Evaluation and Continuous Improvement Program in the Northwestern University Clinical and Translational Sciences Institute (NUCATS) and serves on its executive committee. In her role as director at Galter Library, she is delighted to have an opportunity to help define new roles and opportunities for the modern biomedical research library in an increasingly informatics and data-driven environment.


Send Email for Kristi Holmes

Ya-Ling Lu

National Institutes of Health
Bethesda, MD

Dr. Ya-Ling Lu joined the NIH Library in 2014. Ya-Ling earned her MLIS and PhD from UCLA.

At NIH Library, Ya-Ling provides research support services related to bilbiometrics. Some topics include: publication productivity, collaboration and co-author network, research topics, and citation impact. Ya-Ling is also exploring alternative metrics and welcome communications from interested parties. Her other professional interests include user behaviors, bibliotherapy and children's literature.


Send Email for Ya-Ling Lu

Lisa A. Palmer

Institutional Repository Librarian
Lamar Soutter Library
Worcester, MA

Lisa A. Palmer, MSLS, AHIP, is the Institutional Repository Librarian at the Lamar Soutter Library at the University of Massachusetts Medical School. She oversees eScholarship@UMMS, the medical school’s repository and publishing system for digital research and scholarship. In this role she serves as an editor for the Journal of eScience Librarianshipand other publications. She also provides support for scholarly communication activities, open access, author rights, research impact, copyright, research data management, and NIH Public Access compliance. She earned her graduate degree in library science from Simmons College in Boston, MA. Prior to joining UMass, Lisa was a corporate librarian for Digital Equipment Corporation, Compaq Computer Corporation, and Hewlett-Packard.


Send Email for Lisa Palmer

Rebecca Reznik-Zellen

Head, Research and Scholarly Communication Services
Lamar Soutter Library
Worcester, Massachusetts

Rebecca Reznik-Zellen is the head of research and scholarly communication services at the University of Massachusetts Medical School. Prior to joining the Lamar Soutter Library in 2013, Reznik-Zellen was the digital strategies coordinator at the University of Massachusetts Amherst Libraries (2011-2013) and the science librarian for the Center for Hierarchical Manufacturing, also at the University of Massachusetts Amherst (2006-2011). Reznik-Zellen received her MLIS from Simmons College in 2006 and holds a MA in philosophy from the Katholieke Universiteit Leuven, Belgium.


Send Email for Rebecca Reznik-Zellen

Cathy C. Sarli

Senior Librarian
Becker Medical Library
School of Medicine, Washington University in St. Louis
St. Louis, Missouri

Cathy C. Sarli, MLS, AHIP, Senior Librarian for Evaluation and Assessment Services, Bernard Becker Medical Library at Washington University School of Medicine in St. Louis


Send Email for Cathy Sarli

Amy M. Suiter

Scholarly Publishing Librarian
Bernard Becker Medical Library
Saint Louis, MO

Amy Suiter is a Scholarly Publishing Librarian at the Bernard Becker Medical Library at Washington University School of Medicine in St. Louis. Amy serves as co-manager of the library's institutional repository and she provides support in the areas of copyright, public access mandates and evaluation of scholarly productivity and impact. She generates h-index reports, social network analysis maps, and publication reports for scholars and departments on campus. She is also a member of the Tracking and Evaluation Team for the Washington University Institute of Clinical and Translational Sciences (ICTS).


Send Email for Amy Suiter

Thane Chambers

Research Librarian
John W. Scott Health Sciences Library
University of Alberta
Edmonton, AB, Canada


Send Email for Thane Chambers

Terrie R. Wheeler

Samuel J. Wood Library
New York, New York

Terrie R. Wheeler was appointed the Director of the Samuel J. Wood Library and C.V. Starr Biomedical Information Center in 2014 to lead a library transformation to a facility supporting next generation science, care and education at Weill Cornell Medicine. She has over 33 years of experience in medical librarianship that enables her to effectively lead change. She has already brought an informationist supplement to the Clinical and Translational Science Center at Weill Cornell, and has introduced grant editing, bioinformatics and research impact assessment as new library services. Her leadership has envigorated current programs, and set a vision for the future that is about information services to advance science.

She has held prior supervisory positions since 1991 at the Department of Veterans Affairs, the National Institutes of Standards and Technology, the Walter Reed Army Institute of Research and most recently as the Chief of the Education Services Branch of the National Institutes of Health Library. She has experience as both a clinical and basic sciences informationist.

Active in MLA since the 1980’s, Ms. Wheeler has served at various times as Research Section Chair, Federal Libraries Section Chair, Federal Libraries Section Webmaster, and Chapter Chair, Chapter Representative to Chapter Council, and Consumer and Patient Health Information Section Secretary. She has also been an invited speaker at MLA, SLA, ASIS and AMIA.

Ms. Wheeler’s research interest is information seeking behaviors, integrating information into workflows and program evaluation. In 2015 she was awarded a two year NIH informationist supplement grant. In 2007 she published research on integrating an information tool into the electronic medical record to assist clinicians with questions as they saw patients. She also has a keen interest in information technology and in communicating the value of libraries in language with data that administrators understand. This interest resulted in a five federal agency study of the value of the information provided by a librarian conducted in 2010 – 2011.

A cornerstone of her Walter Reed Army Institute of Research work was the Gorgas Memorial Library Federal Library of the Year Award. One of the efforts this award recognized was the customized products and services that included research impact analyses of infectious disease science for efficacy and influence. This work was used to justify future funding and to report scientific progress in the Command’s Balanced Scorecard. She has continued bibliometrics work by supporting the establishment of percentile rank based metrics at Weill Cornell.

A graduate of Adrian College and then the University of Michigan, Ms. Wheeler holds Bachelor’s degrees in Biology and English, and a Master’s in Library Science with an emphasis in Medical Librarianship.

As Director of the Samuel J. Wood Library, Terrie oversees a staff of 35 in the Library, Medical Archives, Duplicating Service and Myra Mahon Patient Resource Center. She is a Director on the Chief Information Officer’s Council, as well as serving on several Medical College faculty committees.


Send Email for Terrie Wheeler


3 - Implementing the Vision: Making Research Evaluation Services a Reality

MP3 Audio Slides Video

Attendees who have favorited this

Please enter your access key

The asset you are trying to access is locked. Please enter your access key to unlock.

Send Email for Implementing the Vision: Making Research Evaluation Services a Reality