English Arabic Chinese (Simplified) French Hindi Japanese Korean Persian Portuguese Russian Spanish

List of NEO Evaluation Reports by Date

2019 Reports
2020 Reports

All Hands Summit Feedback Survey Report, April 11, 2019
Prepared by NNLM Evaluation Office (NEO)
All Hands Summit for the Network of the National Library of Medicine (NNLM) staff was hosted at University of Maryland, Baltimore from March 4 through March 5, 2019. A total of 95 people attended the summit in person. The Summit agenda was developed by the Summit Planning Committee in response to the interest in and need of an in-person meeting for the NNLM staff. 
Link to PDF
Link to LiveStory

 
DEI Webinar #1: Social Justice: A Starting Place, June 19, 2019
Prepared by June Lee, Sc.D., Evaluation Specialist
The first of 9 webinars, Diversity and Social Justice: A Starting Place, was hosted on June 19, 2019. The class topics included recognizing difference and engagement habits, personal reflection and seeking out new experiences, conscious and unconscious bias, and the role of curiosity, generosity, authenticity, and vulnerability. The class evaluation survey was modified from the existing NNLM training evaluation form to include class-specific learning outcome questions. An evaluation link was provided to the class attendees on June 19, 2019 and was open until July 16, 2019.  A total of 370 people attended the class. 216 participants completed the class evaluation with a response rate of 58 percent. 
Link to PDF

 
All of Us Partner Baseline Survey. East Adams Library District, August 07, 2019
Prepared by Susan M. Wolfe, Ph.D., All of Us Evaluation Specialist.
East Adams Library District in the State of Washington received an All of Us Health Literacy Outreach funding award from the NNLM Pacific Northwest Region (PNR) for a project called Access Health at East Adams. Five (5) individuals from the East Adams Library District who will be involved in this project responded to a baseline survey between June 19, 2019, and July 1, 2019
Link to PDF

 
All of Us Partner Baseline Survey. Multnomah County Library, August 07, 2019
Prepared by Susan M. Wolfe, Ph.D., All of Us Evaluation Specialist.
Multnomah County Library in Oregon received an All of Us Health Literacy Outreach funding award from the NNLM Pacific Northwest Region (PNR) for a project called Healthy Pathways: Programs, Resources, and Education for Multnomah County’s Vietnamese, Cantonese, and Mandarin Communities. Nine (9) individuals from the Multnomah County Library who will be involved in this project responded to a baseline survey between July 2, 2019 and July 5, 2019.
Link to PDF

 
DEI Webinar #2: Conscious Bias: Perceptions of Self and Others, August 21, 2019
Prepared by June Lee, Sc.D., Evaluation Specialist and Serene Myers, MPH, Evaluation Specialist
The second of 9 webinars, Unconscious Bias: Perceptions of Self & Others, was hosted on August 21, 2019. The class topics included self-reflection activities to identify difference, recognizing the role of positive and negative bias in our conscious and unconscious bias, and paying attention to one’s own habits and beliefs and reinforcing or editing them to align with his/her own personal values. The class evaluation survey was modified from the existing NNLM training evaluation form to include class-specific learning outcome questions. An evaluation link was provided to the class attendees on August 21, 2019. As the survey remains open for people seeking Continuing Education (CE) credit, this report included the surveys completed from August 21st, 2019 through September 4th, 2019.  A total of 364 people attended the class. 160 surveys were completed, two of which were duplicate surveys and were removed. As a result, 158 participants completed the class evaluation with a response rate of 43 percent. 
Link to PDF
Link to LiveStory

 
DEI Webinar #3: Being a Better Ally to All, October 16, 2019
Prepared by June Lee, Sc.D., Evaluation Specialist and Serene Myers, MPH, Evaluation Specialist
The third of 9 webinars, Being a Better Ally to All, was hosted on October 16, 2019. The class topics included improving listening skills during difficult conversations or conflict, asking better questions through conscious and unconscious bias, and taking responsibility for who and how a person shows up in relationships with key stakeholders, leaders, colleagues, etc. The class evaluation survey was modified from the existing NNLM training evaluation form to include class-specific learning outcome questions. An evaluation link was provided to the class attendees on October 16, 2019. As the survey remains open for people seeking Continuing Education (CE) credit, this report included the surveys completed from October 16th, 2019 through October 24th, 2019.  A total of 240 people attended the class and 104 surveys were completed with a response rate of 43 percent.
Link to PDF
Link to LiveStory

 
NNLM All of Us Community Engagement Network Reading Club Survey Results, October 2019
Prepared by Susan M. Wolfe, Ph.D., All of Us Evaluation Specialist.
The NNLM All of Us Community Engagement Network Reading Club is a selection of “ready to use” book titles with free and downloadable materials. The purpose is to help libraries support their communities’ health information needs. Health topics in the books align to the NIH All of Us Research Program and the National Health Observances calendar. The kits include eight each: books, bookmarks, discussion guides, NIH Medline Plus Magazines, NIH All of Us Research Program brochures, and reading club book bags. Libraries complete an online application form and acceptance is based on supply, with priority given to public libraries supporting outreach to populations that meet the NIH Underrepresented in Biomedical Research (UBR) criteria. This report presents responses from the online survey completed by libraries that received the Reading Club Kits.
Link to PDF

 
Results Libraries as Partners in Health Post-Program Surveys, October 2019
Prepared by Susan M. Wolfe, Ph.D., All of Us Evaluation Specialist.
NNLM presented the Libraries as Partners in Health: An NNLM Seminar on Consumer Health on Friday, June 21st at the National Institutes of Health Campus from 9 a.m. to 2 p.m. Forty-three librarians attended this seminar. Topics covered included: NNLM offerings to support health programming at libraries, a tour of the National Library of Medicine, and a brainstorming session to develop health programs for participants’ libraries. This report presents the results of the Post-Seminar survey and the NNLM Professional Development Survey.
Link to PDF

National Evaluation Office (NEO) RDM 102 Focus Group, September 2019
MGT was asked to propose an evaluation of the perceptions of 43 participants who completed the Beyond Research Data Management for Biomedical & Health Sciences Librarians (RDM 102) course, which concluded in April 2019. In the proposal, MGT agreed to complete three to five, 45- to 60-minute virtual focus groups and summarize findings, as well as provide transcripts and body language reporting in order to develop an accurate assessment of the perceptions of the course.​
Link to LiveStory

DEI Webinar #4: Working across Difference: Making Better Connections, November 13, 2019
Prepared by Serene Myers, MPH, Evaluation Specialist
The fourth of 9 webinars, Working Across Difference: Making Better Connections, was hosted on November 13th, 2019. The session included content on understanding cultural and social differences, tips for clarifying cultural differences, addressing contentious topics, and changing the culture around addressing difficult topics. The session evaluation survey was modified from the existing NNLM training evaluation form to include session-specific learning outcome questions. An evaluation link was provided to the session attendees on November 13th, 2019. As the survey remains open for people seeking Continuing Education (CE) credit, this report included the surveys completed from November 13th, 2019 through December 2nd, 2019. A total of 209 people attended the session and 93 surveys were completed with a response rate of 44 percent.
Link to PDF
Link to LiveStory

Baseline Survey Results: Healthy Aging for a Healthy Alaska, Juneau Public Libraries, Juneau, Alaska, January 2020
Prepared by Susan M. Wolfe, Ph.D., All of Us Evaluation Specialist
Juneau Public Libraries (JPL) in Juneau, Alaska received an All of Us Health Literacy Outreach Award for their project titles "Healthy Aging for a Healthy Alaska." The goals of this project are to strengthen community engagement, increase awareness of NLM services and the All of Us Research Program, and highlight the library as a primary source of reliable information. JPL will design Memory Kits in partnership with the Alzheimer's Resource of Alaska that include materials such as DVDs, CDs, books, memory cards, and tactile materials and provide a way for friends and families to interact with their loved one(s) who have dementia. They will be available to 99% of Alaskan residents, including those who live remotely, though the Alaska Mail Services program. JPL will also provide education and training for library staff and the public covering MedlinePlus, Genetics Home Reference, information about All of Us, and other health related library resources available to the public. The project was funded by the NNLM Pacific Northwest Regional Medical Library. Three of four library staff assigned to this project completed the NNLM All of Us Baseline Survey. The results reported here are from those three respondents.
Link to LiveStory

DEI Webinar #5: That's Not funny! Or is It?, January 22, 2020
Prepared by Serene Myers, MPH, Evaluation Specialist
The Pacific Northwest Region Medical Library hosted the fifth of nine webinars, That’s Not Funny? Or is It? on January 22nd, 2020. The session included content on being thoughtful when making comments, jokes, or planning programs, taking ownership of decisions to use humor, and being responsible for the impact when one’s use of humor doesn’t land well. The session evaluation survey was modified from the existing NNLM training evaluation form to include session-specific learning outcome questions. An evaluation link was provided to the session attendees on January 22nd, 2020. As the survey remains open for people seeking Continuing Education (CE) credit, this report included the surveys completed from January 22nd, 2020, through February 11th, 2020.  A total of 217 people attended the session and 103 surveys were completed with a response rate of  47% percent. The Survey data was subsequently downloaded from REDCap and analyzed by the NEO Evaluation Specialist using SPSS version 26.0 for univariate analysis. A paired-sample test was conducted to compare the difference in the respondents’ expertise prior to and after taking the session.
Link to LiveStory

2020 NNLM Summit Feedback Survey Report, February 4-5, 2020
Prepared by the NNLM Evaluation Office (NEO)
The 2020 Summit for the Network of the National Library of Medicine (NNLM) staff was hosted at the University of Utah, Salt Lake City, February 4 through February 5, 2020. A total of 81 people attended the Summit in-person and 5 people attended the Summit online. The Summit Planning Committee developed the agenda in response to the interest in and need of an in-person meeting for the NNLM staff. As defined by the planning committee, the purpose of the 2020 Summit was to ‘Develop a coordinated approach to achieving success around national initiatives and NIH & NLM Priorities for NNLM.’ This was conceptualized as being achieved by 1) Building on the 2019 All Hands Summit Key Findings and 2) Linking NNLM Performance Measures to Summit outcomes/outputs. 
Link to PDF
Link to LiveStory

DEI Webinar #6: Knowing what You Don't Know: Medical Micro-aggressions, March 18, 2020
Prepared by Serene Myers, MPH, Evaluation Specialist
The Pacific Northwest Region Medical Library hosted the sixth of nine webinars, Knowing what You Don’t Know: Medical Micro-aggressions on March 18th, 2020. The session included content on understanding the difference between social justice and diversity, reflecting on our own and others’ life stories, having difficult conversations with others, and having conversations about the unknown. The session evaluation survey was modified from the existing NNLM training evaluation form to include session-specific learning outcome questions. A total of 255 people attended the session and 68 surveys were completed with a response rate of 27% percent. The Survey data were subsequently downloaded from REDCap and analyzed by the NEO Evaluation Specialist using SPSS version 26.0 for univariate analysis. A paired-sample test was conducted to compare the difference in the respondents’ expertise prior to and after taking the session.
Link to PDF
Link to Livestory

DEI Webinar #7: I am Safe Zones: Sticks and Stones LGBTQIA 101, May 13, 2020
Prepared by Serene Myers, MPH, Evaluation Specialist
The Pacific Northwest Region Medical Library hosted the seventh of nine webinars, I am Safe Zones: Sticks and Stones LGBTQIA 101 on May 13th, 2020. The session included content on identifying stereotypes, derogatory terms, and other assumptions for lesbian, gay, bisexual, trans, and heterosexual people. The session evaluation survey was modified from the existing NNLM training evaluation form to include session-specific learning outcome questions. A total of 305 people attended the session and 101 surveys were completed with a response rate of 33% percent. The Survey data were subsequently downloaded from REDCap and analyzed by the NEO Evaluation Specialist using SPSS version 26.0 for univariate analysis. A paired-sample test was conducted to compare the difference in the respondents’ expertise prior to and after taking the session.
Link to PDF
Link to Livestory

DEI Webinar #8: I am Safe Zones: Gender this!, July 15, 2020
Prepared by Serene Myers, MPH, Evaluation Specialist
The Pacific Northwest Region Medical Library hosted the eighth of nine webinars, I am Safe Zones: Gender This! on July 15th, 2020. The session included content on identifying stereotypes, derogatory terms, and other assumptions for lesbian, gay, bisexual, trans, and heterosexual people. The session evaluation survey was modified from the existing NNLM training evaluation form to include session-specific learning outcome questions. An evaluation link was provided to the session attendees on July 15th, 2020. As the survey remains open for people seeking Continuing Education (CE) credit, this report included the surveys completed from July 15th, 2020 through July 28th, 2020. A total of 224 people attended the session and 74 surveys were completed with a response rate of 33% percent. The Survey data were subsequently downloaded from REDCapi and analyzed by the NEO Evaluation Specialist using SPSS version 26.0 for univariate analysis. A paired-sample test was conducted to compare the difference in the respondents’ expertise prior to and after taking the session. 
Link to PDF
Link to Livestory
 
DEI Webinar #9: I am Safe Zones: Messages I Learned, August 12, 2020
Prepared by Serene Myers, MPH, Evaluation Specialist
The Pacific Northwest Region Medical Library hosted the ninth of nine webinars, I am Safe Zones: Messages I Learned on August 12th, 2020. The session included content on identifying messages learned about identities (self and others) and the functions of internalized and externalized oppression.
The session evaluation survey was modified from the existing NNLM training evaluation form to include session-specific learning outcome questions. An evaluation link was provided to the session attendees on August 12th, 2020. As the survey remains open for people seeking Continuing Education (CE) credit, this report included the surveys completed from August 12th, 2020 through August 25th, 2020.  A total of 159 people attended the session and 53 surveys were completed with a response rate of 33% percent. 
The Survey data were subsequently downloaded from REDCap and analyzed by the NEO Evaluation Specialist using SPSS version 26.0 for univariate analysis. A paired-sample test was conducted to compare the difference in the respondents’ expertise prior to and after taking the session.

Link to Livestory