Skip all navigation and go to page content
NN/LM Home About MAR | Contact MAR | Feedback |Site Map | Help | Bookmark and Share

Archive for the ‘Evaluation’ Category

Seeking the next Head of the National Network of Libraries of Medicine (NN/LM) at NLM

Tuesday, July 22nd, 2014

We are pleased to share with you the recruitment announcement for the next Head of the National Network of Libraries of Medicine,
commonly referred to as the national Network Office (NNO):

The Head of the National Network Office of the NN/LM serves as a national leader in developing collaborations among the varied types of libraries in the Network, including health sciences libraries, and academic and public institutions, to improve access to and the sharing of biomedical information resources.  The NNO Head is responsible for monitoring, evaluating, and advising on all aspects of providing biomedical information, for outreach to groups experiencing health disparities, and for providing access to medical information in national and international emergency and disaster situations.  The NNO Head advises on public health information policy issues, as related to programs conducted throughout the Network.   This is an exciting time for an incoming Head because plans for the 2016-2021 Regional Medical Library contracts are underway.

The very short posting time of July 22July 31 reflects the government’s effort to hire talented people quickly.  Please see the postings on USAJobs.gov and follow the instructions to apply.  One posting is for “Status Candidates” (Merit Promotion and VEOA Eligibles) and the other is for for “All US Citizens.”

The jobs will also be linked from “Careers @ NLM” on the NLM home page:  www.nlm.nih.gov.

In addition to an interesting, challenging work environment, NLM has a great location on the campus of the National Institutes of Health (NIH) in Bethesda, Maryland.  NIH is a short Metro ride from Washington, DC and a short walk from Bethesda’s thriving restaurant and retail district.  As a supervisory librarian at the GS15 level, the position has a salary range of $124,995-$157,100, and reports to the Associate Director for Library Operations, Joyce Backus.

If you have questions about this job, please contact Zenaida Olivero, PHR, (301) 435-5716, or Oliverozm@mail.nih.gov.

Dianne Babski

Deputy Associate Director of Library Operations
National Library of Medicine

Visualization Literacy

Friday, July 18th, 2014

With an increase of technology tools available for data reporting and visualization, sometimes it’s challenging to know how to best use them to clearly communicate the intended meaning of data. The concept of visualization literacy and a broader theme of visual literacy are often not included as part of the instructions guiding people in the steps to create their own visualization design.

A recent entry by Andrew Kirk on the blog of Seeing Data, a research project in the United Kingdom studying how people understand big data visualizations shown in the media, offers a great review of 8 Articles Discussing Visual and Visualization Literacy that are freely available and well worth a read to better understand both visual and visualization literacy. Their featured articles include resources ranging from the importance of Visual Literacy in an Age of Data to How to Be an Educated Consumer of Infographics, and Seeing Data has asked that you share additional ones with them via blog comments or their Twitter social media account @SeeingData.

Evidence-Based Practices ALA Discussion Group Summary

Friday, July 11th, 2014

Follow the link to read the summary of the 2014 ALA Annual Evidence Based Practices Discussion Group summary of presentations and discussion. Thank you to everyone who came to the discussion. It was very interesting: http://connect.ala.org/node/226376

Data Burger: A Good Questionnaire Response Rate Plus Basic Quantitative Data Analysis (Boost Box session)

Thursday, July 3rd, 2014

MAR offers 1 MLA Continuing Education (CE) credit per session—details will be provided at the end of the session.

Presenter:     Nikki Dettmar, Evaluation Librarian, NN/LM Outreach Evaluation Resource Center

Date / Time: Thursday, July 22, 2014 / Noon – 1 pm (ET)

Where:            Online / No Registration Required

Summary: Many of us use questionnaires to learn about our stakeholders’ attitudes and knowledge. Let’s picture this as a burger: The data we collect is like the meat in the filling, and we wrap the data in a tasty bun (summaries, graphs, and charts) to present it.

Meat: We want to use the best ingredients for our filling and collect good data. The question “What is a ‘good’ response rate?” often comes up. What does “response rate” mean, and why is it important? And how do you know what your response rate is? We’ll go over practical steps you can take to increase the number of people who complete and return the questionnaires that you send to them. We’ll also talk about some strategies for addressing low response rates.

Bun: Once you have administered a questionnaire, what do you do with all those numbers? The next section of this webinar will be about preparing and presenting those numbers. It will provide a very quick review of basic quantitative data analysis, including descriptive statistics and suggestions for selecting types of charts or graphs to illustrate your data.

Telling Training’s Story: The Success Case Method

Thursday, July 3rd, 2014

National Network of Libraries of Medicine

NN/LM Outreach Evaluation Resource Center

New OERC Blog posting! This is to let you know that a new OERC Blog article has become available. You can find this article online here. For simplicity’s sake, we’ve posted the article below:

Telling Training’s Story: The Success Case Method

“On the average, it is true that most training does not work very well. But some programs work very well with some of the people, and this represents their great potential for being leveraged for even greater results.” Robert O. Brinkerhoff, “Telling Training’s Story.”

Most evaluation methods for program training reduce data to averages: the average number of things learned by participants; the average number of techniques applied on the job; the average number of times a skill was used post-training. Unfortunately, this approach can underestimate the true value of training for the organizations investing in the programs.

In Telling Training’s Story, Brinkerhoff writes that, in reality, the majority of participants gain little from training programs.  They either use some information but get no results, or they simply give up after a few attempts. Sometimes poor instructional design is to blame. More often, low success is caused by contextual variables, such as lack of supervisory support, no opportunity to try out the learning, or program timing. In fact, good instructional design often cannot compensate for these environmental crosscurrents.

Yet, Brinkerhoff argues that most training programs can boast a few success cases. There are usually a handful of participants (sometimes more) who apply their new knowledge or skill to produce valuable results for their organizations.  Sometimes the value of their contributions justifies program cost. Or, if the percentage of success cases was boosted by just 10%, the investment would be worthwhile to the organization.

To truly evaluate a training program, you need to identify any positive outcomes that occur, even if they are traced to a small number of participants, and assess the value of those results. You also need to determine what instructional and contextual factors influence successful use of training information. Then, organizations can make informed decisions about continuing to invest in training.

Brinkerhoff’s Success Case Method (SCM) was designed for in-depth analysis of training programs and their outcomes. The method focuses on high and low success cases. High success cases refer to incidents where participants applied training program information and attained positive results for their organizations. Low success cases are situations in which participants demonstrated no application of the training information.

Investigation of the high-success cases identifies the best possible outcomes that occur when employees apply information gained from the training program. By adding low-success cases into the mix, the method also leads to a thorough understanding of key factors, both in training design and in the organizational context, that influence participants use of their new capabilities.

Brinkerhoff’s book Telling Training’s Story provides step-by-step guidance for conducting SCM studies. Steps include working with stakeholders to define success and value; developing a program impact model, using rigorous sampling methods; and testing rival hypotheses for your findings. By following these steps, you can present a case study with compelling evidence of your program’s value. If you find your program is ineffective, the process will illustrate the factors working against its success.

So, the next time you want to evaluate a training program, consider going beyond “average.”  Check out the Success Case Method.

Source: Brinkerhoff RO. Telling training’s story. San Francisco, CA: Berrett-Koehler Publishers; 2006.

National Library of Medicine Planning Blog

Friday, June 27th, 2014

The U.S. National Library of Medicine will soon be initiating development of its next long-range plan and, in so doing, welcomes public feedback through its recently-launched “Voyaging to the Future” blog, located at: http://nlmvoyagingtothefuture.org/
Thank you for your feedback, and for sharing this information with interested colleagues and friends.

Stephen J. Greenberg, MSLS, PhD
Coordinator of Public Services
History of Medicine Division
National Library of Medicine
National Institutes of Health
Department of Health and Human Services
Bethesda, MD
greenbes@mail.nih.gov

Freebie Friday: American Evaluation Association Online Public Library

Friday, June 27th, 2014

National Network of Libraries of Medicine

NN/LM Outreach Evaluation Resource Center

New OERC Blog posting! This is to let you know that a new OERC Blog article has become available. You can find this article online here. For simplicity’s sake, we’ve posted the article below:

As we at the Outreach Evaluation Resource Center (OERC) learn more about great evaluation resources available at an even better price (free!) in addition to our own freely available resources (http://guides.nnlm.gov/oerc/tools), we will feature some of them here for you to explore on ‘Freebie Friday’ as an occasional series.

To begin our coverage, did you know the American Evaluation Association (AEA) has an online public library of AEA conference presentations, assessment instruments (such as rubrics and logic models), and more available at http://comm.eval.org/communities/resources/libraryview/? The default library setting displays those files most recently updated in the online library and offers keyword searching, but I recommend going straight to the more advanced search functionality at http://comm.eval.org/communities/resources/searchlibrary/.

(more…)

NLM e-Clips (June 2014)

Friday, June 27th, 2014

ANNOUNCEMENTS

 

AIDSinfo and infoSIDAWeb Sites Now Optimized for Display on Mobile Devices

http://www.nlm.nih.gov/news/aidsinfo_optimized.html

 

Clinical Advisory: Randomized, Multi-Center, Phase III Study of Allogeneic Stem Cell Transplantation Comparing Regimen Intensity in Patients with Myelodysplastic Syndrome or Acute Myeloid Leukemia (BMT CTN 0901)

http://www.nlm.nih.gov/databases/alerts/2014_nhlbi_bmt_ctn.html

 

Daily MEDLINE/PubMed Updates

http://www.nlm.nih.gov/pubs/techbull/mj14/mj14_daily_medline_pubmed_updates.html

 

MLA 2014: NLM Theater Presentations

http://www.nlm.nih.gov/pubs/techbull/mj14/mj14_mla_theater_presentations.html

 

National Library of Medicine Announces 2014-2015 Associate Fellows

http://www.nlm.nih.gov/news/associates_2014_2015.html

 

NLM Announces Biomedical Informatics Course, in Partnership with Georgia Regents University

http://www.nlm.nih.gov/news/biocourse.html

 

NLM Issues Request for Information in Preparation for 2016-2021 Contract Award of the National Network of Libraries of Medicine (NN/LM)

http://www.nlm.nih.gov/news/nnlm_contract_2016_2021.html

 

NLM Mourns William G. Harless, PhD, Creator of the First Natural Language Computer Patient Simulation Model

http://www.nlm.nih.gov/news/william_harless_death.html

 

NLM VSAC Publishes Annual Update for 2014 Eligible Professional CQM Value Sets

http://www.nlm.nih.gov/news/cqm_value_sets.html

 

Terrence Sejnowski to Give the 2014 Joseph Leiter NLM/MLA Lecture, June 12, 2014

http://www.nlm.nih.gov/news/leiter_lecture_sejnowski.html

 

NLM DIRECTOR’S PODCASTS

 

Child Mental Health and Brain Development

http://www.nlm.nih.gov/medlineplus/podcast/transcript061614.html

 

Chronic Kidney Disease Mystery in Central America

http://www.nlm.nih.gov/medlineplus/podcast/transcript060214.html

 

Mammography Counseling Challenges

http://www.nlm.nih.gov/medlineplus/podcast/transcript051914.html

 

NIH MedlinePlus Magazine Spring 2014

http://www.nlm.nih.gov/medlineplus/podcast/transcript052714.html

 

NLM’s Past 30 Years and Future

http://www.nlm.nih.gov/medlineplus/podcast/transcript062314.html

 

Treating Prescription Opioid Overdose

http://www.nlm.nih.gov/medlineplus/podcast/transcript060914.html

 

NLM IN THE NEWS

 

Civil War exhibit on display at Gundersen [La Crosse, Wisconsin]

http://www.news8000.com/news/civil-war-traveling-exhibit-on-display-at-gundersen/26416912

 

Exhibit on Native health will open in Anchorage today

http://www.newsminer.com/features/health/exhibit-on-native-health-will-open-in-anchorage-today/article_f708ea04-efa5-11e3-b944-001a4bcf6878.html

 

Former Baylor center Isaiah Austin diagnosed with career-ending condition

http://tracking.si.com/2014/06/22/isaiah-austin-marfan-syndrome/

 

Greek Envoy Helps Plant ‘Hippocrates Tree’ at NIH

http://www.washdiplomat.com/PouchArticle/cms/index.php?option=com_content&view=article&id=193

 

How popular is the STEM degree?

http://techpageone.dell.com/industries2/education/how-popular-is-the-stem-degree/

 

Magic comes to campus: Laupus Library [Greenville, NC] brings in Harry Potter exhibit

http://theeastcarolinian.com/?p=33661

 

Making drug information smart and open

http://developmentseed.org/blog/2014/05/23/pillbox-launches-on-github/

 

National Library of Medicine Announces 2014-2015 Associate Fellows

http://technews.tmcnet.com/news/2014/06/20/7886468.htm

 

National Library of Medicine: Past, Present, and Future

http://informaticsprofessor.blogspot.com/2014/06/national-library-of-medicine-past.html

 

“Native Voices” Exhibit in Anchorage, Available on iTunes

http://kdlg.org/post/native-voices-exhibit-anchorage-available-itunes

 

“Native Voices” Traveling Exhibition Visits Anchorage

http://www.scf.cc/newsletter/2014MayJunANN.pdf

 

Open digital signage journal gains users

http://opensource.com/life/14/6/open-digital-science-journal-gains-users

 

Traveling exhibition explores Native peoples’ concepts of health and illness

http://thearcticsounder.com/article/1424traveling_exhibition_explores_native_peoples

 

Visiting Exhibit Explores Link Between Traditional, Modern Medicine

http://www.ktuu.com/news/news/visiting-exhibit-explores-link-between-traditional-modern-medicine/26428782

 

NEW IN NLM IN FOCUS

 

A Close Look at Openi

http://infocus.nlm.nih.gov/2014/05/a-close-look-at-openil.html

 

NLM Honored at Medical Library Association Meeting: NLM Resource Updates Available Online

http://infocus.nlm.nih.gov/2014/06/nlm-at-mla-14-medical-library.html

 

Regional Medical Libraries Making a Difference: Focus on MidContinental Region

http://infocus.nlm.nih.gov/2014/05/regional-medical-libraries-mak-3.html

 

Training Future Leaders in Informatics Research

http://infocus.nlm.nih.gov/2014/05/training-future-leaders-in-inf.html

 

NEW OR UPDATED MEDLINEPLUS TOPICS AND FEATURES

 

Agrandamiento de la próstata

http://www.nlm.nih.gov/medlineplus/spanish/enlargedprostatebph.html

 

Enlarged Prostate (BPH)

http://www.nlm.nih.gov/medlineplus/enlargedprostatebph.html

Copyright Issues

Saturday, June 14th, 2014

https://www.coursera.org/#course/cfel

Kevin Smith, the scholarly communication officer and copyright expert at Duke University and two colleagues are organizing a four-week MOOC on the basics of copyright.  Course is aimed at librarians and K-12 educators and offered on the Coursera platform.  Sounds like a great, free opportunity to learn from one of the best.  Let me know if there is any interest in doing this in a group.

Is it in the Public Domain?

The Samuelson Law Clinic at the University of California, Berkeley, has released a very cool handbook/set of visual tools to help researchers determine whether a work is still under copyright.  Article:  http://www.law.berkeley.edu/17178.htm

Handbook and Visuals:  http://www.law.berkeley.edu/files/Final_PublicDomain_Handbook.pdf

New OERC Posting

Saturday, June 14th, 2014

National Network of Libraries of Medicine

NN/LM Outreach Evaluation Resource Center

 

New OERC Blog posting! This is to let you know that a new OERC Blog article has become available. You can find this article online here. For simplicity’s sake, we’ve posted the article below:

SlideDocs help you create readable reports

Thanks to evolving Internet and mobile technology, most of us now prefer our information presented in tapas-sized quantities, preferably in a visually appealing way. This preference is having an impact on our business communication. Before our eyes, bullet points on PowerPoint slides are gradually giving away to engaging visuals. Infographics are replacing text-dense brochures and executive summaries.

Nancy Duarte, who is motivating  the world to clean up its PowerPoint presentations, is venturing into a new frontier: Written reports. She suggests creating reports using presentation software like PowerPoint, which is more amenable to manipulating layouts. The idea is to present one idea per slide, incorporating visuals, text and much-appreciated white space.

Duarte calls this type of report a SlideDoc and offers a free tutorial on how to create one (presented in, you guessed it, a PowerPoint document). The site includes downloadable templates to help you create your own SlideDoc report. You also can find Duarte’s Diagrammer here, which I wrote about in a previous post.  I believe, at this point, that I should state explicitly that I do not own stock in her company. I just love her approach to presenting ideas and I think evaluation reports would be read and heard by more people if we all started using her guidelines.

As someone who wants to stop producing coma-inducing reports, I have tried my hand at creating more engaging layouts using Microsoft Word. What I learned is this: Take your anticipated timeline for report-writing and double it. Word does not lend itself to interesting layouts, so inserting pictures, graphs, and call-out quotes is like putting shoes on a toddler. You can do it, but it’s probably going to make you late.

Consequently, my results have been underwhelming.

So I‘m excited to try SlideDocs. I already can see how much more flexible PowerPoint will be for arranging text, images, and graphs. I won’t be wasting time adjusting margins and re-positioning graphs that always seem to wander around in Word documents. I also like that I don’t have to learn a new software application, nor do I have to get my audience to download a special reader to view my reports.

Just remember: Shorter isn’t easier when it comes to reports. These “to-the-point” SlideDocs require that you know both your findings and your audience extremely well so you can communicate the most important information in the most succinct way. SlideDocs will help with the layout, but you still have to do the thinking.