Skip all navigation and go to page content
NN/LM Home About PSR | Contact PSR | Feedback |Site Map | Help | Bookmark and Share

Archive for the ‘Non-NLM Resources’ Category

Evaluating Social Media Activities

For public sector and nonprofit organizations, social media can be a cost effective way to engage with users and supporters. However, social media is not without its cost, particularly in terms of staff time. So organizations have an interest in assessing the value of their social media activities.

One great resource for social media evaluation is Paine’s book, Measure What Matters. The book contains detailed guidance for evaluating social media use by different types of organizations. A great supplement to Paine’s book is The Nonprofit Social Media Decision Guide, by Idealware, which has worksheets that will help plan social media strategies and implement recommendations in Measure What Matters.

Below are the key elements of Paine’s evaluation framework:

  • Begin with a solid social media plan that identifies specific goals and objectives. As with any project, you need a plan for social media that links strategies to the organizational mission and includes objectives with targets and key performance indicators. Objectives for social media in the public sector often belong in one of two categories: helping users find information they need; or building user awareness, engagement, or loyalty. (The Nonprofit Social Media Decision Guide provides a list of potential objectives on page 52.)
  • Define your target audience: Organizations often have many stakeholder groups, so it’s important to identify the groups most attuned to social media. On page 54 of The Nonprofit Social Media Decision Guide, there is a worksheet for narrowing down stakeholder audiences to those most receptive to social media activities.
  • Pick your metrics: Metrics such as views, followers, and measures of engagement with online content will help monitor your reach. Conversions, defined as the actions you want your social media followers to complete, might include becoming members of your organization or actively recommending your organization to colleagues or friends.
  • Identify a source for benchmarks. Benchmarks provide a basis for comparison to assess progress. Organizations often use their own histories as benchmarks, comparing progress against baseline measures. You also may have access to data from a competing or peer organization that you can use for comparison.
  • Pick a measurement tool: Paine’s book describes different measurement methods for evaluating social media, such as content analysis, web analytics, or surveys.

For more information, check out the resources mentioned in this blog post:

  • Katie Delahaye Paine, Measure What Matters: Online Tools For Understanding Customers, Social Media, Engagement, and Key Relationships. Hoboken, NJ: John Wiley & Sons, Inc, 2011.
  • Idealware. The Nonprofit Social Media Decision Guide, 2013.

Presentation & Identification of E-Journals (PIE-J): Request for Feedback

The National Library of Medicine (NLM) has a deep interest in the publishing models used by scientific journals, from the viewpoints of practical and efficient use of titles that are indexed for MEDLINE, and the clear and accurate preservation of the scientific literature for use by future generations. Now you have the opportunity to participate in the development of a National Information Standards Organization (NISO) Recommended Practice that provides guidance on the presentation and identification of electronic journals!

PIE-J: The Presentation & Identification of E-Journals, a NISO (National Information Standards Organization) Recommended Practice, was published just over a year ago, having been approved on March 25, 2013. In just over 12 months, the full Recommended Practice document has received well over 4500 downloads, while two PIE-J brochures have received a total of more than 2000 downloads. All three documents can be accessed from the PIE-J website. This level of download activity suggests that PIE-J is meeting a need, and it is essential that librarians, publishers, and other e-journal providers be aware of its existence. The PIE-J Standing Committee, co-chaired by Sally Glasser (Hofstra University) and Ed Cilurso (Taylor & Francis), is charged with responding to specific questions about the Recommended Practice, gathering comments for a full review of the Recommended Practice document, and promoting PIE-J.

If you have written to publishers or providers about PIE-J, the Standing Committee would like to hear from you, whether the result was positive or negative. Likewise, the Committee would greatly appreciate hearing from publishers and providers who have made changes to their websites based on PIE-J and user feedback, intend to make changes based on PIE-J during a future website redesign, or feel that the recommended practices are not feasible. Please write the Committee with the subject “PIE-J feedback.” Standing Committee members have been busy making the rounds at various conferences and meetings. Next up are NASIG (May 1-4, Fort Worth, TX), the Society of Scholarly Publishers (SSP) conference (May 28-30, Boston), and ALA Annual (June 28-July 1, Las Vegas). If you plan to attend any of these conferences, please look out for NISO’s PIE-J presentations! Also, on Monday, May 12, 2014, at 12 PM PDT co-chairs Sally Glasser and Ed Cilurso will be speaking about PIE-J at NISO’s monthly Open Teleconference.

The Standing Committee recently posted a template to the PIE-J website for librarians wishing to contact publishers and providers with concerns about the presentation of e-journals on their websites. The template includes suggested wording but is completely customizable. If you (or your users) have experienced an access or display issue that is due to the way in which e-journals are presented online, use the template to let publishers and providers know how PIE-J can help. Regina Reynolds, who was on the original PIE-J Working Group and has continued on the Standing Committee, recently published the freely accessible article, “PIE-J: Presentation and Identification of E-Journals: What’s the Point?” in Insights: the UKSG Journal, vol. 26, no. 3 (Nov. 2013). The article provides an excellent overview of PIE-J.

NLM and Wellcome Library Establish Agreement to Make 150 Years of Biomedical Journals Freely Available Online!

Representatives of the US National Library of Medicine (NLM) and the Wellcome Trust recently signed a memorandum of understanding to work together to make thousands of complete back issues of historically-significant biomedical journals freely available online. The terms of the MOU include a donation of £750,000 ($1.2 million) to the NLM that will support coordination of the three-year project to scan original materials from NLM’s collection at the article level, and Wellcome’s work to secure copyright clearances and permissions for electronic deposit from publishers. NLM will undertake conservation of the original material to ensure its preservation for future generations. Key journals charting the development of modern medicine over the last 150 years will be digitized in their entirety and made available on the National Institutes of Health life sciences repository PubMed Central (PMC) and its European counterpart, Europe PMC. The project builds on the Medical Journal Backfiles Digitization Project (2004-2010) and will contribute substantially to the current PMC archive of over 3 million articles from medical journals.

Part of the project will concentrate on mental health journals, supporting a major archive digitization program also being undertaken by the Wellcome Trust. Journals to be digitized include Mental Health, Mental Hygiene, and the Journal of Psychological Medicine and Mental Pathology. Other journals have been selected for their general relevance, such as the Indian Medical Gazette, the British and Foreign Medico-Chirurgical Review and the Transactions of the Epidemiology Society of London. In addition to images and searchable text, NLM will also create article-level citations for PubMed. Digitization is expected to start in late 2014 and to be completed by 2017. Material will be added to PMC and Europe PMC as it is digitized.

The Wellcome Library is one of the world’s leading libraries of medical history, housing 2.5 million items of extraordinary range and diversity, and a growing collection of contemporary biomedical information resources relating to consumer health, popular science, biomedical ethics and the public understanding of science. The Wellcome Library is part of the Wellcome Trust, a global charitable foundation dedicated to achieving extraordinary improvements in human and animal health. It supports the brightest minds in biomedical research and the medical humanities. The Trust’s breadth of support includes public engagement, education and the application of research to improve health. It is independent of both political and commercial interests.

New SurveyMonkey Mobile App Available!

SurveyMonkey recently launched a mobile app for the iPad and iPhone, providing the ability to create, send, and monitor surveys from a phone or tablet device. The app is free, although you need a SurveyMonkey account to use it. With the new app, there’s no longer a need to rely on a computer to design and manage surveys. The app also allows convenient viewing of data from any location with Internet access. Another notable benefit is that the analytic reports are optimized for mobile devices and are easy to read on small screens. Although there is not yet an Android app, all SurveyMonkey pages and surveys are optimized for any mobile device, so surveys are easy to take regardless of the operating system used.

NLM Value Set Authority Center Publishes Annual Update for 2014

The National Library of Medicine (NLM) Value Set Authority Center (VSAC), in collaboration with the Office of the National Coordinator for Health Information Technology (ONC) and Centers for Medicare & Medicaid Services (CMS), has published the annual update for the 2014 Eligible Hospital Clinical Quality Measure (CQM) Value Sets. The update includes revised value sets to address deleted and remapped codes in the latest terminology versions, as well as new codes for addressing CQM logic corrections and clarifications. The Centers for Medicare & Medicaid Services (CMS) updates these electronic reporting specifications annually to ensure that the specifications align with current clinical guidelines and terminologies, and that they remain relevant and actionable within the clinical care setting.

The VSAC offers a Downloadable Resource Table, accessible from the Download tab on the VSAC Web page, that provides prepackaged downloads for the most recently updated and released 2014 CQM Value Sets, as well as for previously released versions. Access to the Value Set Authority Center requires a free Unified Medical Language System® Metathesaurus License. NLM also provides the Data Element Catalog that identifies data element names (value set names) required for capture in electronic health record technology certified under the 2014 Edition of the ONC Standards and Certification Criteria. The NLM update of the VSAC coincides with the CMS posting of the official updated 2014 Eligible Hospital Clinical Quality Measures (eCQMs).

The following additional resources are available to help health care providers and vendors navigate the 2014 CQMs:

Maximizing Questionnaire Response Rates

The American Medical Association has specific recommendations for its authors about questionnaire response rates included in the JAMA Instructions for Authors. One of the guidelines is that survey studies should have sufficient response rates (generally at least 60%) and appropriate characterization of nonresponders to ensure that nonresponse bias does not threaten the validity of the findings. However, response rates to questionnaires have been declining over the past 20 years, as reported by the Pew Research Center in The Problem of Declining Response Rates. Fortunately, suggestions about increasing questionnaire response rates are available in two recent AEA365 blog posts that are open access:

Additional useful advice, such as making questionnaires short, personalizing your mailings, and sending full reminder packs to nonrespondents, is included in this open access article: Sahlqvist S, et al., “Effect of questionnaire length, personalisation and reminder type on response rate to a complex postal survey: randomised controlled trial.” BMC Medical Research Methodology 2011, 11:62.

Free Images for Evaluation Reports!

The current trend in evaluation reporting is toward fewer words and more images. There are a number of companies that offer high-quality, royalty free photographs at minimal cost. Stockfresh, for example, charges as little as $1 per image. However, no-cost is even better than low-cost. Freelancers Union, a nonprofit organization dedicated to assisting freelance workers, recently published a list of the best websites for no-cost images. If you are looking for free images for your presentations or reports, check out their article, which also describes the difference between public domain, royalty-free and Creative Commons-licensed images.

Exhibit evaluations with QuickTapSurvey

Exhibiting is a popular strategy for health information resource promotion, but exhibits can be challenging events to evaluate. Survey platforms for tablets and mobile phones can make it a little easier to collect feedback at exhibit booths. The NN/LM Outreach Evaluation Resource Center (OERC) has explored QuickTapSurvey, which seems well-suited to getting point-of-contact responses from booth visitors. The application allows creation of short, touch-screen questionnaires on Apple or Android tablets. You simply hand the tablet to visitors for their quick replies. The same questionnaire can be put on multiple tablets, so you and your colleagues can collect responses simultaneously during an exhibit.

When you have an Internet connection, responses are automatically uploaded into your online QuickTapSurvey account. When no connection is available, data are stored on the tablet and uploaded later. You can use QuickTapSurvey’s analytics to summarize responses with statistics and graphs, and can also download the data into a spreadsheet to analyze in Excel. QuickTapSurvey is a commercial product, but there is a limited free version. The application is fairly user friendly, but it may be worthwhile to experiment with it before taking it on the road. Further information about QuickTapSurvey, including the different pricing options, is available on the web site.

A Tip-a-Day by and for Evaluators: The American Evaluation Association (AEA) 365 Blog!

Do you want to know more about great assessment resources, tools, and lessons learned from others with an interest in evaluation? Check out the American Evaluation Association (AEA) 365 blog, where anyone (not only AEA members) can subscribe via email or really simple syndication (RSS) feed. The established blog guidelines place a cap on contributions with a maximum of 450 words per entry. You will know at a glance what the subject is (Hot Tips, Cool Tricks, Rad Resources, or Lessons Learned) from the headers used within the entries, and all assumptions of prior knowledge and experience with evaluation and organizations are avoided, with clarification of all acronyms and no jargon allowed.

A handy tip is to scroll down the right sidebar of the website to locate subjects arranged by the AEA Topical Interest Groups (TIGs). Some of these that are likely to be of interest to National Network of Libraries of Medicine (NN/LM) members are Data Visualization and Reporting, Disabilities and Other Vulnerable Populations, Health Evaluation, Integrating Technology into Evaluation, and Nonprofits and Foundations Evaluation. Examples of recent items of potential interest include Conducting a Health Needs Assessment of People With Disabilities, with shared lessons learned from the needs assessment work done in Massachusetts, and the “rad resource” of Disability and Health Data System (DHDS), with state-level disability health data available from the Centers for Disease Prevention and Control (CDC).

JGIM Commentary Calls on Physicians to Advance Health Literate Organizations

The Journal of General Internal Medicine published a commentary this month, “Physicians’ Roles in Creating Health Literate Organizations: A Call to Action,” that gives physicians guidance on their role in implementing health literate health care organizations. Physicians’ responsibilities to address health literacy are not restricted to improving the clinical encounter, declared authors Cindy Brach, Benard Dreyer, and Dean Schillinger. For health care organizations to become health literate, physicians must also be willing to serve as health literacy champions.

The authors detail actions physicians can take to implement each of the Ten Attributes of Health Literate Health Care Organizations, as described in an Institute of Medicine discussion paper by Brach, et al, published in 2012. The article also points readers to the Health Literacy Universal Precautions Toolkit to help physicians lead their practices in implementing health literacy universal precautions.