Archive for the ‘Communications Tools’ Category
Recently the Public Library Association (PLA) initiated a service called Project Outcome. An article entitled “Project Outcome – Looking Back, Looking Forward” by Carolyn Anthony, director of the Skokie Public Library, IL, was recently published in Public Libraries Online that describes the successes of libraries using this service over the past six months.
Project Outcome is an online resource that provides evaluation tools that are designed to measure the impact of library programs and services, such as summer reading programs or career development programming. It also provides ready-made reports and data dashboards that can be used to give libraries and stakeholders immediate data on their programs’ outcomes. And Project Outcome provides support and peer sharing opportunities to address common challenges and increase capacity for outcomes evaluation.
Following are some highlights about this service:
- Project Outcome has managed to create a structured approach for program outcome evaluation that can be used online by public libraries of all shapes and sizes, by people who have not done outcome evaluation before. Along with tools for collecting data, the resource has tutorials and support for libraries doing outcomes evaluation for the first time.
- Continued support and peer sharing as an integral part of the service means that PLA is building a community of librarians who use outcome evaluation.
- The stories that are shared by the peers as described in the article will increase the understanding that evaluation isn’t something forced on you from outside, but can be something that helps you to create a better library and enhance the meaning of your library’s programs.
- This process teaches librarians to start with the evaluation question (“decide what you want to learn about outcomes in your community”) and a plan for what to do with the findings. And the process ends with successfully communicating your findings to stakeholders and implementing next steps.
- Lastly, Project Outcome and the PLA Performance Measurement Task Force are planning the next iteration of their project that will measure whether program participants followed through with their intended outcomes.
The HHS Office of the Assistant Secretary for Preparedness and Response recently kicked off the My Preparedness Story: Staying Healthy and Resilient Video Challenge. The contest invites young people between the ages of 14 and 23 to submit a creative video, up to 60 seconds long and closed-captioned, showing how they help their families, friends, and community protect their health during disasters and every day. Completed videos should be uploaded to YouTube, and the link, along with a description and transcript of the video, should be provided through the “Submit Solutions” form. The entries will be evaluated by a panel of expert judges and the top entries will be posted on the web site for public voting. Submissions could be used to help others learn better ways to prepare their communities for disasters and emergencies, and contestants could win up to a $2,000 grand prize. Entries are due by March 28, 2016, at 8:00 p.m. PDT. Winners will be notified and announced no later than May 9.
Join members of the National Library of Medicine Training Center for three quick online presentations related to teaching topics. Jessi Van Der Volgen will discuss tips and tools for creating video tutorials. Cheryl Rowan will talk about including audience culture and diversity in your training sessions and Rebecca Brown will demonstrate how to integrate Zaption into your online training to add interactive opportunities to videos. Register now for this one-hour session on Friday, February 19, at 10:00 AM PST!
The National Institutes of Health (NIH) has just released the NIH-Wide Strategic Plan, Fiscal Years 2016–2020: Turning Discovery Into Health, which will ensure the agency remains well positioned to capitalize on new opportunities for scientific exploration and address new challenges for human health. Developed after hearing from hundreds of stakeholders and scientific advisers, and in collaboration with leadership and staff of NIH’s Institutes, Centers, and Offices (ICOs), the plan is designed to complement the ICOs’ individual strategic plans that are aligned with their congressionally mandated missions.
The plan focuses on four essential, interdependent objectives that will help guide NIH’s priorities over the next five years as it pursues its mission of seeking fundamental knowledge about the nature and behavior of living systems and applying that knowledge to enhance health, lengthen life, and reduce illness and disability. The objectives are to:
- advance opportunities in biomedical research in fundamental science, treatment and cures, and health promotion and disease prevention;
- foster innovation by setting NIH priorities to enhance nimbleness, consider burden of disease and value of permanently eradicating a disease, and advance research opportunities presented by rare diseases;
- enhance scientific stewardship by recruiting and retaining an outstanding biomedical research workforce, enhancing workforce diversity and impact through partnerships, ensuring rigor and reproducibility, optimizing approaches to inform funding decisions, encouraging innovation, and engaging in proactive risk management practices; and
- excel as a federal science agency by managing for results by developing the “science of science,” balancing outputs with outcomes, conducting workforce analyses, continually reviewing peer review, evaluating steps to enhance rigor and reproducibility, reducing administrative burden, and tracking effectiveness of risk management in decision making.
To inform development of the strategic plan, NIH solicited input from a wide range of stakeholders through a Request for Information, which generated more than 450 responses; a series of interactive webinars, which attracted more than 750 participants; and meetings with 21 NIH advisory councils, including the Advisory Committee to the NIH Director. The plan concludes with a bold vision for NIH, listing some specific achievements and advances that the agency will strive to deliver over the next five years.
The National Library of Medicine (NLM) Value Set Authority Center (VSAC) has just launched VSAC Collaboration; a tool to support communication, knowledge management and document management by value set authors and stewards. VSAC Collaboration provides a central site where value set authors can post value sets for collaborative discussion. In that site, teams can share threaded discussions about the value sets, view recent value set expansions posted by site members, organize their value sets by usage and by team’s workflow needs, and receive activity and change notifications from VSAC.
VSAC Collaboration Tool training webinars and slides are available. Access to the VSAC and to the VSAC Collaboration Tool requires a free Unified Medical Language System® Metathesaurus License.
We’re all trying to find ways to improve evaluation of our social media efforts. It’s fun to count the number of retweets and “likes.” But are these numbers meaningful? A recent program at the American Evaluation Association Conference in Chicago, “Do Likes Save Lives? Measuring What Really Matters in Social Media and Digital Advocacy Efforts,” presented by Lisa Hilt and Rebecca Perlmutter of Oxfam, provided a presentation designed to build knowledge and skills in planning and measuring social media strategies, setting digital objectives, selecting meaningful indicators and choosing the right tools and approaches for analyzing social media data. The presenters did not want to rely solely on what they called “vanity metrics,” for example the number of “impressions” or “likes.” Alone these metrics show very little actual engagement with the information. Instead they chose to focus on specific social media objectives based on their overall digital strategy.
Develop a digital strategy:
- Connect the overall digital strategy to campaign objectives: (for example: To influence a concrete change in policy, or to change the debate on a particular issue.)
Develop social media objectives:
- You want people to be exposed to your message.
- Then you want people to engage with it (for example, sharing your message) or make them work with it (for example: sign an online petition after reading it.)
Collect specific information based on objectives:
- Collect data about social media engagement supporting your objectives that can be measured (for example “the Oxfam Twitter campaign drove 15% of the readers to signing its petition” vs. “we got 1500 likes”.)
The presenters suggested some types of more meaningful metrics:
- On Twitter you can look at the number of profiles who take the action you want them to take, and then the number of tweets or retweets about your topic.
- For Facebook, the number of likes, shares and comments mean that your audience was definitely exposed to your message.
- Changes in the rate of likes or follows (for example if you normally get 5 new followers to your fan page a week, but due to a particular campaign strategy, you suddenly started getting 50 new followers a week.)
- Number of “influential” supporters.
- Qualitative analysis: Consider analyzing comments on Facebook posts, or conversation around a hashtag in Twitter.
Overall, the goal is to have a plan for how you would like to see people interact with your messages in relation to your overall organizational and digital strategies, and find metrics to see if your plan worked.
NIH-supported scientists have made over 300,000 author manuscripts available on PubMedCentral (PMC) since 2008. Now, NIH is making these papers accessible to the public in a format that will allow robust text analyses. You can download the entire PMC collection of NIH-supported author manuscripts as a package in either XML or plain text formats. The collection will encompass all NIH manuscripts posted to PMC since July 2008. While the public can access the articles’ full text and accompanying figures, tables, and multimedia on the PMC website, the newly available article packages include full-text only, in a form that facilitates text-mining. This resource was developed to increase the impact of NIH funding. Through this collection, scientists will be able to analyze these manuscripts, further apply the findings of NIH research, and generate new discoveries. For more information visit the PMC author manuscript collection web site.
Data visualization expert Stephen Few explained the problem with pie charts during this interview with the New York Times: “When looking at parts of a whole, the primary task is to rank them to see the relative performance of the parts. That can’t be done easily when relying on angles formed by a slice.” An article by American Evaluation Association’s president-elect John Gargani argues for retirement of the venerable pie chart. He make points that are repeated in many anti-pie chart blog posts. On the other hand, this post by Bruce Gabrielle of Speaking PowerPoint describes situations where pie charts can shine.
In general, most experts believe that the times and places to use pie charts are few and far between. If you have found one of those rare times, then here’s a post at Better Evaluation with design tips to follow. And for humorous examples of what not to do, check out Michael Friendly’s Evil Pies blog!
A data party is another name for a kind of participatory data analysis, where stakeholders are gathered together to help analyze data that you have collected. Here are some reasons to include stakeholders in the data analysis stage:
- It allows stakeholders to get to know and engage with the data.
- Stakeholders may bring context to the data that will help explain some of the results.
- When stakeholders participate in analyzing the data, they are more likely to understand and use it.
- Watching their interactions often reveals the person with the power to act on your recommendations.
To begin the process, you need to know what you hope to gain from the attendees, since you may only be able to hold an event like this one time. There are a number of different ways to organize the event, such as the World Cafe format, where everyone works together to explore a set of questions, or an Open Space system in which attendees create their own agenda about which questions they want to discuss. Recently the American Evaluation Association held a very successful online unconference using MIT’s Unhangout, an approach that could be used for an online data party with people from multiple locations.
Here are suggested questions to ask at a data party:
- What does this data tell you?
- How does this align with your expectations?
- What do you think is occurring here and why?
- What other information do you need to make this actionable?
At the end of the party it might be time to present some of your findings and recommendations. Considering the work that they have done, stakeholders may be more willing to listen, since people often tend to support what they helped to create.
The Medical Library Association’s October 28 continuing education webinar, Data Visualization Skills and Tools for Librarians, was presented by Lisa Federer, Research Data Informationist at the NIH Library. The session provided information on different aspects of data visualization, including information about elements of design, such as color, line, and contrast. Lisa has also created the LibGuide Creating Infographics with Inkscape, which contains the resources for a class she taught with NIH Informationist Chris Belter. The LibGuide includes a Power Point presentation from the lecture part of the class. The slides cover design principles and design elements with links to resources such as Vischeck, a tool for finding out how colors in a chart appear to someone who is color blind, and The 10 Commandments of Typography, with suggestions for choosing font combinations that work well.
The second part of the class is a hands-on section for using Inkscape, a free, open-source graphics program, to make infographics. Inkscape allows you to use “vector graphics” to design infographics. Vector graphics are useful for image design, since they are based on pathways defined by mathematical expressions like lines, curves, and triangles, allowing images to get larger and smaller without losing any quality. If this sounds hard to do, there are Inkscape tutorials available to help. Other vector graphics editors are available, such as Apache OpenOffice Draw, a free service, or Adobe Illustrator. Comparisons with links to detailed information are available in Wikipedia’s “Comparison of Vector Graphics Editors.”