Archive for the ‘Evaluation’ Category
New Report from RLUK “Re-skilling for Research” Looks at Changing Needs of Researchers and Effects on Libraries: http://www.infodocket.com/2012/02/01/new-report-from-rluk-re-skilling-for-research-looks-at-changing-needs-of-researchers/
New OERC Blog posting! This is to let you know that a new OERC Blog article has become available. You can find this article online here. For simplicity’s sake, we’ve posted the article below:
The OERC will be attending the Library Assessment Conference at University of Washington this week, where we will be learning about new trends in library assessment, evaluation, and improvement. Stayed tuned to our blog and we will pass along what we learn. The LAC is sponsored by the Association of Research Libraries.
In the meantime, I want to leave you with a fun data visualization site to explore while we’re gone. David McCandless creates wonderful infographics for his site “Information is Beautiful.” Many are health-related. All are gorgeous. You can find the list of data visualizations here.
- Joanne Gard Marshall, Distinguished Research Professor, School of Information and Library Science, University of North Carolina at Chapel Hill
- Julia Sollenberger, Associate Vice President and Director, Medical Center Libraries and Technologies, University of Rochester Medical Center
Date / Time: Tuesday, August 12, 2014 / Noon – 1 pm (ET)
Online / No Registration Required
Summary: The speakers will present the results of the Value Study the most useful for library advocacy and discuss how results are being used by librarians across the country. Over 16,000 physicians, residents and nurses served by 56 libraries participated in the study. As a result, the findings can be used by both participating and non-participating libraries.
Librarians are using the results to advocate for the importance of the library through posters, presentations, newsletters and personal contacts with administrators, educators and clinicians. Time saved by health professionals is also being also converted into dollars saved to show cost-effectiveness. Our examples show that librarians are using the results, but customizing their advocacy efforts so that they have maximum impact on their institution.
Librarians are making frequent use of the resources available on the Value Study website: http://nnlm.gov/mar/about/value.html, containing an overview of the study results suitable for presentation. Librarians are welcome to use the full presentation or key slides as needed. Specialized PowerPoint summary reports are also available based on geographic region, as well as AAHSL and non-AAHSL sites, and the profession of respondents. The site provides access to the data and all supporting materials, including the survey. Features encourage data use, benchmarking with similar types of libraries, as well as study replication. Links to peer reviewed journal articles based on the study results are also available on the site. Two new publications, one in a nursing journal and one in a health care management journal are about to appear. Results from these additional analyses will be discussed.
Big Data: Seizing Opportunities, Preserving Values.
Report produced in 2014 by the Executive Office of the President, Washington, DC.
A White House report on big data released May 1 concludes that the explosion of data in today’s world can be an unprecedented driver of social progress, but it also has the potential to eclipse basic civil rights and privacy protections. The report drew praise from business and technology groups for its grasp of how big data analytics could improve education and healthcare, uncover wasteful government spending, and help with the nation’s continuing economic recovery. But those same groups cautioned that government attempts to regulate data collection could interfere with productivity and job growth.
Frontiers in Massive Data Analysis.
Report produced in 2013 by the National Research Council, Washington, DC. Board on Mathematical Sciences.
Experiments, observations, and numerical simulations in many areas of science and business are currently generating terabytes of data, and in some cases are on the verge of generating petabytes and beyond. Analyses of the information contained in these data sets have already led to major breakthroughs in fields ranging from genomics to astronomy and high-energy physics and to the development of new information-based industries. Traditional methods of analysis have been based largely on the assumption that analysts can work with data within the confines of their own computing environment, but the growth of big data is changing that paradigm, especially in cases in which massive amounts of data are distributed across locations. While the scientific community and the defense enterprise have long been leaders in generating and using large data sets, the emergence of e-commerce and massive search engines has led other sectors to confront the challenges of massive data.
Data Mining Meets HCI: Making Sense of Large Graphs.
Report produced in 2012 by Carnegie Mellon Univ., Pittsburgh, PA. Machine Learning Department.
We have entered the age of big data. Massive datasets are now common in science, government and enterprises. Yet, making sense of these data remains a fundamental challenge. Where do we start our analysis. Where to go next. How to visualize our findings. We answers these questions by bridging Data Mining and Human-Computer Interaction (HCI) to create tools for making sense of graphs with billions of nodes and edges, focusing on (1) Attention Routing: we introduce this idea, based on anomaly detection, that automatically draws people’s attention to interesting areas of the graph to start their analyses. We present three examples Polonium unearths malware from 37 billion machine- file relationships NetProbe fingers bad guys who commit auction fraud. (2) Mixed-Initiative Sensemaking: we present two examples that combine machine inference and visualization to help users locate next areas of interest: Apolo guides users to explore large graphs by learning from few examples of user interest; Graphite finds interesting subgraphs, based on only fuzzy descriptions drawn graphically. (3) Scaling Up: we show how to enable interactive analytics of large graphs by leveraging Hadoop, staging of operations, and approximate computation. This thesis contributes to data mining, HCI, and importantly their intersection, including: interactive systems and algorithms that scale theories that unify graph mining approaches; and paradigms that overcome fundamental challenges in visual analytics. Our work is making impact to academia and society: Polonium protects 120 million people worldwide from malware; NetProbe made headlines on CNN, WSJ and USA Today; Pegasus won an open source software award; Apolo helps DARPA detect insider threats and prevent exfiltration. We hope our Big Data Mantra ‘Machine for Attention Routing Human for Interaction’ will inspire more innovations at the crossroad of data mining and HCI.
Do you want to learn more about outcomes-based planning and evaluation (OBPE) for your outreach project but there’s no money in the training budget to do so?
Shaping Outcomes: Making a Difference in Libraries and Museums (shapingoutcomes.org) is available as a free online course that learners can start anytime and work on at their own self-navigated pace. While there are library and museum-specific examples provided in the course the concepts of learning more about target audience needs, how to clarify desired results, developing logic models and evaluating outcomes are applicable for most other organizations’ outreach projects as well.
Modules of the class are broken into five sections (Overview, Plan, Build, Evaluate, Report) with a helpful Glossary to learn OBPE terminology and a Logic Model template. Shaping Outcomes was developed by the Institute of Museum and Library Services (IMLS) and Indiana University/Purdue University Indianapolis (IUPUI) and previously was available as an instructor-led class.
More information specific to developing logic models in health information outreach programs is available from Booklet Two: Planning Outcomes-Based Outreach Projects, part of our resources on our Outreach Evaluation Resource Center (OERC) Evaluation Guides page at http://nnlm.gov/evaluation/guides.html.
We are pleased to share with you the recruitment announcement for the next Head of the National Network of Libraries of Medicine,
commonly referred to as the national Network Office (NNO):
The Head of the National Network Office of the NN/LM serves as a national leader in developing collaborations among the varied types of libraries in the Network, including health sciences libraries, and academic and public institutions, to improve access to and the sharing of biomedical information resources. The NNO Head is responsible for monitoring, evaluating, and advising on all aspects of providing biomedical information, for outreach to groups experiencing health disparities, and for providing access to medical information in national and international emergency and disaster situations. The NNO Head advises on public health information policy issues, as related to programs conducted throughout the Network. This is an exciting time for an incoming Head because plans for the 2016-2021 Regional Medical Library contracts are underway.
The very short posting time of July 22 – July 31 reflects the government’s effort to hire talented people quickly. Please see the postings on USAJobs.gov and follow the instructions to apply. One posting is for “Status Candidates” (Merit Promotion and VEOA Eligibles) and the other is for for “All US Citizens.”
- NLM Supervisory Librarian – Status Candidates (Merit Promotion and VEOA Eligibles)
- NLM Supervisory Librarian – All US Citizens
In addition to an interesting, challenging work environment, NLM has a great location on the campus of the National Institutes of Health (NIH) in Bethesda, Maryland. NIH is a short Metro ride from Washington, DC and a short walk from Bethesda’s thriving restaurant and retail district. As a supervisory librarian at the GS15 level, the position has a salary range of $124,995-$157,100, and reports to the Associate Director for Library Operations, Joyce Backus.
If you have questions about this job, please contact Zenaida Olivero, PHR, (301) 435-5716, or Oliverozm@mail.nih.gov.
Deputy Associate Director of Library Operations
National Library of Medicine
With an increase of technology tools available for data reporting and visualization, sometimes it’s challenging to know how to best use them to clearly communicate the intended meaning of data. The concept of visualization literacy and a broader theme of visual literacy are often not included as part of the instructions guiding people in the steps to create their own visualization design.
A recent entry by Andrew Kirk on the blog of Seeing Data, a research project in the United Kingdom studying how people understand big data visualizations shown in the media, offers a great review of 8 Articles Discussing Visual and Visualization Literacy that are freely available and well worth a read to better understand both visual and visualization literacy. Their featured articles include resources ranging from the importance of Visual Literacy in an Age of Data to How to Be an Educated Consumer of Infographics, and Seeing Data has asked that you share additional ones with them via blog comments or their Twitter social media account @SeeingData.
Follow the link to read the summary of the 2014 ALA Annual Evidence Based Practices Discussion Group summary of presentations and discussion. Thank you to everyone who came to the discussion. It was very interesting: http://connect.ala.org/node/226376
Data Burger: A Good Questionnaire Response Rate Plus Basic Quantitative Data Analysis (Boost Box session)Thursday, July 3rd, 2014
MAR offers 1 MLA Continuing Education (CE) credit per session—details will be provided at the end of the session.
Presenter: Nikki Dettmar, Evaluation Librarian, NN/LM Outreach Evaluation Resource Center
Date / Time: Thursday, July 22, 2014 / Noon – 1 pm (ET)
Where: Online / No Registration Required
Summary: Many of us use questionnaires to learn about our stakeholders’ attitudes and knowledge. Let’s picture this as a burger: The data we collect is like the meat in the filling, and we wrap the data in a tasty bun (summaries, graphs, and charts) to present it.
Meat: We want to use the best ingredients for our filling and collect good data. The question “What is a ‘good’ response rate?” often comes up. What does “response rate” mean, and why is it important? And how do you know what your response rate is? We’ll go over practical steps you can take to increase the number of people who complete and return the questionnaires that you send to them. We’ll also talk about some strategies for addressing low response rates.
Bun: Once you have administered a questionnaire, what do you do with all those numbers? The next section of this webinar will be about preparing and presenting those numbers. It will provide a very quick review of basic quantitative data analysis, including descriptive statistics and suggestions for selecting types of charts or graphs to illustrate your data.
- Beforehand, test your connection to ensure Adobe Connect will run on your computer: http://na1cps.adobeconnect.com/common/help/en/support/meeting_test.htm
- Log-in at https://webmeeting.nih.gov/boost2/ (ONLY use Firefox or Internet Explorer)
- Allow Adobe Connect to call your phone. Choose the DIAL-OUT option.