As with any resource, you must assess the quality of a systematic review or meta-analysis. See our Evaluating Information and Website Evaluation pages for basic guidelines. Additional appraisal tools (checklists, etc.) are available below:
Systematic reviews and meta-analyses are situated at the top of what is known as the “Evidence Pyramid” (see figure below). As you move up the pyramid the amount of available literature on a given topic decreases, but the relevancy and quality of that literature increases. Systematic reviews and meta-analyses are considered to be the highest quality evidence on a research topic because their study design reduces bias and produces more reliable findings. However, you may not always be able to find (or need to find) the highest level of evidence to answer your research question. In the absence of the best evidence, you then need to consider moving down the pyramid.
EBM Pyramid and EBM Page Generator, copyright 2006 Trustees of Dartmouth College and Yale University. All Rights Reserved.
Produced by Jan Glover, David Izzo, Karen Odato and Lei Wang.
A systematic review is a high-level overview of primary research on a particular research question that systematically identifies, selects, evaluates, and synthesizes all high quality research evidence relevant to that question in order to answer it. In other words, it provides an exhaustive summary of scholarly literature related to a particular research topic or question. A systematic review is often written by a panel of experts after reviewing all the information from both published and unpublished studies. The comprehensive nature of a systematic review distinguishes it from traditional literature reviews which typically examine a much smaller set of research evidence and present it from a single author’s perspective. Systematic reviews originated in the biomedical field and currently form the basis of decision-making in Evidence-Based Treatment (EBT) and evidence-based behavioral practice (EBBP).
For additional information, read this entry in the e-reference book The A-Z of Social Research:
Systematic reviews often use statistical techniques to combine data from the examined individual research studies, and use the pooled data to come to new statistical conclusions. This is called meta-analysis, and it represents a specialized subset of systematic reviews. Not all systematic reviews include meta-analysis, but all meta-analyses are found in systematic reviews. Simply put, a systematic review refers to the entire process of selecting, evaluating, and synthesizing all available evidence, while the term meta-analysis refers to the statistical approach to combining the data derived from a systematic-review. Conclusions produced by meta-analysis are statistically stronger than the analysis of any single study, due to increased numbers of subjects, greater diversity among subjects, or accumulated effects and results. Meta-analyses have become common in the social and biomedical sciences. However, some challenge the validity of meta-analysis, arguing that combining data from disparate studies produces misleading or unreliable results.
For additional information, read this entry in e-reference book The Concise Corsini Encyclopedia of Psychology and Behavioral Science:
Since there are far fewer systematic reviews and meta-analyses than most other types of research, you will often need to broaden your search terms when searching in the Library’s Databases or the Internet. Also, keep in mind that the term "systematic review" originated in the medical field, so you can expect to see the majority of articles related to medical areas and conditions.
Locating systematic reviews and meta-analyses is extremely beneficial not only because they provide high-quality evidence, but also because they will include extensive references to primary studies relevant to your research topic.
See the Resources box below for instructions on locating systematic reviews and meta-analyses in the Library databases.
This workshop provides an introduction to library resources which can be used to locate systematic reviews and meta-analysis studies.
Content: Journal article database from the American Psychological Association that indexes over 2,500 journals along with book chapters and dissertations.
Purpose: Provides a single source of vetted, authoritative research for users across the behavioral and social sciences.
Special Features: citations in APA Style®, updated bi-weekly, spans 600 years of content
Compiled by the American Psychological Association (APA), APA PsycInfo covers all aspects of psychology, plus the behavioral aspect of education, medicine, sociology, law, management, and other fields.
To limit your APA PsycInfo search results to systematic reviews, select Systematic Review within the Methodology box (as shown below) and then type your search terms into the search box.
Content: EBSCO’s nursing database covering biomedicine, alternative/complementary medicine, consumer health, and allied health disciplines.
Purpose: Database for research in nursing, medicine, and consumer health.
Special Features: Strong qualitative studies. Filter studies by nurse as author, evidence-based practice, and type of study. Includes MESH indexing, PICO search functionality, text-to-speech feature for some articles, and a tool for discovering citing articles.
CINAHL allows you to limit your publication type not only systematic reviews or meta analyses, but also to a "meta synthesis." This publication type value is applied to articles that indicate the presence of a qualitative methodology that integrates results from a number of different, but inter-related studies.
To limit your results, select Systematic Reviews (or Meta Analysis or Meta Synthesis) within the Publication Type box (as shown below) and then type your search terms into the search box.
Alternatively, you may wish to limit your CINAHL search results to Evidence-Based Practice, as shown below. Applying this limiter allows you to limit results to: articles from evidence-based practice journals; articles about evidence-based practice; research articles (including systematic reviews, clinical trials, meta analyses, etc.) and commentaries on research studies (applying practice to research). Selecting Evidence-Based Practice will produce a broader set of results than applying a single publication type limiter.
Content: Database of intervention focused systematic reviews.
Purpose: Learn the effectiveness of interventions proven through evidence-based research.
Special Features: Includes MESH and PICO search functionality.
Help using this database. Please allow cookies if the page does not load.
- Cochrane Database of Systematic Reviews (CDSR)
- Cochrane Central Register of Controlled Trials (CENTRAL)
- Cochrane Methodology Register (CMR)
- Database of Abstracts of Reviews of Effects (DARE)
- Health Technology Assessment Database (HTA)
- NHS Economic Evaluation Database (EED)
Cochrane Library is a collection of six databases that contain different types of high-quality, independent evidence to inform healthcare decision-making, and a seventh database that provides information about Cochrane groups.
Select Advanced Search and then click on Search limits to choose your Cochrane Reviews as shown below.
Content: Biomedical and health journals. Provides MESH subject headings and offers the full text of many popular MEDLINE-indexed journals that are not available in other databases.
Purpose: Informs users about health and medicine topics
Special Features: Includes text-to-speech function for some articles
MEDLINE provides authoritative medical information on medicine, nursing, dentistry, veterinary medicine, the health care system, pre-clinical sciences, and much more.
To limit your results to systematic reviews, select Systematic Reviews within the Subject Subset box (as shown below) and then type your search terms into the search box.
Content: Medical database covering nursing, allied health, education and training, development and management, midwifery, health and healthcare economics, clinical medical and healthcare social work, psychiatry and mental health, and traumatology, emergency and critical-care medicine.
Purpose: Provides information about all topics relevant to nursing and nursing education
Special Features: Advanced search functions including MESH capability.
Ovid Nursing Full Text is a collection of unique scholarly nursing journals. with subjects ranging from alternative medicine to perinatal nursing.
On the OVID Basic Search screen, select from among the options under the field EBM-Evidence Based Medicine, as shown below. To select both Meta Analysis and Systematic Review, hold down the Control button on your keyboard.
Content: Includes citations to millions of biomedical journal articles, as well as some books, book chapters, and reports.
Purpose: An essential database for biomedical and health topics
Special Features: Includes MeSH search functionality
PubMed systematic reviews cover a broad set of articles that build consensus on biomedical topics and medical genetics. PubMed also includes meta-analyses, reviews of clinical trials, evidence-based medicine, consensus development conferences, and guidelines.
After doing your search, go to the Article Type limit within the left-hand column and select Meta-Analysis or Systematic Review.
Note that the Systematic Reviews filter in PubMed will include meta-analyses results. If however, you want to search for only for meta-analyses, select the Meta-Analysis filter under Article Type. You will need to deselect everything in this filter except Meta-Analysis.
Alternatively, you can also search for systematic reviews in PubMed by using the Clinical Queries search page. Results of searches on this page are limited to specific clinical research areas.
Content: Scholarly journals, e-books, videos and more.
Purpose: A key multidisciplinary database for most topics. It is one of the library’s main search engines and the most comprehensive single search.
Note: Certain library databases and publisher content are not searchable in NavigatorSearch, and individual databases may need to be searched to retrieve information due to unique content. NavigatorSearch can be found at https://resources.nu.edu.
NavigatorSearch is a great starting point for your research as it searches approximately 95% of the library’s database content, including articles, e-books and videos.
To include systematic reviews in your NavigatorSearch results, include the phrase “systematic review” in one of the search boxes and change the drop-down menu to TI Title (as shown below).
Content: Citations and articles in multi-disciplines not found through a NavigatorSearch.
Purpose: Used to conduct topic searches as well as find additional resources that have cited a specific resource (citation network).
Web of Knowledge provides access to current and retrospective bibliographic information, author abstracts, and cited references in social science journals that cover more than 50 disciplines. Note there is no full-text within this database.
To include systematic reviews in your Web of Knowledge search results, enter your topic keyword on the top line for Topic. On the second line, type “systematic review” and change the drop-down box to Title (as shown below).