Protocol for a scoping review of traditional medicine research methods, methodologies, frameworks and strategies
1 Introduction
In 2020, the World Health Organization (WHO) announced the establishment of a new global center for traditional medicine (TM) in Jamnagar, India, to further advance the WHO’s long-standing call for governments worldwide to appropriately integrate TM into national health systems (1). The WHO Traditional Medicine Strategy: 2014–2023 emphasizes that TM-related health system advancements “must be supported by evidence,” to foster delivery of safe, effective and accessible healthcare (2). However, surveys of WHO Member States consistently identify a “lack of research data” as their primary challenge in this regard (3). To support development of a research agenda for the new global TM center, the WHO has commissioned a series of evidence reviews. The scoping review protocol presented here pertains to one such commissioned study.
In the 2018 Declaration of Astana, the WHO explicitly called for the concurrent application of both biomedical and TM knowledges, and their associated practices, in advancing universal access to primary health care worldwide (4). There is strong academic and political pressure for TM to align with the biomedical evidence-based approaches that are widely applied in other areas of health and medicine. However, research methods must also be appropriate to what is being studied. TM takes many forms and is often underpinned by paradigms that differ in keyways from biomedicine (5). Tensions may thus arise in this context, as dominant biomedical research paradigms are not always optimally suited to studying TM approaches.
There remains an active global debate as to what types of research approaches may be most appropriate for the study of TM systems and their affiliated practices. This debate, in part, reflects the paradigmatic differences between TM and biomedicine (and its widely accepted research approaches). Since all research approaches—including standard biomedical methodologies and methods—are underpinned by their own paradigmatic features (6, 7), the question arises as to what types of rigorous research approaches may be aligned with TM paradigms. Indeed, the paradigmatic tenets of TM systems differ considerably from those underpinning dominant biomedical paradigms. Biomedicine is a therapeutic system historically structured around a worldview of “scientific materialism” that mechanistically reduces living systems to their constituent physical parts (8). Over the last 70 years, the biomedical paradigm has faced transformations from within, including the rise of a “biopsychosocial paradigm” (9), that includes social and psychological factors alongside biological considerations (10). In contrast, TM systems, while diverse, tend to be paradigmatically based in worldviews of “holism” (i.e., the whole is greater than the sum of its parts) (11), “vitalism” (i.e., there is a “vital” operating principle that distinguishes living organisms from other parts of the material world) (8), and/or “eco-centrism” (i.e., which situates the planet/nature rather than humans as the central conceptual element, drawing links between them) (11, 12).
TM researchers (13–15), like Indigenous scholars (16, 17), have critiqued the limitations of many mainstream health research norms, reporting methodological challenges with applying many standard biomedical research approaches (13). Some such critiques and challenges are similar to those raised and faced by biomedical researchers (18, 19). For example, in the field of psychotherapy (20), it has proven difficult to establish credible placebo/sham controls for many TM therapies (e.g., acupuncture, energy medicine) (21). Further—like some psychotherapeutic and psychosocial interventions in biomedicine—blinding within TM clinical trials is not possible when conscious awareness and/or learning is a component of the intervention itself (e.g., meditation, yoga, tai chi, expressive therapies). Notably, Cochrane reviewers have judged some psychosocial interventions (e.g., Alcoholics Anonymous, music therapy)—wherein active, participant engagement is (as in many TM therapies) a central therapeutic element—to be at low risk of performance bias, despite lack of blinding of study participants and personnel (22, 23). On the whole, a shift away from reductionist conceptualizations of health and disease has been evident in the biomedical research world in recent years, with a greater emphasis on biopsychosocial models, person-centered care, complexity science, and systems-based thinking (18). Part of this shift has included the development of research and evidence synthesis approaches that more rigorously evaluate health-related interventions—including TM approaches—with a high degree of intervention complexity (24). Further, considerations and strategies raised with respect to the cultural appropriateness of biomedical research approaches in TM contexts [e.g., Indigenous TM (25)] echo those discussed in biomedical contexts (e.g., “cultural psychiatry”) (26).
Despite these advances, many TM-specific challenges persist with respect to the alignment of biomedical research approaches with TM paradigms. For instance, the application of randomized controlled trial (RCT) study designs is challenging when evaluating interventions individualized according to TM-specific diagnostic frameworks, which are often strongly distinct from biomedical diagnostic categories; for example, in Chinese medicine, “liver qi stagnation” or “kidney yin deficiency” are common diagnostic categories (13). Related challenges are especially pronounced when a TM intervention is multicomponent (e.g., herbal formulations with multiple ingredients) and/or multimodal (e.g., acupuncture with herbal medicine)—and when treatments for a single patient may be modified over the course of a therapeutic process wherein the bodily conditions are understood to be changing (13). Other challenges arise from the dominant biomedical approach to pharmacological research, as this is based on a biomedical construct of a “single active ingredient.” However, the “one-disease one-target one-drug” notion is strongly at odds with many TM conceptual models for herbal medicines, wherein “whole plants” and plant combinations are understood to have various synergistic, additive and antagonistic effects on multiple targets with multiple clinical indications (27). Furthermore, in some TM systems, medicinal plants have spiritual significance and their therapeutic activity is understood in this light (5). Adding to this complexity, “relational” Indigenous knowledges “passed down through oral tradition,” as well as “Indigenous sources of knowledge, such as dreams, visions, or spirit” are often poorly considered or devalued within conventional biomedical research (28).
Research about TM—which in many settings carries both clinical and cultural importance—also raises complex sociopolitical and economic questions. For example, the “bioprospecting” approach that underpins much phytopharmacological research may, as the WHO and other United Nations agencies have observed, lead to large profits for pharmaceutical sellers, without concomitant recognition of Indigenous knowledge contributions, or benefit sharing with Indigenous communities (29). Further, it cannot be ignored that TM research—like TM’s integration into health systems—occurs within a sociopolitical context of biomedical dominance (5, 30), as well as inequitable conditions of resource distribution and knowledge production (5).
Over the last 20 years, there has been an exponential growth in TM-related research and evidence synthesis (31–33). Like biomedicine, the field of TM research crosses multiple disciplinary domains, including basic science, pre-clinical, clinical, health services, economic, policy, social science, ethnomedicine and implementation research. The methods and methodologies used range from quantitative to qualitative and mixed methods, Indigenous research designs, and machine learning and omics. Paradigmatic considerations, along with questions of Indigenous cultural and intellectual property, may arise across each of these domains, all of which shape the field’s broader, policy relevant evidentiary landscape. To date, however, systematic literature reviews that examine how paradigmatic considerations have been addressed in TM research have been lacking.
Multiple bodies of prior scholarship address the methodological issues to be investigated in this Review. Scholars in the TM field have critiqued the challenges posed by biomedical evidentiary hierarchies, proposing TM-relevant reconceptualizations (14, 15, 34, 35). Similar proposals have been advanced by biomedical researchers concerned with the limitations of dominant research norms (18, 19). Indigenous scholars have advanced a range of paradigmatically-aligned Indigenous research methodologies and methods, including decolonizing approaches, both within and beyond the health research field (16, 17). A previous systematic review by Saini explores areas of methodological “compatibility and convergence” between “[W]estern and [A]boriginal research designs” (36). In addition, TM scholars have developed several guidelines for the conduct and reporting of TM clinical research (37–42). Ijaz et al. scoping review of “whole systems research methods” details multiple adaptations to biomedical clinical research methods used by TM researchers (13). Some TM researchers have applied logic models and program theory to evaluate complex outcomes such as health behavior (43) and global functioning, as well as healthcare services that are integrating TM and biomedicine (44, 45). There are also examples of paradigmatically-aligned clinical practice guidelines for various conditions (46). Scholars seeking research approaches that align with TM therapeutic systems are furthermore adopting research approaches designed to evaluate complex interventions. Examples include, complexity science (47, 48) (which is the interdisciplinarity study of complex adaptive systems (49)) and systems science approaches (50), such as network pharmacology (51, 52) that have “shifted the paradigm from a “one-target, one-drug” mode to a network-target, multiple-component-therapeutics’ mode” (52). Likewise, TM-focused social scientists have demonstrated the importance of addressing paradigmatic considerations within TM policy processes (53, 54).
Notwithstanding these examples of TM research, a systematic review of the literature that scopes and summarizes the characteristics of TM research approaches, with reference to questions of paradigmatic alignment, is yet to be conducted.
The scoping review whose protocol is presented in this work therefore aims to: (a) summarize the range of research approaches (i.e., methods, methodologies, frameworks and strategies) currently used (or proposed for use) in the study of TM; and (b) describe the “paradigmatic alignment” of these research approaches with the TM being studied. Scoping reviews are well suited to answering “big picture” exploratory questions such as these, which do not seek to evaluate TM nor exhaustively map all TM research (55–57). As per JBI guidance, an a priori conceptual framework, provisionally named “paradigmatic alignment,” will steer the review process. The following sections contextualize the review methods by elaborating key definitions and presenting the project’s conceptual framework.
2 Methods
An abridged version of this protocol was registered on 17 November 2023 on the International Platform of Registered Systematic Review and Meta-analysis Protocols (INPLASY2023110071) (58). The methodology for this scoping review is informed by JBI guidelines (56), and will be reported according to the Preferred Reporting Items for Systematic Review and Meta-analysis Scoping Review extension (PRISMA-ScR) (59). This protocol is reported according to a modified PRISMA-P reporting checklist (Supplementary File S1) (60).
2.1 Research question
The primary, two-part question driving this scoping review is:
a. What are the types and characteristics of the research approaches (i.e., methods, methodologies, frameworks and strategies) applied in, or recommended for application in, TM research; and
b. How do these TM research approaches and their affiliated research paradigms align with the therapeutic paradigm(s) of the TM being studied (i.e., paradigmatic alignment) (Table 1)?
Table 1. Paradigms and worldviews.
Three related sub-questions are:
1. Where (e.g., regions, countries), by whom (e.g., cultural groups, communities/patients, practitioners, professions, governments, academic institutions) and why (e.g., rationale, purpose) are these TM research approaches being applied or recommended?
2. How have TM research approaches been applied (and/or modified) to suit different TM types, knowledges and practices, and regional, disciplinary or cultural conditions?
3. How do paradigmatically-aligned TM research approaches co-exist, contrast, complement or align with established biomedical research approaches?
2.2 Definitions and concepts
2.2.1 Traditional medicine
The WHO defines traditional medicine (TM) as
the sum total of the knowledge, skill, and practices based on the theories, beliefs, and experiences [I]ndigenous to different cultures, whether explicable or not, used in the maintenance of health as well as in the prevention, diagnosis, improvement or treatment of physical and mental illness (2).
Further, as WHO observes, some TM approaches may be used outside of their geographies and cultures of origin and are sometimes categorized as “complementary medicine” in such contexts.
While the WHO’s definition of TM will provide a basis for the review, that definition is primarily theoretical (i.e., broadly characterizing the TM construct) rather than operational (i.e., specifying what is included within the construct). Ijaz has elsewhere advanced an operational typology theoretically based on the WHO’s definition (61). Two key features of the typology make it a suitable basis to inform the review.
First, it is broadly inclusive of a wide range of Indigenous, ethnomedical and otherwise-unconventional therapeutic approaches that are widely used across the globe. This inclusive approach is consistent with the WHO’s own indications that it intends the TM construct, in the context of its new global TM center, to include a wide range of “traditional, complementary, and integrative medicine” approaches (1).
Second, the typology draws close attention to knowledge paradigms as a core differentiating factor between TM approaches, whether codified (e.g., Ayurveda, Chinese medicine, homeopathy) or non-codified (e.g., many local Indigenous healing approaches and remedies in the self-care domain). It also acknowledges the overlap between therapeutic approaches that are rooted in TM paradigms, yet strongly incorporate biomedical paradigmatic perspectives (e.g., anthroposophy, chiropractic, naturopathy, osteopathy), and other complementary therapeutic approaches that have developed alongside biomedicine when practiced within the context of a biomedical paradigm (e.g., dry needling, dietary supplements used in isolation to treat a symptom or disease).
2.2.2 Research approaches and domains
In this review, the term research approaches will be used when referring to any aspect of the research process (i.e., methods, methodologies, frameworks, and strategies). Research methods refers to the specific techniques for collecting, analyzing and reporting research data. The research methodologies are the guiding principles and study design that inform the selection and application of the research methods. The theoretical context, rationale and/or guidelines for conducting research may be outlined in a research framework. Research strategies are the structured plans for achieving the research goals, whether for a single project or an entire field, and may encompass the overall study design(s), task sequencing, and resource allocation.
WHO Member States consistently signal the need for more TM research data to inform regulatory decisions (3). Along with clinical research evaluating TM effectiveness and safety, other evidence (information) is also required when making clinical decisions, providing public health guidance, regulating therapies and practitioners, and delivering health services. For instance, in addition to evidence about the clinical effectiveness and safety of a TM intervention, evidence about modifying factors (e.g., patient/population use; stakeholders’ preferences and values; direct and indirect costs; availability, quality control, and regulatory consideration; and the benefits and risks of alternative option, including doing nothing) may warrant recommending or implementing a TM intervention despite low certainty in the clinical evidence and vice versa (62, 63). Another example is the United States of America Food and Drug Administration endorsed framework for evaluating the safety of dietary supplements considers evidence from historical (traditional) use, in vitro and animal studies, clinical trials, epidemiological studies, and post-market surveillance (64).
Therefore, the scoping review will examine the research approaches that are applied across a wide range of disciplinary research domains including basic science and preclinical research, clinical research, health services research, health economics, health technology assessments, implementation science, social sciences, ethnomedicine, policy research, and Indigenous methodologies [e.g., storytelling, yarning, talking circles, and other culture-specific methods (65)].
2.2.3 Conceptual framework: paradigmatic alignment
Conceptual frameworks can be a “critical element in effectively focusing [a] review and designing the methods to respond to the knowledge question” (66). In line with JBI guidance, an a priori conceptual framework will inform all stages of the scoping review’s conduct, from sub-question development to search strategy and data analysis (56). This conceptual framework, provisionally termed “paradigmatic alignment,” refers to the ways in which a research approach (and its paradigmatic underpinnings) align with the paradigmatic features of the TM therapeutic approach being studied. The principles of Two-Eyed Seeing (Etuaptmumk) (67) and a TM-specific concept of “model validity” (13) were used to inform the theoretical underpinnings of this framework and it operationalization.
2.2.3.1 Research and therapeutic paradigms
The term paradigm is typically used when referring to “the entire constellation of beliefs, values, techniques, and so on shared by the members of a given community” (68). Based on the work of research methodologists, who have extensively elaborated on the concept of a “research paradigm,” for the purpose of this scoping review, paradigms will be understood to include three central elements: ontology (understandings about the nature of reality); epistemology (how knowledge is acquired, constructed and justified); and practice (e.g., methods, methodologies and techniques) (6, 7). Another reason for using this three-part construct is its alignment with the work of Indigenous scholars, who often refer to “ways of being, knowing and doing” when describing Indigenous “worldviews” (Table 1) (69, 70).
2.2.3.1.1 Research paradigms
Research methodologists have expounded upon “research paradigms” (such as positivism, post-positivism, realism, constructivism, interpretivism, Indigenous research paradigms) and their application according to the research purpose and context (6, 7). The research paradigm directs the choice of the study design, data collection, analysis, and interpretation. While a specific research method or methodology may not exclusively belong to a single research paradigm, they will often align with certain research paradigms. For example, quantitative methods typically align with the positivist paradigm, while qualitative methods lend themselves to research that draws on constructivism or interpretivism (7). Notably, it is widely acknowledged that positivist and post-positivist research paradigms (along with associated quantitative methodologies like RCTs) hold sociopolitical privilege over other research paradigms and approaches (6, 7, 18). Further, it will be taken as axiomatic that every research approach has its own ontological and epistemic basis regardless of whether this is explicitly recognized by academic scholars.
2.2.3.1.2 Therapeutic paradigms
Although the term “therapeutic paradigm” is commonly used, it has not been extensively theorized. Notwithstanding, educationalists from various healthcare disciplines have discussed how therapeutic and disciplinary paradigms, along with their related clinical practices, are influenced by the ontologies and epistemologies of both the individual practitioner and their professional bodies (71, 72).
In a comparative analysis of four complex medical systems—contemporary biomedicine, homeopathy, traditional Chinese medicine, and Ayurveda—Brazilian scholar Madel Luz proposed the “medical rationalities” framework (73). Luz observed that all four systems exhibited the characteristics of a complex medical system, as they each have their own distinct cosmology (a construct similar to ontology), elements in which that cosmology is expressed as knowledge, or epistemology—including medical doctrine (that defines and guides foundational concepts for health, disease, etiology, and clinical practice), morphology (that describes that body’s micro and macro structures and anatomy), and physiology (that explains the body’s functional and regulatory systems) –and, areas in which epistemology and practice intersect—that is, diagnostic and therapeutic systems. In this sense, Luz’s model of a “complex medical system” may be provisionally understood as similar to the concept of a “therapeutic paradigm.”
Like biomedical paradigms, TM paradigms are not static and continue to evolve and shift (74, 75). In contrast however, biomedical therapeutic paradigms typically wield more political influence globally than contemporary TM therapeutic paradigms (5).
2.2.3.2 Two-eyed seeing (Etuaptmumk)
Two-Eyed Seeing, or Etuaptmumk (pronounced: eh-doo-ahp-duh-mumk), is a principle advanced by Mi’kmaq Indigenous scholars Marshall and Marshall wherein Indigenous/traditional knowledges and biomedical knowledges may equitably co-exist (67).
As the authors explain, Two-Eyed Seeing (Etuaptmumk):
refers to learning to see from one eye with the strengths of (or best in) Indigenous knowledges and ways of knowing, and learning to see from the other eye with the strengths of (or best in) Western knowledges and ways of knowing… [and] using both of these eyes together for the benefit of all. We need to utilize Two-Eyed Seeing to determine the benefits both in the modern medical science knowledges and in our Indigenous knowledges … Two-Eyed Seeing encourages that we draw upon both new technologies and traditional practices to lead to better health outcomes for everyone (67).
This principle has been widely engaged in health research addressing traditional/Indigenous knowledges and ways of knowing, and adopted by government agencies (such as the Canadian Institutes of Health Research) (76). Constituting “Indigenous and Western knowledge systems as whole and, distinct in and of themselves, Two-Eyed Seeing holds that each knowledge system can only offer a partial understanding of the world … [and recognises that] no single worldview offers everything” (76). In the context of this scoping review, the central importance of Two-Eyed seeing as a guiding principle is that it explicitly recognizes—within a context of biomedical dominance—the concurrent and fundamentally equal value of distinct forms of knowledge, even though each will necessarily contribute to the domains of research, policy and clinical practice in its own way. In this sense, the principle of Two-Eyed Seeing (Etuaptmumk) is closely aligned with the principles of epistemic pluralism and epistemic equity, as explained below.
2.2.3.2.1 Epistemic pluralism and epistemic equity
Epistemic pluralism recognizes that multiple epistemologies (be they various biomedical or TM knowledges) may co-exist despite unequal sociopolitical power dynamics (77). It recognizes that the dominant epistemologies may become so deeply embedded within sociopolitical structures and mass culture that their underlying assumptions appear “neutral” or “universal” despite being culturally and historically situated (78). In this context, the concept of “epistemic equity” or “epistemic justice” holds that diverse epistemologies should be appropriately and fairly valued according to their unique contributions (77). Such an equitable co-existence of diverse epistemologies has also been termed “an ecology of knowledges” by decolonial scholars (79). These principles are closely aligned with the WHO’s call for the appropriate integration of TM within biomedically dominant national health systems worldwide (2, 4).
2.2.3.3 Model validity
Model validity is a term that holds multiple meanings across different research communities. However, for the purpose of this review, the TM-specific use of the term will be engaged. Originally referred to as “model fit validity” by Cassidy (80), TM clinical researchers have distinctly used the term “model validity” to denote a principle that emphasizes the importance of aligning clinical research paradigms with the TM being studied (13, 81–84). With reference to biomedical contexts, where there exist commonly held paradigmatic assumptions about etiology, diagnosis, pathophysiology, and outcomes, Jonas and colleagues explain that there is often no “need to evaluate whether research methods have violated these basic assumptions” (81). However, in TM research, whose paradigmatic assumptions diverge from those biomedical, the concept of model validity gains in importance.
Much TM scholastic work has involved the development and application of specific criteria for critically appraising the model validity of TM clinical research (81–84). However, leading on from this, in a scoping review of TM whole systems research, Ijaz and colleagues used the TM-specific construct of “model validity” in their conceptual framework that “represents a commitment to actively preserving these [TM] paradigms and practices in their own right” (13). That conceptual framework aligns closely with the WHO’s commitment to “protect[ing] traditional knowledge,” articulated in the TM Strategy 2014–2023 (2).
Ijaz and colleagues proposed three inter-related subcategories of the model validity construct—paradigm compatibility, paradigm consistency, and paradigm specificity—with reference to TM clinical research (13). In this scoping review, the model validity construct and its three subcategories will be analytically applied to a wide range of research approaches and domains (including, but not limited to, clinical research) and, thus, require further theoretical elaboration and development. As explained below, this includes a minor adjustment to Ijaz et al. concept of “paradigm consistency,” renaming it to “paradigm adapted,” with the addition of a fourth subcategory of “paradigm pluralistic.”
Paradigm specific research will refer to research approaches originating in a specific (therapeutic or research) paradigm that are best suited for the conduct of studies within that same paradigm. For example, placebo controlled, RCTs were developed by biomedical researchers to evaluate the efficacy of single drugs when used for a single diagnosis and quantifiably-measured outcomes. Similarly, there are traditional and Indigenous research approaches that were designed to study their own practices. For instance, there are numerous examples of culturally specific Indigenous research methods, such as talking circles, storytelling and “yarning” (65). Notably, culturally specific methods that originated in one Indigenous group may be paradigm specific and, therefore, not translatable to other Indigenous groups due to differences in their cultural practices, paradigms, and worldviews (65).
Paradigm compatible research, by contrast, is a research approach that originates in one paradigm yet may also be suitable for studying a different therapeutic paradigm. For instance, a double-blind, placebo-controlled RCT may be used in a model valid manner to evaluate TM interventions where: (a) an inert placebo can be created; (b) a TM therapeutic approach is traditionally used in isolation to treat a singular “generic” symptom; and/or (c) application of a TM therapeutic approach does not require specialized TM diagnosis or therapeutic individualization (e.g., a standardized herbal formula, supplement, or other TM drug for headache, cough, soft-tissue bruising, menopausal hot flashes, sleep quality etc.).
Pragmatic trial designs that use various randomization and recruitment methods, and often include real-world data to evaluate complex interventions in the setting where they are intended to be delivered, are another example of a research method originating in biomedical science that have been appropriately used to evaluate complex, individualized TM interventions in a model valid way (13). Similarly, researchers seeking to investigate complex TM herbal formulations (and their synergistic effects) use network pharmacology methods, developed in biomedical contexts to investigate synergistic drug combinations (85–87).
Paradigm adapted research approaches are those developed within one knowledge system adapted or modified to better fit another paradigmatic context. Examples include the adaption of a biomedical clinical trial method to include TM diagnoses in the inclusion criteria and/or for individualized treatment protocols (13), or community-based participatory research methods that are modified to incorporate “yarning” or “storytelling” (which are culturally-situated methods based in Indigenous oral traditions) (65). The TM extensions to CONSORT and PRISMA reporting guidelines are another example of such paradigmatic adaptations to established research approaches.
Finally, a fourth subcategory, termed paradigm pluralistic, will be provisionally added to better operationalize the model validity construct within this scoping review. Paradigm pluralism represents areas of interweaving between paradigms where two or more research approaches from different paradigms are used side-by-side. Examples include Indigenous-led co-research methods that combine ethnobotanical and preclinical research (88), clinical practice guidelines that report the confidence in the TM knowledge along with the certainty/quality of empirical research (89), and regulatory guidance for industry on how to synthesize both TM knowledge and empirical research when making health claims for regulated TM products (90).
Overall, the principle of Two-Eyed Seeing (Etuaptmumk) (67) is expressed across all four model validity subcategories, illustrating different ways in which biomedical and TM knowledges have the potential to fruitfully, dynamically and respectfully co-exist in research-related contexts.
2.3 Eligibility criteria
The inclusion criteria will follow the JBI scoping review framework of concept, context, and types of evidence sources (56).
In summary, the evidence sources to be included in this review will:
1. Describe or summarize the research approaches used to study TM;
2. Propose, recommend, or provide guidance for TM research;
3. Critique or articulate a rationale for developing, implementing, or applying TM research approaches; and/or
4. Provide an example of paradigmatic alignment between a specific research approach and the TM being studied.
2.3.1 Concepts
The concepts of interest that will inform the inclusion and exclusion criteria are: (1) traditional medicine, (2) research approaches, and (3) the review’s conceptual framework of paradigmatic alignment that encompasses the concepts of research paradigms, therapeutic paradigms, Two-Eyed Seeing (Etuaptmumk) (67) and the TM-specific use of the “model validity” concept (13).
Any form of TM that aligns with the WHO’s definition will be included (2, 61). Medicines with natural ingredients or derivatives when used in a biomedical setting (e.g., vitamin K for neonates, digoxin for cardiac conditions, vincristine for cancer treatment) will be excluded (91). As will biomedical healthcare approaches and related disciplines (e.g., psychiatry/psychology, physical/physiotherapy, exercise physiology, rehabilitation, occupational therapy, dietetics, lifestyle medicine, public health interventions etc.). The exception are instances when biomedical approaches are used alongside or integrated with TM (91).
The included evidence sources will describe or summarize TM research methods, methodologies, frameworks or strategies (i.e., research approaches). Sources that only discuss TM therapeutic paradigms (along with their associated knowledges and practices) will be excluded.
Based on the primary review question, technically, all documents reporting TM research could be included. Therefore, for pragmatic reasons, the following will be excluded and will not be actively searched for:
1. Primary studies of TM, except those where it is not possible to identify a literature review that summarizes the relevant methods or methodologies, or when the primary study is deemed to be an exemplar.
2. Secondary studies, review articles, etc. that do not describe, discuss, or critique a TM research approach.
3. Secondary studies, review articles, etc. that only evaluate or discuss TM efficacy, effectiveness, safety, mechanisms of action, or the risk of bias / quality of primary TM studies. Instead, we will include overviews/umbrella reviews, mapping reviews, scoping reviews etc. that summarize review methods and methodologies. The exception will be when paradigmatically aligned synthesis methods or critical appraisal tools are used, or reviews that report a wide range of study designs.
4. Clinical practice guidelines and related consensus statements / Delphi studies for diagnosis or treatment.
5. TM monographs and related evidence sources.
2.3.2 Context
The contexts that will inform the inclusion and exclusion criteria for the scoping review are as follows.
All research domains (e.g., basic science, preclinical, clinical, health services, economic analyses, health technology assessment, implementation science, social sciences, ethnomedicine, and policy research) will be included. Indigenous methodologies such as storytelling, yarning, talking circles, and other culture-specific methods (65), that involve research “of” Indigenous peoples will only be included if the context is TM, either as a standalone concept or when integrated with biomedicine and/or mainstream health services.
All geographical locations, countries, regions, cultural contexts, and health care settings (e.g., community, self-care, primary care, secondary care, integrative or traditional health care, clinical or non-clinical settings) will be included. However, research or activities that do not directly pertain to human health or health care will be excluded, as will research for other purposes such as veterinary, agriculture, or the environment.
2.3.3 Types of evidence sources
The types of evidence sources to be included are broad, including primary and secondary research articles and other types of articles published in peer reviewed journals (e.g., viewpoint and review articles, guidelines for the conduct or reporting of TM research), gray literature (e.g., research theses, guidelines, white papers, reports, and policy documents), and books and book chapters. Inclusion of gray literature is important in the present context due to known barriers faced by TM stakeholders regarding participation within biomedically-dominant scholarly contexts (34, 92–94). Information published on websites, letters to editors, conference proceedings/abstracts, magazine and news articles, and other evidence sources will be excluded unless this is the only example identified in the search for a particular research approach or a key example of paradigmatic alignment. There are no date nor language restrictions, and all efforts will be made to translate potentially relevant evidence sources.
2.4 Search strategy
Free-text and standardized search terms will reflect general overarching TM terms, Indigenous health care approaches, TM whole systems, overarching terms for botanicals and nutraceuticals, and terms for individual TM modalities and therapies. The selection of terms were informed by search terms identified by Ng et al. operational definition of complementary, alternative and integrative medicine for literature reviews (95). The final selection of terms aimed to optimize a balance between sensitivity and specificity by focusing on the TMs terms that contrast biomedical therapeutic paradigms as outlined in a TM typology proposed by Ijaz (61) and an operational definition of Integrative Medicine for primary care research proposed by Hunter et al. (91). TM terms will be combined with terms for research approaches, methodological approaches for evaluating complex phenomena, and other review concepts (e.g., epistemology, paradigm, model validity, fit-for-purpose). Search term syntax, fields and languages will be tailored according to the database that is searched.
To account for the exploratory nature of the scoping review question and sub-questions, database searching will be staggered and continue concurrently with analysis until data saturation is reached (i.e., no new information is identified through further literature searching). This approach draws on qualitative research methodology where iterative techniques, such as the constant comparative method, are applied when determining data saturation (96). While all TM, research domains and research approaches will be included, it is impractical to search for, and include every published example. Therefore, data saturation will focus on sampling the overarching categories outlined in scoping review matrix (Figure 1). These are: (a) the TM research approaches (methodologies, methods, strategies and frameworks); (b) TM research domains (basic science/preclinical research, clinical/health services, and social science/ethnomedicine); (c) different types of TM systems and practices (non-codified Indigenous, codified whole systems, and other complementary therapeutic approaches including self-care); and (d) the various contexts (location, knowledge users) where these TM research approaches were applied, discussed or recommended. To align with the review’s focus on paradigmatic alignment, data saturation will emphasize TM therapeutic paradigms that sharply contrast biomedical paradigms.
Figure 1. Scoping review matrix.
The Category I databases listed in Table 1 will first be searched using the free-text and standardized search terms outlined in Supplementary File S2 that were designed for the English language. Notwithstanding this English-language bias, relevant articles/citations published in languages other than English will be included and the index terms will be tailored for the databases searched. When data saturation is not reached, additional focused searches for a key population, concept, and/or context will be conducted, including non-English languages (e.g., Arabic, Chinese, French, Hindi, Japanese, Korean, Spanish, Portuguese, Thai) with corresponding search strategies using one or more of the Category I or II databases (Table 2). Except for some secondary focused databases searches, databases will be searched from inception.
Table 2. Scoping review and mixed methods systematic review databases to be searched.
Protocol-driven search strategies, will be used alongside iterative search methods, such as citation tracking (97), pearl growing/snowballing (97, 98), and CLUSTER searching (99). This strategy is recommended for systematic reviews of complex evidence (97–100). Other tools such as PubMed Miner (101) will be used to refine additional database search strategies. Searches will be supplemented by information and documents known to members of the Review Team, the WHO TM Evidence Task Force, and other knowledge users through the Review Team’s regional outreach strategy. Authors will only be contacted about key information that is needed to directly answer the review’s questions. All procedures will be documented for transparent reporting.
2.4.1 Screening, selection, and data extraction
All identified citations from database searches that can be exported in RIS format will be collated and uploaded into EndNote 20 software (102) for automatic linking of available full texts and initial screening for duplicates. Covidence systematic review software (103) will then be used for a second screening of duplicates, that will be followed by title/abstract screening, full text screening, and preliminary data extraction of the included articles. For database searches where this strategy is not feasible, we will use alternate comparable methods.
Following calibration exercises, two reviewers will independently conduct title/abstract and full text screening. Inter-rater reliability will be checked and reported using the Covidence functions. Due to the broad nature of the research question, over 10,000 citations may need to be screened. If the inter-rater reliability is high after the first round of screening (e.g., percentage agreement >80%), rapid review methods may be employed for additional rounds wherein, following calibration exercises, single reviewers screen and a second reviewer screens the excluded citations (104). Disagreements between reviewers will be resolved via consensus.
Single reviewers will extract data according to a prespecified, piloted data extraction template in Covidence (Supplementary File S3—draft extraction form); a second reviewer will verify data extraction. The details of any modifications will be reported. Disagreements will be resolved via consensus. Electronic spreadsheets and Taguette software (105) will be used when extracting, sorting and categorizing data for the supplementary qualitative data analyses.
2.5 Quality appraisal
Quality appraisal (e.g., risk of bias) assessments will not be conducted for all included evidence sources. However, if the evidence source was not peer reviewed, then prior to using it to inform the in-depth, qualitative analysis, the JBI Critical Appraisal Tools will be used (106). Notably, the JBI suite includes appraisal tools for different types of textual evidence and all checklists have an overall appraisal recommendation to include, exclude, or seek further information. Single, senior reviewers will conduct the appraisals. The decision to include or exclude an evidence source will be verified by another senior reviewer. Disagreements will be resolved via consensus.
2.6 Analysis and evidence synthesis
The analysis will follow JBI guidance for scoping reviews (56, 107). To account for the substantial heterogeneity and diversity of data that is likely to result from the study’s broad, exploratory research questions and the multidimensional sampling frame, subsequent analysis and synthesis of findings, will proceed in stages. This will be informed by the review’s conceptual framework of paradigmatic alignment and related concepts previously outlined.
The first stage of the analysis will focus on describing the types and range of research approaches used to study the various forms of TM across diverse contexts. Data extracted in Covidence will be exported into electronic spreadsheets. Analysis will begin by summarizing the characteristics of the evidence sources (e.g., citation details, publication type and year, countries of authors, declarations) and the types of TM, research domains and research approaches that were applied, discussed or recommended. The scoping review matrix in Figure 1. illustrates the overarching categories that will be used for sorting and charting the data. Additional subcategories may be inductively introduced or developed over the course of the analytic process.
Data extraction in Covidence will include preliminary coding to flag potentially relevant evidence sources (Supplementary File S3—data extraction form) for further in-depth analysis. A basic qualitative content analysis (107) will then be conducted to explore the question of paradigmatic alignment and other related sub-questions. After data immersion, analysis will initially proceed deductively in relation to the review’s conceptual framework and the scoping review matrix (Figure 1). Reviewers may also flag emergent topics that were not addressed in the a priori sub-questions yet appear relevant to the review. Other qualitative methods, such as “following the thread” (108), the constant comparative method (96), and deductive and inductive thematic methods (109, 110) may, therefore, be indicated as the qualitative content analysis proceeds. After reaching consensus about further topics or sub-questions that warrant further exploration, literature searching and analysis will then continue until saturation is reached. All post hoc changes or modification to this protocol will be transparently reported.
Further, in seeking answers to a specific sub-question, or in characterizing a particular topic, reviewers will identify illustrative exemplars. To facilitate knowledge user engagement with review findings, some of these exemplars will be highlighted in the results. When selecting and reporting exemplars, we will aim toward regional and TM disciplinary inclusivity.
A narrative summary of the finding supported by relevant tables and figures will characterize the diverse range of research approaches employed in TM research. Draft charting tables are reported in Supplementary File S4.
2.7 Knowledge user engagement
Involving knowledge users (stakeholders) recognizes their perspectives, expertise, and experiences, ensuring research outcomes are relevant, applicable and useful for end-users. In line with JBI guidance on knowledge user engagement for scoping reviews (111), from the outset, a Review Team was formed, composed of two dozen TM research experts from all global regions (see: Acknowledgements). Review Team members are primarily established scholars in the TM field with training and expertise in a wide range of research methodologies (including biomedical research methods, sociology, implementation science, and Indigenous research methodologies) as well as clinician-scientists with dual biomedical-TM training.
Review team members were also selected with the following principles in mind: regional and contextual representation and representation across diverse research domains and TM types. Following WHO requirements, all Review Team members must formally disclose their varied engagements to manage potential conflicts of interest. The team members provide expert advice on all stages of the review. Membership may be expanded to fill key knowledge gaps. Review Team members will also support regional outreach through their networks. Additional stakeholder consultations that informed the development of this protocol included a roundtable discussion between TM experts appointed by the six WHO regional head offices at the 2023 WHO Traditional Medicine Global Summit, India (August 2023), and feedback from the TM Evidence Task Force of global experts appointed by the WHO to advise on the conduct of commissioned reviews.
3 Discussion
This protocol outlines plans for a scoping review that will describe the range of research approaches used to study various forms of TM and characterize these approaches with reference to the concept of “paradigmatic alignment.” Commissioned by the WHO, the review aims to support development of a policy-relevant global TM research agenda. At once, the review’s design seeks to advance the WHO’s articulated goal of TM’s evidence-informed integration within health systems globally, while explicitly recognizing the value of traditional and Indigenous therapeutic knowledges within a biomedically-dominant therapeutic landscape. The review findings will seek to highlight methodological trends and innovations in paradigmatically aligned TM research. As such, the work will reflect demands for healthcare to be informed by the best available evidence.
The conceptual framework proposed for this review aligns well with broader trends in the biomedical context of evidence-based medicine (EBM). “A New Framework for Causal Inference in the Health and Social Sciences” (112), often referred to as EBM+ (18, 113), calls for what is increasingly termed evidential pluralism. Proponents of this framework are challenging the dominant evidentiary hierarchy, “which favor[s] probabilistic evidence from clinical trials” (18). The importance of integrating other sources of evidence, such as mechanistic studies and a broader range of quantitative and qualitative evidence, is emphasized (18, 113, 114). Although non-biomedical therapeutic paradigms are not explicitly addressed, the underlying tenets of evidential pluralism echo the perspectives of TM scholars who have similarly critiqued the limitations of biomedicine’s evidentiary hierarchy (13–15, 35). Evidential pluralism also parallels the WHO’s recognition of both “scientific” (formal) and “tacit” (informal, stakeholder-informed) forms of evidence as contextually relevant to policy making (115). Critically, the planned scoping review extends biomedical critiques of evidentiary norms to recognize the potential contributions of TM therapeutic and research paradigms—that is, their ontologies, epistemologies and practices—to the broader world of health care.
The broad, exploratory nature of the research questions, coupled with the inclusion of a wide range of disciplinary approaches to research, aims to ensure that the breadth of TM research required for clinical decision-making and policy is described. Notwithstanding this strength, the decision will present substantial logistical challenges. There are thousands of potentially eligible evidence sources that are indexed across hundreds of databases in different languages. We considered limiting the search date parameters. However, key documents such as the WHO General Guidelines for Methodologies on Research and Evaluation of Traditional Medicine (116), published in 2000, would then be excluded. Instead, other compromises are planned. Evidence sources published in languages other than English will not be identified during the first round of database searches, unless they are indexed with the searched controlled vocabulary terms (e.g., MeSH, DeCS), the title or abstract is also indexed with an English-language translation, or they are already known to the review team. Additionally, instead of conducting an exhaustive literature review, we plan to limit our analysis to only describing and characterizing the range of research approaches. Literature searching will stop when data saturation is reached. Thus, the search strategy cannot accurately quantify the frequencies of different research approaches nor to identify gaps in their application according to TM type, health care setting or region.
Operationalizing the conceptual framework is another potential challenge with the execution of this protocol. Although a similar framework was previously used in a scoping review of whole systems clinical research (13) its broader applicability is yet to be ascertained and as such, may require further modifications as the analysis proceeds. As per scoping review guidance that cautions against reviewers synthesizing or critically appraising the findings (107, 117), theoretical, iterative and synthesis methods will not be used. The review will stop short of judging, critiquing or recommending specific research approaches. Notwithstanding, the findings of this review will lay the groundwork for further studies that are designed to explore and interrogate the complexities and challenges with conducting, synthesizing and implementing TM research across global contexts.
Engaging with knowledge users throughout all stages of a literature review is another design strength (111). However, due to practical constraints, most of the knowledge users involved in this scoping review are TM researchers, many of whom reflect either the authors’ or the WHO’s academic networks. Despite efforts to achieve diverse global and disciplinary representation, there are inevitable gaps. Some of our knowledge users have dual roles as healthcare practitioners or possess broader non-TM research, health service or policy experience. However, there will only be limited, informal engagement with other key stakeholders, such as patients, communities, and practitioners who are not researchers, health service providers, and policy-makers.
Finally, the limitations of the scoping review methodology must be noted. Like other “big picture” reviews (57), scoping reviews are not designed to answer specific questions, such as which TM research approaches are most suitable or should be recommended. Instead, by describing and cataloging the range of research methods, methodologies, frameworks and strategies that have been applied or recommended the findings will provide contextual information about their potential roles in conducting paradigmatically aligned research.
Even though the planned scoping review is focused on a defined field of interest—TM research—with reference to a conceptual focus of paradigmatic alignment, its design, conceptual underpinnings, and anticipated findings may have broader relevance. As previously noted, scholars, clinicians, and decision makers in other fields face similar challenges due to intervention or system complexity, or misalignment of their therapeutic paradigm with research norms. By recognizing the value of multiple approaches to knowledge and practice, the scoping review seeks to advance scholarly insights of critical value in an increasingly pluralistic and globalized world.
Author contributions
NI: Conceptualization, Funding acquisition, Methodology, Project administration, Validation, Writing – original draft, Writing – review & editing. JH: Conceptualization, Funding acquisition, Methodology, Project administration, Validation, Writing – original draft, Writing – review & editing. SG: Validation, Writing – review & editing. KT: Project administration, Validation, Writing – review & editing.
Funding
The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This project was funded through a contract award granted by the WHO Global Traditional Medicine Centre: WHO Registration No. 2023/1375113–0.
Acknowledgments
We would like to thank our review team members for their support and expert advice: Heather Boon (Leslie Dan Faculty of Pharmacy, University of Toronto, Canada); Mariana Cabral Schveitzer (Brazilian Academic Consortium of Integrative Health; Universidade Federal de Sao Paolo, Brazil); Claudia Citkovitz (Society for Acupuncture Research); Holger Cramer (Institute of General Practice and Interprofessional Care, University of Tuebingen, Germany); Nelson Filice de Barros (Universidad Estadual de Campinas, Brazil); Mandip Goyal (Insititute of Teaching and Research in Ayurveda; Ministry of AYUSH, India); Razak Gyasi (African Population Health Research Centre, Kenya); Ted Kaptchuk (Harvard Medical School; Program in Placebo Studies and the Therapeutic Encounter, Harvard University, United States); Ossy Kasilo (Independent Researcher, Tanzania); Pakakrong Kwankhao (Center for Evidence-Based Traditional and Herbal Medicine, Chao Phya Abhaibhubejhr Hospital, Thailand); Myeong Soo Lee (Korea Institute of Oriental Medicine (KIOM), Republic of Korea); Jianping Liu (Centre for Evidence-Based Chinese Medicine, Beijing University of Chinese Medicine & Pharmacology, China); Scott Mist (Oregon Health Sciences University, United States); Francesca Panzironi (Anangu Ngangkari Tjutaku Aboriginal Corporation, Australia); Mehdi Pasalar (Research Center for Traditional Medicine and History of Medicine, Shiraz University of Medical Sciences, Iran); Rosa Schnyer (Society for Acupuncture Research, United States); Amie Steel (Australian Research Centre in Complementary and Integrative Medicine, University of Technology Sydney, Australia); Jon Wardle (National Centre for Naturopathic Medicine, Southern Cross University, Australia); Claudia Witt (Institute for Complementary and Integrative Medicine, University Hospital Zurich, Switzerland); Ursula Wolf (Institute of Complementary & Integrative Medicine, University of Bern, Switzerland); Maryam Yavari (Canadian College of Naturopathic Medicine, Canada); Tetsuhiro Yoshino (Center for Kampo Medicine, School of Medicine, Keiio University; Japanese Society for Oriental Medicine, Japan).
Conflict of interest
JH has received payments, travel and/or accommodation for providing expert advice about traditional, complementary and integrative medicine to industry, government bodies and non-government organizations. NI, JH, and SG have spoken at conferences or provided consultations for which honoraria, registration, travel and/or accommodation have been paid for by the organizers.
The remaining author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at:
References
4. World Health Organization
. Declaration of Astana World Health Organization (2018).
Google Scholar
5. Hollenberg, D, and Muzzin, L. Epistemological challenges to integrative medicine: an anti-colonial perspective on the combination of complementary/alternative medicine with biomedicine. Health Sociol Rev. (2010) 19:34–56. doi: 10.5172/hesr.2010.19.1.034
Crossref Full Text | Google Scholar
6. Guba, E, and Lincoln, Y. Epistemological and methodological bases of naturalistic inquiry. Educ Comm Technol J. (1982) 30:233–52. doi: 10.1007/BF02765185
Crossref Full Text | Google Scholar
7. Lincoln, Y, and Guba, E. Naturalistic inquiry. Newbury Park, CA: Sage Publications (1985).
Google Scholar
8. Coulter, I, Snider, P, and Neil, A. Vitalism – a worldview revisited: a critique of vitalism and its implications for naturopathic medicine. Integr Med. (2019) 18:60.
Google Scholar
9. Garland, EL, and Howard, MO. Neuroplasticity, psychosocial genomics, and the biopsychosocial paradigm in the 21st century. Health Soc Work. (2009) 34:191–9. doi: 10.1093/hsw/34.3.191
PubMed Abstract | Crossref Full Text | Google Scholar
10. Farre, A, and Rapley, T. The new old (and old new) medical model: four decades navigating the biomedical and psychosocial understandings of health and illness. Healthcare. (2017) 5:88. doi: 10.3390/healthcare5040088
PubMed Abstract | Crossref Full Text | Google Scholar
11. Ijaz, N, Welsh, S, and Boon, H. Toward a ‘green allopathy’? Naturopathic paradigm and practice in Ontario. Canada Soc Sci Med. (2022) 315:115557. doi: 10.1016/j.socscimed.2022.115557
PubMed Abstract | Crossref Full Text | Google Scholar
12. Redvers, N
. The value of global indigenous knowledge in planetary health. Challenges. (2018) 9:30. doi: 10.3390/challe9020030
Crossref Full Text | Google Scholar
13. Ijaz, N, Rioux, J, Elder, C, and Weeks, J. Whole systems research methods in health care: a scoping review. J Altern Complement Med. (2019) 25:S21–s51. doi: 10.1089/acm.2018.0499
PubMed Abstract | Crossref Full Text | Google Scholar
15. Lewith, G
. The use and abuse of evidence-based medicine: an example from general practice. Complement Ther Med. (1996) 4:144. doi: 10.1016/S0965-2299(96)80037-9
Crossref Full Text | Google Scholar
16. Harfield, S, Pearson, O, Morey, K, Kite, E, Canuto, K, Glover, K, et al. Assessing the quality of health research from an indigenous perspective: the aboriginal and Torres Strait islander quality appraisal tool. BMC Med Res Methodol. (2020) 20:79. doi: 10.1186/s12874-020-00959-3
PubMed Abstract | Crossref Full Text | Google Scholar
17. Huria, T, Palmer, SC, Pitama, S, Beckert, L, Lacey, C, Ewen, S, et al. Consolidated criteria for strengthening reporting of health research involving indigenous peoples: the CONSIDER statement. BMC Med Res Methodol. (2019) 19:173. doi: 10.1186/s12874-019-0815-8
PubMed Abstract | Crossref Full Text | Google Scholar
18. Greenhalgh, T, Fisman, D, Cane, DJ, Oliver, M, and Macintyre, CR. Adapt or die: how the pandemic made the shift from EBM to EBM+ more urgent. BMJ Evid Based Med. (2022) 27:253–60. doi: 10.1136/bmjebm-2022-111952
PubMed Abstract | Crossref Full Text | Google Scholar
19. Munn, Z, Pollock, D, Barker, TH, Stone, J, Stern, C, Aromataris, E, et al. The Pandora’s box of evidence synthesis and the case for a living evidence synthesis taxonomy. BMJ Evid Based Med. (2022) 28:148–50. doi: 10.1136/bmjebm-2022-112065
PubMed Abstract | Crossref Full Text | Google Scholar
20. Locher, C, Gaab, J, and Blease, C. When a placebo is not a placebo: problems and solutions to the gold standard in psychotherapy research. Front Psychol. (2018) 9:2317. doi: 10.3389/fpsyg.2018.02317
PubMed Abstract | Crossref Full Text | Google Scholar
21. Caspi, O, Stellhorn, C, and Connor, M. Sham in CAM: the anatomy and physiology of control and sham in complementary and alternative medicine research. Evid Based Integr Med. (2004) 1:233–40. doi: 10.2165/01197065-200401040-00002
Crossref Full Text | Google Scholar
22. Ghetti, C, Chen, X-X, and Brenner, A. Music therapy for people with substance use disorders. Cochrane Database Syst Rev. (2022) 2022:CD012576. doi: 10.1002/14651858.CD012576.pub3
PubMed Abstract | Crossref Full Text | Google Scholar
23. Kelly, JF, Humphreys, K, and Ferri, M. Alcoholics anonymous and other 12-step programs for alcohol use disorder. Cochrane Database Syst Rev. (2020) 3:CD012880. doi: 10.1002/14651858.CD012880.pub2
PubMed Abstract | Crossref Full Text | Google Scholar
24. Thomas, J, Petticrew, M, Noyes, J, Chandler, J, Rehfuess, E, Tugwell, P, et al. Chapter 17: intervention complexity. Cochrane handbook for systematic reviews of interventions version 6.4 (updated august 2023). Cochrane (2023). Available at: (Accessed December 22, 2023).
Google Scholar
25. Tamasese, K, Peteru, C, Waldegrave, C, and Bush, A. Ole Taeao Afua, the new morning: a qualitative investigation into Samoan perspectives on mental health and culturally appropriate services. Aust N Z J Psychiatry. (2005) 39:300–9. doi: 10.1080/j.1440-1614.2005.01572.x
PubMed Abstract | Crossref Full Text | Google Scholar
26. Chan-Yip, A
. Health promotion and research in the Chinese community in Montreal: a model of culturally appropriate health care. Paediatr Child Health. (2004) 9:627–9. doi: 10.1093/pch/9.9.627
PubMed Abstract | Crossref Full Text | Google Scholar
28. Wright, A, Wahoush, O, Ballantyne, M, Gabel, C, and Jack, S. Qualitative Health Research involving indigenous peoples: culturally appropriate data collection methods. Qual Rep. (2016). doi: 10.46743/2160-3715/2016.2384
Crossref Full Text | Google Scholar
29. World Trade Organization
, World intellectual property organization, World Health Organization. Promoting access to medical technologies and innovation: Intersections between public health, intellectual property and trade. 2nd ed. Geneva: World Health Organization. (2020). Available at: (Accessed September 4, 2022).
Google Scholar
30. Broom, A, Doron, A, and Tovey, P. The inequalities of medical pluralism: hierarchies of health, the politics of tradition and the economies of care in Indian oncology. Soc Sci Med. (2009) 69:698–706. doi: 10.1016/j.socscimed.2009.07.002
PubMed Abstract | Crossref Full Text | Google Scholar
31. Ding, Z, and Li, F. Publications in integrative and complementary medicine: a ten-year bibliometric survey in the field of ICM. Evid Based Complement Alternat Med. (2020) 2020:1–12. doi: 10.1155/2020/4821950
PubMed Abstract | Crossref Full Text | Google Scholar
32. Fu, J-Y, Zhang, X, Zhao, Y-H, Huang, M-H, and Chen, D-Z. Bibliometric analysis of complementary and alternative medicine research over three decades. Scientometrics. (2011) 88:617–26. doi: 10.1007/s11192-011-0391-0
Crossref Full Text | Google Scholar
33. Ma, Y, Dong, M, Zhou, K, Mita, C, Liu, J, and Wayne, P. Publication trends in acupuncture research: a 20-year bibliometric analysis based on PubMed. PLoS One. (2016) 11:e0168123. doi: 10.1371/journal.pone.0168123
Crossref Full Text | Google Scholar
34. Canaway, R, Leach, M, and Hunter, J. Setting an agenda for strengthening the evidence-base for traditional and complementary medicines: perspectives from an expert forum in Australia. Adv Integr Med. (2018) 5:103–11. doi: 10.1016/j.aimed.2018.06.002
Crossref Full Text | Google Scholar
35. Walach, H, Falkenberg, T, Fonnebo, V, Lewith, G, and Jonas, W. Circular instead of hierarchical: methodological principles for the evaluation of complex interventions. BMC Med Res Methodol. (2006) 6:1–9. doi: 10.1186/1471-2288-6-29
Crossref Full Text | Google Scholar
36. Saini, M
. A systematic review of western and aboriginal research designs: assessing cross-validation to explore compatibility and convergence. Natl Collab Cent Aborig Health. Prince George, BC: National Collaborating Centre for Aboriginal Health. (2012):1–24.
Google Scholar
37. Bian, Z, Liu, B, Moher, D, Wu, T, Li, Y, Shang, H, et al. Consolidated standards of reporting trials (CONSORT) for traditional Chinese medicine: current situation and future development. Front Med. (2011) 5:171–7. doi: 10.1007/s11684-011-0132-z
Crossref Full Text | Google Scholar
38. Dorsher, PT
. The 2001 STRICTA recommendations for reporting acupuncture research: a review with implications for improving controlled clinical trial design. J Altern Complement Med. (2009) 15:147–51. doi: 10.1089/acm.2008.0141
PubMed Abstract | Crossref Full Text | Google Scholar
39. MacPherson, H, Altman, DG, Hammerschlag, R, Youping, L, Taixiang, W, White, A, et al. Group on behalf of the SR. revised STandards for reporting interventions in clinical trials of acupuncture (STRICTA): extending the CONSORT statement. PLoS Med. (2010) 7:e1000261. doi: 10.1371/journal.pmed.1000261
PubMed Abstract | Crossref Full Text | Google Scholar
40. Collaborators, WCM, Aickin, M, Cherkin, D, Che, CT, Elder, C, Flower, A, et al. Effectiveness guidance document (EGD) for Chinese medicine trials: a consensus document. Trials. (2014) 15:169. doi: 10.1186/1745-6215-15-169
PubMed Abstract | Crossref Full Text | Google Scholar
41. Zhang, X, Tan, R, Lam, WC, Yao, L, Wang, X, Cheng, CW, et al. PRISMA (preferred reporting items for systematic reviews and Meta-analyses) extension for Chinese herbal medicines 2020 (PRISMA-CHM 2020). Am J Chin Med. (2020) 48:1279–313. doi: 10.1142/s0192415x20500639
PubMed Abstract | Crossref Full Text | Google Scholar
42. Hunter, J, Arentz, S, Goldenberg, J, Yang, G, Beardsley, J, Lee, MS, et al. Choose your shortcuts wisely: COVID-19 rapid reviews of traditional, complementary and integrative medicine. Integr Med Res. (2020) 9:100484. doi: 10.1016/j.imr.2020.100484
PubMed Abstract | Crossref Full Text | Google Scholar
43. Pinto, JW, Bradbury, K, Newell, D, and Bishop, FL. Lifestyle and health behavior change in traditional acupuncture practice: a systematic critical interpretive synthesis. J Altern Complement Med N Y N. (2021) 27:238–54. doi: 10.1089/acm.2020.0365
PubMed Abstract | Crossref Full Text | Google Scholar
44. Hilton, L, Elfenbaum, P, Jain, S, Sprengel, M, and Jonas, WB. Evaluating integrative Cancer clinics with the claim assessment profile: an example with the InspireHealth clinic. Integr Cancer Ther. (2018) 17:106–14. doi: 10.1177/1534735416684017
PubMed Abstract | Crossref Full Text | Google Scholar
45. Skovgaard, L, Bjerre, L, Haahr, N, Paterson, C, Launsø, L, Boesen, F, et al. An investigation of multidisciplinary complex health care interventions – steps towards an integrative treatment model in the rehabilitation of people with multiple sclerosis. BMC Complement Altern Med. (2012) 12:50. doi: 10.1186/1472-6882-12-50
PubMed Abstract | Crossref Full Text | Google Scholar
46. Li, H, Lam, WC, Guo, J, Zheng, J, Cheung, CH, Bian, Z, et al. A framework on developing integrative medicine clinical practice guideline for stroke management and rehabilitation in Hong Kong. Phytomed Int J Phytother Phytopharm. (2022) 106:154442. doi: 10.1016/j.phymed.2022.154442
Crossref Full Text | Google Scholar
47. Graham, KD, Steel, A, and Wardle, J. Primary health care case management through the lens of complexity: an exploratory study of naturopathic practice using complexity science principles. BMC Complement Med Ther. (2022) 22:107. doi: 10.1186/s12906-022-03585-2
PubMed Abstract | Crossref Full Text | Google Scholar
48. Dodds, SE, Herman, PM, Sechrest, L, Abraham, I, Logue, MD, Grizzle, AL, et al. When a whole practice model is the intervention: developing Fidelity evaluation components using program theory-driven science for an integrative medicine primary care clinic. Evid Based Complement Alternat Med. (2013) 2013:1–11. doi: 10.1155/2013/652047
Crossref Full Text | Google Scholar
50. Guangle, Y, Lei, Z, and Shibing, S. Application of theories and methods of systems science to the study of the complexity of traditional Chinese medicine. World Sci Technol. (2010) 12:15–9. doi: 10.1016/S1876-3553(11)60006-9
Crossref Full Text | Google Scholar
51. Yuan, Z, Pan, Y, Leng, T, Chu, Y, Zhang, H, Ma, J, et al. Progress and prospects of research ideas and methods in the network pharmacology of traditional Chinese medicine. J Pharm Pharm Sci. (2022) 25:218–26. doi: 10.18433/jpps32911
PubMed Abstract | Crossref Full Text | Google Scholar
52. Zhang, R, Zhu, X, Bai, H, and Ning, K. Network pharmacology databases for traditional Chinese medicine: review and assessment. Front Pharmacol. (2019) 10:123. doi: 10.3389/fphar.2019.00123
PubMed Abstract | Crossref Full Text | Google Scholar
53. Ijaz, N
. Paradigm-specific risk conceptions, patient safety, and the regulation of traditional and complementary medicine practitioners: the case of homeopathy in Ontario, Canada. Front Sociol. (2020) 4:89. doi: 10.3389/fsoc.2019.00089
PubMed Abstract | Crossref Full Text | Google Scholar
54. Ijaz, N, Boon, H, Muzzin, L, and Welsh, S. State risk discourse and the regulatory preservation of traditional medicine knowledge: the case of acupuncture in Ontario, Canada. Soc Sci Med. (2016) 170:97–105. doi: 10.1016/j.socscimed.2016.08.037
PubMed Abstract | Crossref Full Text | Google Scholar
55. Khalil, H, and Tricco, AC. Differentiating between mapping reviews and scoping reviews in the evidence synthesis ecosystem. J Clin Epidemiol. (2022) 149:175–82. doi: 10.1016/j.jclinepi.2022.05.012
PubMed Abstract | Crossref Full Text | Google Scholar
56. Peters, MDJ, Godfrey, C, McInerney, P, Munn, Z, Tricco, AC, and Khalil, H. Chapter 11: scoping reviews (2020 version). In: JBI Manual for Evidence Synthesis. E Aromataris and Z Munn, editors. JBI manual for evidence synthesis : JBI (2020)
Google Scholar
57. Campbell, F, Tricco, AC, Munn, Z, Pollock, D, Saran, A, Sutton, A, et al. Mapping reviews, scoping reviews, and evidence and gap maps (EGMs): the same but different— the “big picture” review family. Syst Rev. (2023) 12:45. doi: 10.1186/s13643-023-02178-5
PubMed Abstract | Crossref Full Text | Google Scholar
58. Hunter, J, Ijaz, N, Grant, S, and Templeman, K. Protocol for a scoping review of traditional medicine research methods, methodologies, frameworks and strategies. INPLASY. (2023). doi: 10.37766/inplasy2023.11.0071
Crossref Full Text | Google Scholar
59. Peters, MDJ, Godfrey, C, McInerney, P, Khalil, H, Larsen, P, Marnie, C, et al. Best practice guidance and reporting items for the development of scoping review protocols. JBI Evid Synth. (2022) 20:953–68. doi: 10.11124/JBIES-21-00242
PubMed Abstract | Crossref Full Text | Google Scholar
60. Shamseer, L, Moher, D, Clarke, M, Ghersi, D, Liberati, A, Petticrew, M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. (2015) 349:g7647. doi: 10.1136/bmj.g7647
PubMed Abstract | Crossref Full Text | Google Scholar
62. Andrews, JC, Schünemann, HJ, Oxman, AD, Pottie, K, Meerpohl, JJ, Coello, PA, et al. GRADE guidelines: 15. Going from evidence to recommendation—determinants of a recommendation’s direction and strength. J Clin Epidemiol. (2013) 66:726–35. doi: 10.1016/j.jclinepi.2013.02.003
PubMed Abstract | Crossref Full Text | Google Scholar
63. Hunter, J, Leach, M, Braun, L, and Bensoussan, A. An interpretive review of consensus statements on clinical guideline development and their application in the field of traditional and complementary medicine. BMC Complement Altern Med. (2017) 17:116. doi: 10.1186/s12906-017-1613-7
PubMed Abstract | Crossref Full Text | Google Scholar
64. Committee on the Framework for Evaluating the Safety of Dietary Supplements
. Dietary supplements: a framework for evaluating safety. Washington, DC: National Academies Press (2005).
Google Scholar
65. Drawson, AS, Toombs, E, and Mushquash, CJ. Indigenous research methods: a systematic review. Int Indig Policy J. (2017) 8:1–27. doi: 10.18584/iipj.2017.8.2.5
Crossref Full Text | Google Scholar
66. Rn, CMG, MBH, Rn, Graham, ID, and Mlis, AR-W. Utilisation of theoretical models and frameworks in the process of evidence synthesis. (2010) 8:730–51. doi: 10.11124/01938924-201008180-00001
Crossref Full Text | Google Scholar
67. Marshall, M, Marshall, A, and Bartlett, C. Two-Eyed Seeing in Medicine. In: Determinants of indigenous peoples’ health: Beyond the social. Canadian Scholars. (2018).
Google Scholar
68. Kuhn, TS
. The structure of scientific revolutions. 2nd ed. Chicago: University of Chicago Press (1994).
Google Scholar
69. Buergelt, PT, Mahypilama, LE, and Paton, D. The value of sophisticated indigenous ways of being-knowing-doing towards transforming human resource development in ways that contribute to organizations thriving and addressing our existential crises. Hum Resour Dev Rev. (2022) 21:391–409. doi: 10.1177/15344843221134351
Crossref Full Text | Google Scholar
70. Fleming, C, Young, S, Else, J, Hammond, L, and McLaren, H. A yarn among social workers: knowing, being, and doing social work learning, expertise, and practice. Aust Soc Work. (2023) 76:330–42. doi: 10.1080/0312407X.2023.2199424
Crossref Full Text | Google Scholar
71. Richardson, B
. Recognising practice epistemology in the health professions In: Developing practice knowledge for health professionals : Elsevier (2004). 1–14. doi: 10.1016/B978-0-7506-5429-6.50004-5
Crossref Full Text | Google Scholar
72. Higgs, J
. Practice knowledge—its nature, sources and contexts In: Developing practice knowledge for health professionals. New York: Elsevier (2004). 51–69.
Google Scholar
73. Luz, MT
. Contribution of the concept of medical rationality to the field of health: comparative studies of medical systems and therapeutic practices In: Racionalidades médicas e práticas integrativas em saúde: estudos teóricos e empíricos. Coleção Clássicos para integralidade em saúde. Rio de Janeiro: CEPESC/IMS-UERJ/ABRASCO (2012)
Google Scholar
74. Smith, FM, and Wujastyk, D. Introduction In: Modern and global Ayurveda: pluralism and paradigms. Albany, NY: State University of New York Press (2008). 1–28.
Google Scholar
75. He, M, Yang, H, Thomas, S, Browning, C, Searle, K, Lu, W, et al. Paradigm evolution of the traditional Chinese medicine and its application in international community. Ann Community Med Pr. (2015) 1:1007. doi: 10.47739/2475-9465/1007
Crossref Full Text | Google Scholar
76. Roher, SIG, Yu, Z, Martin, DH, and Benoit, AC. How is Etuaptmumk/two-eyed seeing characterized in indigenous health research? A scoping review. PLoS One. (2021) 16:e0254612. doi: 10.1371/journal.pone.0254612
PubMed Abstract | Crossref Full Text | Google Scholar
78. Ijaz, N
. The reluctant and the envious: therapeutic subalternity and the practice of homeopathy in North America. Soc Sci Med. (2022) 311:115310. doi: 10.1016/j.socscimed.2022.115310
PubMed Abstract | Crossref Full Text | Google Scholar
79. de Sousa, SB, Nunes, JA, and Meneses, MP. Introduction: opening up the canon of knowledge and recognition of difference In: Another knowledge is possible: beyond northern epistemologies. London, NY: Verso (1996)
Google Scholar
80. Cassidy, CM
. Social science theory and methods in the study of alternative and complementary medicine. J Altern Complement Med. (1995) 1:19–40. doi: 10.1089/acm.1995.1.19
Crossref Full Text | Google Scholar
81. Jonas, WB, and Linde, K. Conducting and evaluating clinical research on complementary and alternative medicine. Princ Pract Clin Res Elsevier. (2002):401–26. doi: 10.1016/B978-012274065-7/50026-5
Crossref Full Text | Google Scholar
82. Khorsan, R, and Crawford, C. External validity and model validity: a conceptual approach for systematic review methodology. Evid Based Complement Alternat Med. (2014) 2014:694804:1–12. doi: 10.1155/2014/694804
PubMed Abstract | Crossref Full Text | Google Scholar
83. Mathie, R, Roniger, H, van Wassenhoven, M, Frye, J, Jacobs, J, Oberbaum, M, et al. Method for appraising model validity of randomised controlled trials of homeopathic treatment: multi-rater concordance study. BMC Med Res Methodol. (2012) 12:1–9. doi: 10.1186/1471-2288-12-49
Crossref Full Text | Google Scholar
84. Verhoef, MJ, Lewith, G, Ritenbaugh, C, Boon, H, Fleishman, S, and Leis, A. Complementary and alternative medicine whole systems research: beyond identification of inadequacies of the RCT. Complement Ther Med. (2005) 13:206–12. doi: 10.1016/j.ctim.2005.05.001
PubMed Abstract | Crossref Full Text | Google Scholar
85. Zhou, X, Seto, SW, Chang, D, Kiat, H, Razmovski-Naumovski, V, Chan, K, et al. Synergistic effects of Chinese herbal medicine: a comprehensive review of methodology and current research. Front Pharmacol. (2016) 7:201. doi: 10.3389/fphar.2016.00201
PubMed Abstract | Crossref Full Text | Google Scholar
86. Yang, H-Y, Liu, M-L, Luo, P, Yao, X-S, and Zhou, H. Network pharmacology provides a systematic approach to understanding the treatment of ischemic heart diseases with traditional Chinese medicine. Phytomedicine. (2022) 104:154268. doi: 10.1016/j.phymed.2022.154268
PubMed Abstract | Crossref Full Text | Google Scholar
87. Noor, F, Tahir Ul Qamar, M, Ashfaq, UA, Albutti, A, Alwashmi, ASS, and Aljasir, MA. Network pharmacology approach for medicinal plants: review and assessment. Pharmaceuticals. (2022) 15:572. doi: 10.3390/ph15050572
PubMed Abstract | Crossref Full Text | Google Scholar
88. Packer, J, Turpin, G, Ens, E, Venkataya, B, Hunter, J, Mbabaram, C, et al. Building partnerships for linking biomedical science with traditional knowledge of customary medicines: a case study with two Australian indigenous communities. J Ethnobiol Ethnomed. (2019) 15:69. doi: 10.1186/s13002-019-0348-6
PubMed Abstract | Crossref Full Text | Google Scholar
89. Shi, N, Zhong, LLD, Han, X, Ziea, TC, Ng, B, Bian, Z, et al. Enhanced evidence-based Chinese medicine clinical practice guidelines in Hong Kong: a study protocol for three common diseases. Evid Based Complement Alternat Med. (2015) 2015:482706:1–7. doi: 10.1155/2015/482706
PubMed Abstract | Crossref Full Text | Google Scholar
91. Hunter, J, Harnett, JE, Chan, W-JJ, and Pirotta, M. What is integrative medicine? Establishing the decision criteria for an operational definition of integrative medicine for general practice health services research in Australia. Integr Med Res. (2023) 12:100995. doi: 10.1016/j.imr.2023.100995
PubMed Abstract | Crossref Full Text | Google Scholar
92. Brosnan, C, and Cribb, A. Professional identity and epistemic stress: complementary medicine in the academy. Health Sociol Rev. (2019) 28:307–22. doi: 10.1080/14461242.2019.1678397
Crossref Full Text | Google Scholar
93. Hollenberg, D
. Uncharted ground: patterns of professional interaction among complementary/alternative and biomedical practitioners in integrative health care settings. Soc Sci Med. (2006) 62:731–44. doi: 10.1016/j.socscimed.2005.06.030
PubMed Abstract | Crossref Full Text | Google Scholar
94. Leach, MJ, and Veziari, Y. Enablers and barriers to evidence implementation in complementary medicine: a systematic review. Integr Med Res. (2022) 11:100899. doi: 10.1016/j.imr.2022.100899
PubMed Abstract | Crossref Full Text | Google Scholar
95. Ng, JY, Dhawan, T, Dogadova, E, Taghi-Zada, Z, Vacca, A, Fajardo, R-G, et al. A comprehensive search string informed by an operational definition of complementary, alternative, and integrative medicine for systematic bibliographic database search strategies. BMC Complement Med Ther. (2022) 22:200. doi: 10.1186/s12906-022-03683-1
PubMed Abstract | Crossref Full Text | Google Scholar
96. Kolb, SM
. Grounded theory and the constant comparative method: valid research strategies for educators. J Emerg Trends Educ Res Policy Stud. (2012) 3:83. doi: 10.10520/EJC135409
Crossref Full Text | Google Scholar
97. Zwakman, M, Verberne, LM, Kars, MC, Hooft, L, van Delden, JJM, and Spijker, R. Introducing PALETTE: an iterative method for conducting a literature search for a review in palliative care. BMC Palliat Care. (2018) 17:82. doi: 10.1186/s12904-018-0335-z
PubMed Abstract | Crossref Full Text | Google Scholar
98. Wohlin, C, Kalinowski, M, Romero Felizardo, K, and Mendes, E. Successful combination of database search and snowballing for identification of primary studies in systematic literature studies. Inf Softw Technol. (2022) 147:106908. doi: 10.1016/j.infsof.2022.106908
Crossref Full Text | Google Scholar
100. Greenhalgh, T, and Peacock, R. Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. BMJ. (2005) 331:1064–5. doi: 10.1136/bmj.38636.593461.68
PubMed Abstract | Crossref Full Text | Google Scholar
101. Koster, J. PubMed PubReMiner. Journal of the Canadian Health Libraries Association / Journal de l’Association Des Bibliothèques de La Santé Du Canada. (2014) 33:106. doi: 10.5596/c2012-014
Crossref Full Text | Google Scholar
104. Garritty, C, Gartlehner, G, Nussbaumer-Streit, B, King, VJ, Hamel, C, Kamel, C, et al. Cochrane rapid reviews methods group offers evidence-informed guidance to conduct rapid reviews. J Clin Epidemiol. (2021) 130:13–22. doi: 10.1016/j.jclinepi.2020.10.007
PubMed Abstract | Crossref Full Text | Google Scholar
105. Rampin, R, and Rampin, V. Taguette: open-source qualitative data analysis. J Open Source Softw. (2021) 6:3522. doi: 10.21105/joss.03522
Crossref Full Text | Google Scholar
107. Pollock, D, Peters, MDJ, Khalil, H, McInerney, P, Alexander, L, Tricco, AC, et al. Recommendations for the extraction, analysis, and presentation of results in scoping reviews. JBI Evid Synth. (2023) 21:520–32. doi: 10.11124/JBIES-22-00123
Crossref Full Text | Google Scholar
108. Moran-Ellis, J, Alexander, VD, Cronin, A, Dickinson, M, Fielding, J, Sleney, J, et al. Triangulation and integration: processes, claims and implications. Qual Res. (2006) 6:45–59. doi: 10.1177/1468794106058870
Crossref Full Text | Google Scholar
109. Vaismoradi, M, Turunen, H, and Bondas, T. Content analysis and thematic analysis: implications for conducting a qualitative descriptive study. Nurs Health Sci. (2013) 15:398–405. doi: 10.1111/nhs.12048
Crossref Full Text | Google Scholar
110. Braun, V, and Clarke, V. Using thematic analysis in psychology. Qual Res Psychol. (2006) 3:77–101. doi: 10.1191/1478088706qp063oa
Crossref Full Text | Google Scholar
111. Pollock, D, Alexander, L, Munn, Z, Peters, MDJ, Khalil, H, Godfrey, CM, et al. Moving from consultation to co-creation with knowledge users in scoping reviews: guidance from the JBI scoping review methodology group. JBI Evid Synth. (2022) 20:969–79. doi: 10.11124/jbies-21-00416
PubMed Abstract | Crossref Full Text | Google Scholar
113. Shan, Y, and Williamson, J. Applying evidential pluralism to the social sciences. Eur J Philos Sci. (2021) 11:96. doi: 10.1007/s13194-021-00415-z
Crossref Full Text | Google Scholar
114. Williamson, J
. Establishing causal claims in medicine. Int Stud Philos Sci. (2019) 32:33–61. doi: 10.1080/02698595.2019.1630927
Crossref Full Text | Google Scholar
116. World Health Organization
. General guidelines for methodologies on research and evaluation of traditional medicine. Geneva: World Health Organization (2000).
Google Scholar
117. Peters, MDJ, Marnie, C, Tricco, AC, Pollock, D, Munn, Z, Alexander, L, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evid Synth. (2020) 18:2119–26. doi: 10.11124/JBIES-20-00167
Crossref Full Text | Google Scholar
link