Skip to main content

Clinical trials comparing norepinephrine with vasopressin in patients with septic shock: a meta-analysis

Abstract

Background

The effect of norepinephrine in patients with septic shock remains controversial. We conducted a meta-analysis to compare the mortality rates and benefits of norepinephrine and vasopressin.

Methods

PubMed, EMBASE, and the Cochrane Library database were searched from database inception to December 2013. We selected randomized controlled trials in adults with septic shock and compared norepinephrine with vasopressin. After assessing the heterogeneity of treatment effects across trials using the I2 statistic, we used a fixed effects model (P ≥ 0.1) and expressed the results as risk ratios (RRs) for dichotomous outcomes or as standardized mean differences (SMDs) for continuous data with 95% confidence intervals (CIs). Meta-analysis was conducted using Review Manager 5.1 software.

Results

Seven trials (n = 2323) met the inclusion criteria. Overall, the mortality rate in these seven trials was 36.2% (840/2323). There was no difference in mortality following the use of norepinephrine or vasopressin (RR 1.07; 95%CI 0.97-1.20; P = 0.19). Compared to norepinephrine, vasopressin had no significant effect on heart rate (HR) (SMD 0.21; 95%CI −0.08-0.50; P = 0.15), mean arterial pressure (MAP) (SMD 0.15; 95%CI −0.15-0.44; P = 0.33), cardiac index (CI) (SMD −0.10; 95%CI −0.64-0.44; P = 0.73), systemic vascular resistance index (SVRI) (SMD 0.15; 95%CI −0.39-0.70; P = 0.58), oxygen delivery (DO2) (SMD −0.06; 95%CI −0.62-0.49; P = 0.82), oxygen consumption (VO2) (SMD 0.03; 95%CI −0.52-0.59; P = 0.91) or lactic acid (SMD 0.07; 95%CI −0.23-0.36; P = 0.66). No significant heterogeneity was found in these comparisons (P ≥ 0.1).

Conclusions

There is not sufficient evidence to prove conclusively that norepinephrine is superior to vasopressin in terms of mortality and hemodynamics. The effects of norepinephrine and vasopressin on patients with septic shock require further study in large randomized controlled trials.

Background

Septic shock is one of the most challenging medical problems, and severe sepsis accounts for 20% of all admissions to intensive care units (ICUs), including 750,000 cases annually in the United States, with a mortality rate ranging from 28% to 50% [1, 2]. The initial goal-directed resuscitation for septic shock typically includes the administration of intravenous fluids and vasopressors. Although norepinephrine is commonly used and is the recommended agent for the treatment of hypotension in volume-resuscitated hyperdynamic septic shock [3], the effect of norepinephrine on patient-relevant outcomes remains controversial. Recent evidence from a large-scale study revealed that there was no significant difference in the mortality rate between patients with septic shock who were treated with dopamine as the first-line vasopressor agent and those who were treated with norepinephrine [4].

Vasopressin is an endogenously released hormone that has recently emerged as an adjunct to catecholamines for patients with septic shock requiring vasopressor support [5]. When compared with norepinephrine, a study has shown that vasopressin treatment in septic shock is associated with a significant reduction in heart rate but no change in cardiac output or other measures of perfusion [6]. Daley et al. revealed that vasopressin was not inferior to norepinephrine for the achievement of a mean arterial pressure (MAP) goal within the first 6 hours following the onset of septic shock [7]. In another study, Russell et al. demonstrated that low-dose vasopressin did not reduce mortality rates when compared with norepinephrine among patients with septic shock who were treated with catecholamine vasopressors [8].

Due to the continuing controversy regarding whether norepinephrine is superior to vasopressin, we performed a meta-analysis to attempt to determine whether norepinephrine is more effective than vasopressin in reducing overall mortality and improving hemodynamics in septic shock.

Methods

We performed this meta-analysis following the recommendations of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA statement) guidelines [9].

Eligibility criteria and information sources

We searched for literature in the PubMed (US National Library of Medicine, Bethesda, MD, USA), EMBASE and Cochrane Library databases from database inception to December 2013. The article types were primarily limited to randomized controlled trials (RCTs) that included patients aged older than 18 years. We also scanned the bibliographies of all relevant studies and recent review articles to identify additional citations.

Search strategy

We used medical subject heading (MeSH) terms and text words with a Boolean strategy. Cross-searching was performed based on the following 2 categories: (1) different vasopressors (“norepinephrine” OR “vasopressin”); (2) disease (“sepsis” OR “infection” OR “septic shock” OR “shock” OR “systemic inflammatory response syndrome” OR “SIRS”). The limits placed on the literature searches were “human” and “English”.

Study selection

The study selection was performed by two independent investigators (F.Z. and Q.S.). Studies that compared mortality between norepinephrine and vasopressin use in patients (aged ≥18 years) with septic shock were evaluated and included.

Data extraction

Raw data were extracted using a standard form for each study, which included the study design, year of publication, total number of patients, and patient characteristics. The main endpoint was 28-day mortality. If mortality was assessed at several time points or only at an undetermined time point in a study, we used data from the last follow-up or the only undetermined time point.

Quality assessment

The quality of each study included in the meta-analysis was assessed using the Jadad score [10], including the proper conduct of randomization, concealment of treatment allocation, similarity of treatment groups at baseline, clinician blinding, and the description of withdrawals and dropouts.

Statistical analysis

Statistical analyses were performed using Review Manager, version 5.1 (RevMan, The Cochrane Collaboration, Oxford, the United Kingdom). After assessing for the heterogeneity of treatment effects across trials using the I2 statistic [11], we used a fixed effects model (P ≥ 0.1). The results were expressed as risk ratios (RRs) for dichotomous outcomes or standardized mean differences (SMDs) for continuous data with 95% confidence intervals (CIs), and P < 0.05 was considered significant. Publication bias was assessed using funnel plots.

Results

Study selection

A total of 1995 studies were identified. We retrieved 35 articles for detailed evaluation, of which 28 were excluded (Figure 1). Seven trials (2323 patients) met the criteria for inclusion [7, 8, 1216]. All studies compared the effects of norepinephrine and vasopressin in patients with septic shock using a primary outcome such as survival, hemodynamics, or acute physiology and chronic health evaluation (APACHE) II score (Table 1).

Figure 1
figure 1

Quorum chart of the study cohort. The search was conducted using the PubMed, EMBASE, and Cochrane Library databases from database inception to December 2013.

Table 1 Characteristics of the included trials

Study characteristics

Five multicenter studies [8, 1214, 16] and two single-center studies [7, 15] were identified. The characteristics of the included trials are shown in Table 1. These trials were reported between 2006 and 2013, and the mean age of the study participants ranged between 54.7 and 62.8 years. The proportion of men ranged from 53.1% to 61.1%. The mean APACHE II score was between 23.2 and 27.8. All patients with sepsis or septic shock were diagnosed according to the American College of Chest Physicians/Society of Critical Care Medicine Consensus Conference criteria [17].

Risk of bias within studies

Six of the citations included [8, 1216] were randomized controlled trials, and one was a cohort study [7]. Blinding was performed in four studies [8, 1214]. The mean Jadad score of the six randomized controlled trials was 4 (Table 2).

Table 2 Quality assessment of the six randomized controlled trials included in the meta-analysis

Effect of norepinephrine versus vasopressin on mortality

The mortality rate in the seven trials was 36.2% (840/2323). No difference in mortality was identified when comparing norepinephrine and vasopressin (RR 1.07; 95%CI 0.97-1.20; P = 0.19). No significant heterogeneity was found in this comparison (I2 = 0%, P = 0.51) and the fixed effects model was used (Figure 2). Because one trial [7] was a cohort study, we also performed a meta-analysis of the other six trials [8, 1216]. Similarly, no difference in mortality was found when comparing these two groups (RR 1.07; 95%CI 0.96-1.20; P = 0.22; I2 = 5%, P = 0.39).

Figure 2
figure 2

Risk ratio of mortality for norepinephrine versus vasopressin. Pooled risk ratios (RRs) were obtained using a fixed effects model; CI indicates the confidence interval; The size of the data markers indicates the weight of the study.

Effect of norepinephrine versus vasopressin on hemodynamic and metabolic parameters

Compared to norepinephrine, vasopressin had no significant effect on heart rate (HR) (SMD 0.21; 95%CI −0.08-0.50; P = 0.15), MAP (SMD 0.15; 95%CI −0.15-0.44; P = 0.33), cardiac index (CI) (SMD −0.10; 95%CI −0.64-0.44; P = 0.73), systemic vascular resistance index (SVRI) (SMD 0.15; 95%CI −0.39-0.70; P = 0.58), oxygen delivery (DO2) (SMD −0.06; 95%CI −0.62-0.49; P = 0.82), oxygen consumption (VO2) (SMD 0.03; 95%CI −0.52-0.59; P = 0.91) or lactic acid (SMD, 0.07; 95%CI −0.23-0.36; P = 0.66). No significant heterogeneity was found in these comparisons (P ≥ 0.1, Figure 3).

Figure 3
figure 3

Effect of norepinephrine versus vasopressin on hemodynamic and metabolic parameters. HR, heart rate; MAP, mean arterial pressure; CI, cardiac index; SVRI, systemic vascular resistance index; DO2, oxygen delivery; VO2, oxygen consumption; MPAP, mean pulmonary arterial pressure; SMD, standardized mean difference; CI, confidence interval; IV, inverse variance method.

Publication bias analyses

Publication bias was evaluated using a funnel plot, and the primary comparisons of mortality are presented. The funnel plots of this primary outcome did not suggest major asymmetry, indicating no significant publication bias (Figure 4).

Figure 4
figure 4

Assessment of publication bias using a funnel plot.

Discussion

Seven trials including 2323 patients with septic shock that compared the use of norepinephrine to vasopressin were identified and included in this review. The main results revealed that the survival of patients treated with norepinephrine was not significantly different from those treated with vasopressin. Furthermore, there was also no evidence indicating that norepinephrine is superior to vasopressin in improving hemodynamics.

Vasopressors should be initiated in patients with septic shock if fluid resuscitation fails to restore adequate arterial pressure and organ perfusion, and the effects of vasopressors differ based on the targeted adrenergic receptors, resulting in heterogeneity of their physiological effects [18]. Although both dopamine and norepinephrine are recommended as first-line vasopressor agents in the treatment of septic shock [3], vasopressin, which is a peptide hormone released by the pituitary in response to decreased intravascular volume, has been used in patients with septic shock [18, 19]. In a multi-center double-blind randomized controlled trial of vasopressin versus norepinephrine in adult patients who had septic shock, Gordon et al. revealed that patients with septic shock who were at risk of kidney injury had reduced progression to renal failure and reduced 28-day mortality when treated with vasopressin in comparison to those treated with norepinephrine [13]. However, our meta-analysis did not find a significant difference in mortality between norepinephrine and vasopressin, which was consistent with more recent randomized clinical trials [8, 15, 16]. It is likely that no single pressor has been definitively shown to have a mortality benefit over another in patients with septic shock. It is possible that a continuous infusion of low-dose vasopressin, when given as first-line vasopressor agent in septic shock, is effective in reversing sepsis-induced arterial hypotension and reducing norepinephrine requirements.

For septic patients, once the inflammatory response has been induced, a marked decrease in the SVRI results from arterial and venous dilation, which is accompanied by leakage of plasma into the extravascular space, leading to relative hypovolemia [20]. Recent randomized clinical trials demonstrated that survivors of septic shock had greater decreases in cytokines, chemokines and growth factors in early septic shock. Furthermore, vasopressin decreased 24-hour plasma cytokine levels more than did norepinephrine [12]. In the present study, we compared norepinephrine to vasopressin and found no significant differences in HR, MAP, CI, or SVRI. This was not consistent with a previous trial [16], in which vasopressin was reported to increase the SVRI and decrease the CI when compared with baseline, whereas norepinephrine did not [16]. The hemodynamic impact of norepinephrine on the treatment of septic shock compared to vasopressin, however, requires further evaluation in randomized clinical trials.

For patients with septic shock, it is imperative to restore adequate perfusion pressure and oxygen delivery. It is evident that inadequate systemic hemodynamics, i.e., systemic DO2 and VO2, can impair splanchnic blood flow and oxygenation [21]. Although increased renal circulation and splanchnic blood flow have been reported in cases of hyperdynamic septic shock treated with norepinephrine [2224], no significant differences in DO2, VO2 or lactate were found between norepinephrine and vasopressin in our meta-analysis. Because one of the rationales for catecholamine administration in septic patients is to increase DO2 due to the relationship between DO2 and VO2[25], norepinephrine may therefore be questionable as a preferential treatment when compared with vasopressin in this context.

There are some limitations to this meta-analysis. First, although the mean Jadad score of the included trials was 4, indicating that most of the trials were of high quality, one cohort study was included in this meta-analysis, which may limit the strength of the analysis. Second, although seven trials were included in the analysis, the actual sample size for specific comparisons in subgroup analyses was small, and publication bias was only evaluated using a funnel plot with seven studies, which may have affected the findings. The effects of norepinephrine and vasopressin in patients with septic shock require further evaluation in large-scale randomized controlled trials.

Conclusions

In conclusion, pooled results of seven trials show that there is not sufficient evidence to prove conclusively that norepinephrine is superior to vasopressin in terms of mortality and hemodynamics. The effects of norepinephrine and vasopressin on patients with septic shock require further study in large randomized controlled trials.

Author contributions

All authors had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. FZ is the overall coordinator of the study, and his work included the study design, acquisition of data, analysis and interpretation of data, drafting of the manuscript, statistical analysis, and critical revision of the manuscript for important intellectual content. The work that QS performed included the acquisition of data, analysis and interpretation of data, and statistical analysis. Both authors read and approved the final manuscript.

Abbreviations

ICU:

Intensive care unit

RCTs:

Randomized controlled trials

MeSH:

Medical subject heading

CI:

Confidence interval

HR:

Heart rate

MAP:

Mean arterial pressure

CI:

Cardiac index

SVRI:

Systemic vascular resistance index

MPAP:

Mean pulmonary arterial pressure

SMD:

Standardized mean difference

IV:

Inverse variance.

References

  1. Levy MM, Dellinger RP, Townsend SR, Linde-Zwirble WT, Marshall JC, Bion J, Schorr C, Artigas A, Ramsay G, Beale R, Parker MM, Gerlach H, Reinhart K, Silva E, Harvey M, Regan S, Angus DC: Surviving Sepsis Campaign: The surviving sepsis campaign: results of an international guideline-based performance improvement program targeting severe sepsis. Crit Care Med. 2010, 38: 367-374. 10.1097/CCM.0b013e3181cb0cdc.

    Article  PubMed  Google Scholar 

  2. Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR: Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001, 29: 1303-1310. 10.1097/00003246-200107000-00002.

    Article  CAS  PubMed  Google Scholar 

  3. Dellinger RP, Levy MM, Carlet JM, Bion J, Parker MM, Jaeschke R, Reinhart K, Angus DC, Brun-Buisson C, Beale R, Calandra T, Dhainaut JF, Gerlach H, Harvey M, Marini JJ, Marshall J, Ranieri M, Ramsay G, Sevransky J, Thompson BT, Townsend S, Vender JS, Zimmerman JL, Vincent JL: International Surviving Sepsis Campaign Guidelines Committee; American Association of Critical-Care Nurses; American College of Chest Physicians; American College of Emergency Physicians; Canadian Critical Care Society; European Society of Clinical Microbiology and Infectious Diseases; European Society of Intensive Care Medicine; European Respiratory Society; International Sepsis Forum; Japanese Association for Acute Medicine; Japanese Society of Intensive Care Medicine; Society of Critical Care Medicine; Society of Hospital Medicine; Surgical Infection Society; World Federation of Societies of Intensive and Critical Care Medicine: Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock: 2008. Crit Care Med. 2008, 36: 296-327. 10.1097/01.CCM.0000298158.12101.41.

    Article  PubMed  Google Scholar 

  4. De Backer D, Biston P, Devriendt J, Madl C, Chochrad D, Aldecoa C, Brasseur A, Defrance P, Gottignies P, Vincent JL: SOAP II Investigators: Comparison of dopamine and norepinephrine in the treatment of shock. N Engl J Med. 2010, 362: 779-789. 10.1056/NEJMoa0907118.

    Article  CAS  PubMed  Google Scholar 

  5. Personett HA, Stollings JL, Cha SS, Oyen LJ: Predictors of prolonged vasopressin infusion for the treatment of septic shock. J Crit Care. 2012, 27 (318): e7-e12.

    PubMed  Google Scholar 

  6. Gordon AC, Wang N, Walley KR, Ashby D, Russell JA: The cardiopulmonary effects of vasopressin compared with norepinephrine in septic shock. Chest. 2012, 142: 593-605. 10.1378/chest.11-2604.

    Article  CAS  PubMed  Google Scholar 

  7. Daley MJ, Lat I, Mieure KD, Jennings HR, Hall JB, Kress JP: A comparison of initial monotherapy with norepinephrine versus vasopressin for resuscitation in septic shock. Ann Pharmacother. 2013, 47: 301-310. 10.1345/aph.1R442.

    Article  PubMed  Google Scholar 

  8. Russell JA, Walley KR, Singer J, Gordon AC, Hébert PC, Cooper DJ, Holmes CL, Mehta S, Granton JT, Storms MM, Cook DJ, Presneill JJ: Ayers D; VASST Investigators: Vasopressin versus norepinephrine infusion in patients with septic shock. N Engl J Med. 2008, 358: 877-887. 10.1056/NEJMoa067373.

    Article  CAS  PubMed  Google Scholar 

  9. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg. 2010, 8: 336-341. 10.1016/j.ijsu.2010.02.007.

    Article  PubMed  Google Scholar 

  10. Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Control Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.

    Article  CAS  PubMed  Google Scholar 

  11. Higgins JP, Thompson SG, Deeks JJ, Altman DG: Measuring inconsistency in meta-analyses. BMJ. 2003, 327: 557-560. 10.1136/bmj.327.7414.557.

    Article  PubMed Central  PubMed  Google Scholar 

  12. Russell JA, Fjell C, Hsu JL, Lee T, Boyd J, Thair S, Singer J, Patterson AJ, Walley KR: Vasopressin compared with norepinephrine augments the decline of plasma cytokine levels in septic shock. Am J Respir Crit Care Med. 2013, 188: 356-364. 10.1164/rccm.201302-0355OC.

    Article  CAS  PubMed  Google Scholar 

  13. Gordon AC, Russell JA, Walley KR, Singer J, Ayers D, Storms MM, Holmes CL, Hébert PC, Cooper DJ, Mehta S, Granton JT, Cook DJ, Presneill JJ: The effects of vasopressin on acute kidney injury in septic shock. Intensive Care Med. 2010, 36: 83-91. 10.1007/s00134-009-1687-x.

    Article  CAS  PubMed  Google Scholar 

  14. Russell JA, Walley KR, Gordon AC, Cooper DJ, Hébert PC, Singer J, Holmes CL, Mehta S, Granton JT, Storms MM, Cook DJ, Presneill JJ: Dieter Ayers for the Vasopressin and Septic Shock Trial Investigators: Interaction of vasopressin infusion, corticosteroid treatment, and mortality of septic shock. Crit Care Med. 2009, 37: 811-818. 10.1097/CCM.0b013e3181961ace.

    Article  CAS  PubMed  Google Scholar 

  15. Morelli A, Ertmer C, Rehberg S, Lange M, Orecchioni A, Cecchini V, Bachetoni A, D'Alessandro M, Van Aken H, Pietropaoli P, Westphal M: Continuous terlipressin versus vasopressin infusion in septic shock (TERLIVAP): a randomized, controlled pilot study. Crit Care. 2009, 13: R130-10.1186/cc7990.

    Article  PubMed Central  PubMed  Google Scholar 

  16. Lauzier F, Lévy B, Lamarre P, Lesur O: Vasopressin or norepinephrine in early hyperdynamic septic shock: a randomized clinical trial. Intensive Care Med. 2006, 32: 1782-1789. 10.1007/s00134-006-0378-0.

    Article  CAS  PubMed  Google Scholar 

  17. Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, Schein RM, Sibbald WJ: Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. Chest. 1992, 101: 1644-1655. 10.1378/chest.101.6.1644.

    Article  CAS  PubMed  Google Scholar 

  18. Hollenberg SM: Inotrope and vasopressor therapy of septic shock. Crit Care Clin. 2009, 25: 781-802. 10.1016/j.ccc.2009.07.003.

    Article  CAS  PubMed  Google Scholar 

  19. Parrillo JE: Septic shock-vasopressin, norepinephrine, and urgency. N Engl J Med. 2008, 358: 954-956. 10.1056/NEJMe0800245.

    Article  CAS  PubMed  Google Scholar 

  20. Leone M, Martin C: Vasopressor use in septic shock: an update. Curr Opin Anaesthesiol. 2008, 21: 141-147. 10.1097/ACO.0b013e3282f46d20.

    Article  PubMed  Google Scholar 

  21. Guérin JP, Levraut J, Samat-Long C, Leverve X, Grimaud D, Ichai C: Effects of dopamine and norepinephrine on systemic and hepatosplanchnic hemodynamics, oxygen exchange, and energy balance in vasoplegic septic patients. Shock. 2005, 23: 18-24. 10.1097/01.shk.0000150549.45338.6c.

    Article  PubMed  Google Scholar 

  22. Murphey ED, Traber DL: Cardiopulmonary and splanchnic blood flow during48 hours of a continuous infusion of endotoxin in conscious pigs: a model of hyperdyanmic shock. Shock. 2000, 13: 224-229. 10.1097/00024382-200003000-00009.

    Article  CAS  PubMed  Google Scholar 

  23. Träger K, Radermacher P, Rieger KM, Vlatten A, Vogt J, Iber T, Adler J, Wachter U, Grover R, Georgieff M, Santak B: Norepinephrine and nomega-monomethyl-L-arginine in porcine septic shock: effects on hepatic O2 exchange and energy balance. Am J Respir Crit Care Med. 1999, 159: 1758-1765. 10.1164/ajrccm.159.6.9808040.

    Article  PubMed  Google Scholar 

  24. Meier-Hellmann A, Specht M, Hannemann L, Hassel H, Bredle DL, Reinhart K: Splanchnic blood flow is greater in septic shock treated with norepinephrine than in severe sepsis. Intensive Care Med. 1996, 22: 1354-1359. 10.1007/BF01709551.

    Article  CAS  PubMed  Google Scholar 

  25. De Backer D, Zhang H, Cherkhaoui S, Borgers M, Vincent JL: Effects of dobutamine on hepato-splanchnic hemodynamics in an experimental model of hyperdynamic endotoxic shock. Shock. 2001, 15: 208-214. 10.1097/00024382-200115030-00008.

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fei-Hu Zhou.

Additional information

Competing interest

The authors declare that they have no competing interests.

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, FH., Song, Q. Clinical trials comparing norepinephrine with vasopressin in patients with septic shock: a meta-analysis. Military Med Res 1, 6 (2014). https://doi.org/10.1186/2054-9369-1-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/2054-9369-1-6

Keywords