Posts

efficacyvseffectiveness

Efficacy and Effectiveness Studies

By Michael D. Cabana, MD, MPH

In the world of clinical trials, reproducibility (or consistency) of results across different clinical trials improves clinicians’ confidence in an intervention (Hill, 1965).  However, when reviewing the evidence for a probiotic or prebiotic supplement, the results are sometimes conflicting.  One study claims an intervention may work.  Another study claims that an intervention may not work. So how does the clinician deal with this situation?

To know how much confidence to place in any claim of benefit, clinicians need to consider the totality of the evidence and the quality of the studies. One tool is the systematic review process, which in an unbiased manner searches for all studies for a particular intervention, and when possible, combines results into a meta-analysis. The ‘summary’ of these data point to either an effect or no effect. The best way to combine data is using an individual patient-data meta-analysis (IPDMA). In addition, a clinician should determine whether the clinical trial is an effectiveness study or an efficacy study (Singal 2014).

 

Efficacy or Effectiveness?   

Efficacy studies ask, “does the intervention work in a defined (usually an “ideal”) setting?”  In general, the inclusion criteria for study participants will be very selective.  Patient adherence tends to be closely monitored. The clinicians conducting the trial may be specially trained in the intervention and its application. The intervention occurs in an ideal setting and the risk of other confounding interventions (e.g., unusual diets, concurrent treatments) will be limited.

On the other hand, effectiveness studies ask, “Does the intervention work in a real-world setting?”  The inclusion criteria for study participants tends to be less selective.  Patient adherence to the protocol is not necessarily strictly enforced. The clinicians conducting the trial tend to be representative of the typical physicians who would treat this condition.  The intervention occurs in a more ‘real-world’ setting where the presence of other confounding factors may be present.

For example, two relatively recent studies both examined the effect of a probiotic intervention, L. reuteri DSM 17938 for the treatment infant colic.  A study conducted by a team in Italy (Savino et al. 2010) noted that the intervention reduced colic symptoms; however, the study conducted by a team in Australia (Sung et al. 2014) showed no effect on colic.

Why the different results? In the Italian study, all the infants were breastfed.  In addition, the breastfeeding mothers limited their dairy intake.  The infants tended to be younger (mean age 4.4 weeks) and tended not to have other treatments for colic or gastrointestinal symptoms.  In contrast, the infants in the Australian study were breastfed or formula fed. The infants were older (median age 7.4 weeks) and were more likely to have been exposed to other treatment for gastrointestinal symptoms (such as histamine-2 blocker or proton pump inhibitors).  The infants were recruited from many different settings such as the emergency department.

Although both the Italian and the Australian study evaluated the same probiotic intervention for the same condition, the studies offer different information in terms of efficacy and effectiveness.  Describing a study as either an “efficacy” study or an “effectiveness” study is not always dichotomous.  Rather, these studies exist on a spectrum, from being more like an efficacy study versus more like an effectiveness study. In the example above, the Italian study had stricter criteria and fewer confounding factors.  As a result, it would tend to be classified as an efficacy study.  The Australian study enrolled infants with colic who were older and had a greater likelihood to be exposed to other interventions.  This study would tend to be classified as more of an effectiveness study.  The fact that the Australian study was a null study does not mean that the intervention was not effective in the ‘real world’.  Rather, for the patients enrolled, the treatment was not effective when used in that particular setting and context.  Perhaps you may encounter infants with colic who have feeding history and medical history more like the infants from the Italian study. Understanding the context of the studies helps identify those characteristics that may or may not apply to the infants with colic who you may treat in your clinic.

 

Which is better: Efficacy or Effectiveness?

When developing a new or experimental intervention, an efficacy study might be important to increase the likelihood of detecting a positive change.  However, “real world” factors may make a difference in how a product is used.  Perhaps an intervention might be inconvenient (due to multiple doses throughout the day) or unpalatable for the patient.  Perhaps the dosing regimen is complicated and the primary care providers don’t apply the correct dosing for patients. In these cases, an effectiveness study might be a better guide to how useful the intervention will be in clinical practice.

As a final note, it can be tempting to simply read the abstract of a clinical trial to assess the results of a study.  However, in many instances the crucial details of the study (e.g., how the study participants were selected, who was included or excluded, what type of clinical setting was used) are buried in the methods section of the study.  Patient diet, exposure to other treatments and comorbid conditions are all common confounding factors encountered in trials evaluating supplements.  When reading through the literature and understanding if a study is applicable to your practice, be sure to understand the full context and purpose of the study.  “Was this study useful for determining clinical efficacy or clinical effectiveness?” is an important question for readers of probiotic and prebiotic clinical trials. Keeping this question in mind may help you better resolve what may appear to be inconsistency among clinical trials.

East meets West at ISAPP’s first meeting in Asia

By Mary Ellen Sanders, PhD

The International Scientific Association for Probiotics and Prebiotics (ISAPP) recently convened its first meeting held in Asia, with the modern hub of Singapore as a host city. The meeting featured a two-day open registration meeting, attended by nearly 250 scientists, health professionals, and industry representatives, and a third day of smaller discussion groups by invitation. The meeting provided a rare opportunity for non-members to attend. It provided a dynamic forum for sharing different clinical experiences and regulatory nuances amongst the continents, as well as allowing attendees to better appreciate the research being performed in the Asian region.

Here are a few speaker highlights:

 

Mimi Tang MD

Tang presented the results of a double-blind, randomized controlled trial examining the effect of probiotic supplementation combined with oral immunotherapy (OIT) to decrease the risk of peanut allergy in children. Peanut allergy is one of the fastest growing food allergies in children. In the Probiotic and Peanut Oral ImmunoTherapy [PPOIT] study, children randomized to the intervention group had increased rates of sustained responsiveness to peanut several weeks after discontinuation of the treatment. Tang discussed the implications of the study, as well as current, larger clinical trials that are building upon these findings.

 

Dr. Bruno Pot

The Lactobacillus genus is taxonomically abnormally heterogeneous. Currently, the 231 Lactobacillus species range from a genome size of 1.23 – 4.91 megabases, have a GC content of 32-57% and an average nucleotide identity that is typical for a family or worse. Such ranges are far beyond what is acceptable for a bacterial genus. Experts are recommending that the current genus should be split into 12 new genera. Some well-known lactobacilli would be re-named, which may have important repercussions commercially and legally.

 

Profs. Colin Hill and Patrice Cani

Hill described how lactase in yogurt cultures improves lactose digestion; he emphasized how mechanisms that drive probiotic activity are complex. Some scientists are searching for a single molecule that drives probiotic health benefits—but it is unlikely to be found.

Hill noted even inactivated (non-living) microbes may have health effects—for example, a study showed that a dead Lactobacillus strain reduced anxious behavior, reduced cortisol levels, and impacted the microbiome in a mouse model. Work by Prof. Patrice Cani showed that heat-killed Akkermansia muciniphila were sufficient to ameliorate obesity and diabetes in mice. Does this suggest that we will need to start quantifying probiotics based on biomass as well as CFU?

 

Profs. Hani El-Nezami, Gregor Reid and Akihito Endo

These three speakers illustrated the important impact of environmental toxins (extremely potent aflatoxins, pesticides, and heavy metals) on humans and wildlife. They showed how certain probiotic strains can decrease aflatoxin absorption and even degrade them; sequester heavy metals and pesticides to reduce their uptake; and enhance resistance to honey bee colony collapse disorder that threatens the world’s food supply.

 

Prof. Wim Teughels

To date, 11 studies have been published on probiotics with a low ‘number needed to treat’ for prevention of dental caries in infants, toddlers, and adults. One study showed the benefits of administered L. reuteri, following children for nine years after they were treated as infants before any teeth had emerged. Also, data exist for probiotics influencing other oral health endpoints, including periodontal infections, oral candida infections, and halitosis.

 

The discussion groups on day three of the conference addressed a range of topics:

  • Possibilities to harmonize global probiotic and prebiotic regulations—Chaired by Seppo Salminen (Finland), Yuan Kun Lee (Singapore), and Gabriel Vinderola (Argentina)
  • Fermented foods for health: East meets West—Chaired by Bob Hutkins (USA), Paul Cotter (Ireland), and Liu Shao Quan (Singapore)
  • Potential value of probiotics and prebiotics to treat or prevent serious medical issues in developing countries—Chaired by Daniel Merenstein (USA), Reuben Wong (Singapore), and Colin Hill (Ireland)
  • Prebiotics as ingredients: How foods, fibres and delivery methods influence functionality—Chaired by Glenn Gibson (England) and Karen Scott (Scotland)

 

These workshops often produce peer-reviewed publications based on the discussion outcomes, so stay tuned for these developments. (See here for a list of ISAPP publications.)

The full meeting report is being developed and will be posted on the ISAPP website shortly.

The 2019 meeting will return to ISAPP’s normal format, hosted by Dr. Sarah Lebeer in Antwerp, Belgium.

 

seppo

Welcome Seppo Salminen – ISAPP’s New President

An interview with Prof. Seppo Salminen

ISAPP President 2018-2021

 

1) What are your goals as the next president of ISAPP? 

My goal is to work together with the board and the members to advance excellence in the science of probiotics and prebiotics and to share research and conclusions with as wide an audience as possible. It is also my goal to leverage ISAPP’s scientific  expertise to work with organizations to promote  evidence-based applications of probiotics and prebiotics to advance health and well-being of people.

2) What do you hope to see the organization accomplish during your tenure?

ISAPP is engaged now in North America, Europe and Asia so maybe we can be really be global and reach out to South America and  connect with researchers in Africa as we have done with Professor Reid earlier. I would like to work toward common goals with more industrial, scientific and regulatory experts from different parts of the world.

3) What changes do you foresee in the field of probiotics and prebiotics in the next few years?

 I foresee rapid development in probiotics and prebiotics. There will be novel microorganisms developed and novel sources of prebiotics and this direction leads to challenges in safety evaluation and efficacy demonstration  as well as communication of the results to larger audiences.

4) How did you originally become involved in ISAPP?

I was originally invited to one ISAPP meeting, then to the next one, then to the third one and at the end was invited to be a member of the board, which I considered a special honour!

5) Which ISAPP meeting was your favorite so far?

They all have been excellent, but some I remember (each for different reasons) are the ones in Barcelona, New York, Chicago and Berkeley – and now Singapore. Of course, the one in Turku, Finland as well – when you help organize a meeting like that you certainly remember even on a minute-by-minute basis.

Thank you Prof. Salminen and welcome!

2018_Singpaore

ISAPP’s First Meeting in Asia is a Huge Success

June 5-7th 2018 ISAPP held it’s first Asian meeting in Singapore. This open registration meeting was a huge success with over 240 attendees from 34 countries.

Two days of plenary talks focused on the latest science featuring prebiotic and probiotic use in: pediatrics, oral health, allergy immunotherapy, the gut microbiome throughout life, synbiotics, liver disease, honey bee health, chronic gut disorders, and more. The meeting also featured an interesting talk about the changes coming in the nomenclature of the genus Lactobaccilus.

The plenary, open sessions were followed by a Discussion Forum on June 7th for invited experts and Industry Members. The discussion groups focused on:

  • Harmonizing Global Probiotic and Prebiotic Food/Supplement Regulation
  • Fermented Foods for Health: East Meets West
  • Potential Value of Probiotics and Prebiotics to Treat or Prevent Serious Medical Issues in Developing Countries
  • Prebiotics as Ingredients: How Foods, Fibres and Delivery Methods Influence Functionality

Finally, there were over 70 posters presented at the meeting featuring the latest prebiotic and probiotic research from around the world.

Next year, ISAPP will be hosting an invite-only meeting in Antwerp, Belgium – May 14-16, 2019. To attend this meeting, join ISAPP as an Industry Member.

      

karen_scott

ISAPP’s Outgoing President: Karen Scott

Dr. Karen Scott of the Rowett Institute of the University of Aberdeen has served as the ISAPP President for the last three years. During her time as President, ISAPP has seen some incredible growth and accomplishments, and the organization is so grateful for her leadership.

Last year, under Karen’s leadership, ISAPP produced a prebiotic consensus panel paper, which remains one of the highest cited papers in nature reviews gastroenterology and hepatology.

In addition, over the last three years the Science Translation Committee has produced nine infographics, four videos, monthly blog posts, and a monthly newsletter focused on disseminating clinical and consumer information on probiotics and prebiotics.

Karen led three successful ISAPP Annual Meetings – Turku in 2016, Chicago in 2017, and ISAPP’s first meeting in Asia which took place in Singapore in 2018. All of these meetings followed her acting as local host for the 2014 ISAPP meeting in Aberdeen.

ISAPP’s mission to educate resulted in numerous outreach activities over the last three years including continuing education opportunities, webinars, the USP expert panel on probiotics, and regulator engagements. In terms of advancing the science, under Karen’s leadership ISAPP has published 21 peer-reviewed articles on probiotics and prebiotics.

Finally, industry involvement in ISAPP has remained strong and steady during Karen’s term, with 40-45 industry members from around the world. These industry members support ISAPP’s activities and participate in the annual meeting each year to hear about the latest probiotic and prebiotic science available.

Thank you so much Karen for your dedication and hard work to advance scientific excellence in probiotics and prebiotics.

bowling_1

ISAPP is coming to Asia – the hidden reason

By Prof. Glenn Gibson

In just a few days ISAPP will host its first meeting outside of Europe or North America, when we have an open conference in Singapore1,2. There are about 200 registrants and we cannot wait. The meetings are always scientifically informative but fun also. These are main drivers behind our annual jamboree, but this year there is another task…… I am hoping that first timers to ISAPP, and particularly our Asian friends, break with tradition and pronounce the name of the organisation correctly.

I have written one blog in the 56 years of my existence. This first was last year on the various social events we have at the meetings. But this was prior to Chicago in 2017, where we had a bowling alley experience. My PhD student Xueden Wang (Holly) has never let us forget her winning efforts at this:

bowling_1

The above picture and Holly’s endless bragging came to an abrupt end however, when we had our lab Christmas party in December3 – also at a bowling alley this time in Wokingham UK:

Let’s call that revenge of the supervisor shall we? The open top bus parade is now cancelled Holly I am afraid. By the way, if you don’t know what Chicago or Wokingham look like, then both are pictured below. I will leave you to guess which is which:

uk

Anyway, I disgress (justifiably). This is therefore my second blog, and there is a reason for dusting off the quill pen and rehearsing the hieroglyphics once more.

In the last few years ISAPP has published 2 consensus papers, one on probiotics and one on prebiotics4. What we cannot agree on, however, is how to say the name of our esteemed society. Some say ISAPP with the I as “eye”, while others say ISAPP (with the I as in sIt). Admittedly, there is a slight bias in numbers as it is possible to count on the fingers of one finger the number of people who use the latter. It is me. So, that makes about 852 attendees at previous ISAPP meetings incorrect.

Think of the full name of the ISAPP organisation and say it to yourself now…………………

Did anyone say Eye-Nternational? Or did you say International?

At this stage, I should just say that the case for the prosecution is concluded and no further witnesses your honour!

However, let’s look at things a little more closely. If the anarchists, heretics and Eye-Sappers get their way then we may need to change the logo of the organisation to:

eye ISAPP_logo

We see the letter “I” in front of many things these days such as i pad, i mac , i max, i alex cross, i pod, i robot. A quick search of the internet (or as some say eyeNternet) suggests that the “I” can stand for individual, imagination or internet, but usually refers to intelligent. We might have to live with ISAPP standing for intelligent sapps. Here is a picture of 2 saps:

 

Still, 852 people can’t be wrong. I’ll put that another way – 852 people are wrong. So the spotlight turns to Singapore to show us the light, the truth and the way forward.

But……. It gets worse. The terms probiotic and prebiotic are not used on products in Europe now as they are an implied health benefit. Let’s put aside that the very body who devised this “rule” have turned down all but about one health claim. If we go along with this puffed up lunacy5 then we might have to call ISAPP:

International Scientific Association for @%?!&.. and @%?!&..

Maybe we can get away with just using the first letters of these disgustingly offensive, abhorrent and abusive terms. So, ISAPP becomes:

International Scientific Association for P@%?!&.. and P@%?!&..

It still does not seem right, so ISAPP becomes:

International Scientific Association for PAP

Now we are getting somewhere, as PAP means Noun. 1. Nonsense, rubbish. 2. Faeces. Verb. To defaecate. e.g. ‘He was so scared he papped his pants.’.” This embodies exactly what ISAPP is all about and where pro/prebiotics work!!! So, I propose another new logo:

ISAPP_logo 

1I’ll be flying there with British Airways. One highlight is always the safety demo where they say “in the unlikely event that the plane should land on water.” I always feel that “unlikely” is not quite definitive enough. If you were to ask at check in about the chances of the 777 landing on water and the reply was “er… well…on balance it is unlikely”, you would probably not board the old crate.

2Travel tip: Always aim for row 13 and upon reaching it say “oh no, me and my luck, I’m in death row again”, it often leads to vacating of the seat next to you.

3Also attended by a group of leading food science researchers, who face such crucial issues as:

  • What is there in a chicken that makes an eggshell?
  • Why do we not eat turkey eggs?
  • Why is marmalade not just called orange jam?
  • How is some cheese orange when it made from milk?
  • Why are small chocolate bars called “fun size” when they are about half of what they should be?

4By the way, in the olden days (1995) I wanted to call prebiotics parabiotics. Only because MASH was on TV at the time and featured paramedics. So these could be known as biotics that help medics.

5Please note that these opinions are those of the author and do not represent the views of EYESAPP, aside from Gregor.

2017_annual_report

ISAPP Releases 2017 Annual Report

The 2017 Annual Report on ISAPP’s activities to advance scientific excellence in probiotics and prebiotics is now available. The Report covers the 2017 Annual Meeting in Chicago IL, as well as the publications, webinars, meetings and other activities accomplished during the past year. Finally, ISAPP is grateful to the 43 Industry Advisory Committee Members who support ISAPP’s endeavors. See more here.

pharmacist continuing ed

Continuing Education Opportunity on Probiotics and Prebiotics Now Available for Pharmacists

ISAPP Board member and Professor of Medicine, Dan Merenstein MD, served as faculty for a new continuing education activity on probiotics and prebiotics. “The Expanding Health Benefits of Prebiotics and Probiotics” was developed by Pharmacy Times and is available free of charge here (registration is required to log in to access the materials).  This concise, practice-oriented review summarizes evidence for probiotic interventions for clinical conditions and is an excellent summary for all healthcare practitioners.

ISAPP BOARD MEMBERS TO PARTICIPATE IN PEDIATRIC PROBIOTIC CONFERENCE IN ITALY

ISAPP Board Members, Professors Michael Cabana MD MPH and Seppo Salminen PhD, will be participating in the 4th Annual Prebiotics and Probiotics in Pediatrics conference in Bari, Italy April 12-14, 2018. Prof. Cabana will be chairing a panel on colic and will discuss findings from a meta-analysis of L. reuteri as an intervention for colicThis meta-analysis, published December 2017, was the outcome of discussion groups convened at the 2014 and 2016 ISAPP meetings, both led by Prof. Cabana of University of California, San Francisco.

Prof. Salminen will share his decades of knowledge of probiotics, colonizing microbiota and pediatric applications in his presentation titled “Bacteriome and Friends.”

Don’t miss the 4th Annual Prebiotics and Probiotics in Pediatrics conference, which is a unique opportunity to meet major experts in the field while learning the most updated basic and clinical research on prebiotics and probiotics for the developing human. The three-day meeting will cover the major novelties in pediatric gastroenterology, obesity, allergy, nephrology, neonatology and the new scenario on gut-brain communication.

Talking Science with ISAPP’s Science Translation Committee

By Christopher Cifelli, PhD, VP of Nutrition Research, National Dairy Council.

Communicating with others is an essential part of everyday life. We are constantly sharing information about a variety of topics with friends, family, and even strangers. Most of the time the interaction is easy and natural – and sometimes even fun. But, have you ever talked to a scientist or asked a scientist a question?

Scientists love to talk about their research. And, other scientists want other to know about their research. They enjoy expounding on the minute details of their work and can spend hours on the littlest detail. That is one trait that makes a scientist effective – the attention to detail needed to posit hypotheses and then experimentally test them in controlled, thought-out manners. Scientists can talk to other scientists easily – but, ask some of them to explain their work to the average person and it doesn’t always go so well.

ISAPP is composed of scientists that are world-renowned experts on probiotics, prebiotics, and fermented foods. And, like other scientists, ISAPP wants others to know and understand these complex topics so that they can make informed decisions that may benefit their health. The question was – how does ISAPP do that? The answer: focusing on effectively translating the science. I offered ISAPP my leadership of a new committee to take on this task. ISAPP formed the Science Translation Committee nearly 3 years ago with a goal of taking complex scientific topics and making them easy to understand for consumers and health professionals. The result of this effort has been the development of numerous infographics, blog posts, and informational videos that translate years of research into easily digestible nuggets of information that people can use. The most recent infographic focused on dispelling some common myths about probiotics – because, who doesn’t like some myth busting!

Effective science communication is essential – essential because it can help people understand the complex and enable them to make choices that can benefit their overall health. ISAPP – which is grounded in science – will continue to be the voice of probiotic and prebiotic science and work to help people understand these fun and interesting topics. So, check out our website and our resources and start learning!

blog reid elderly

Do dietary effects on gut microbiota promote health in older individuals? Reid and colleagues gain insights into microbiota composition across the lifespan

January 22, 2018. By Dr. Gregor Reid

ISAPP Board of Directors member Dr. Gregor Reid recently co-authored a cross-sectional study in a cohort of over 1000 very healthy Chinese participants from 3 to over 100 years of age in order to gain insights on ‘healthy’ microbiota composition and whether this changes with age. Using next-generation sequencing (Illumina MiSeq platform) and large-scale compositional data analysis techniques, the study demonstrated that there was very little difference in the fecal microbiota composition of individuals between the around 30 years of age and around 100—as long as the individuals were extremely healthy.

The concept of consuming live microorganisms that offer a benefit to the host (probiotics), or a substrate that is selectively utilized by host microorganisms conferring a health benefit (prebiotics), to promote health in aging populations is becoming more popular. However, it is not currently known what constitutes a ‘healthy’ gut microbiota composition, or what specific prebiotic/probiotic might help establish it.

Discussing the study results in a Reddit Ask Me Anything session, Reid explains, “It is hard to pin down outcomes to one factor such as food, and which components of those foods are critical, but seeing the super-healthy elderly having the same microbiota profile as the super-healthy young adult might make us see if some food practices from 75 years ago have returned.”

Although the study design (cross-sectional) does not allow for a cause and effect relationship to be established, the results may signify that the similarity of gut microbes across ages is a consequence of an active lifestyle and good diet—in contrast with previous hypotheses that aging per se affected gut microbiota composition. Based on these findings, it is reasonable to hypothesize that reestablishing a dysbiotic microbiota composition in older adults, to mirror that of a 30-year-old, may promote health. Moreover, the results offer an established baseline microbiota composition by which other cohorts with chronic or acute disease may be compared.