Chalumeau & Grimaldi Bensouda

58
Lamiae Grimaldi-Bensouda, La-Ser, CNAM Martin Chalumeau, Necker Hospital for Sick Children, Paris Descartes University, Inserm U953 PRES Paris Sorbonne Drug evaluation in children: observational approaches Methodological Approaches to Overcome the Challenges of Drug Evaluation in Children EUCROF/RIPPS/EMA Conference, London, 2013

Transcript of Chalumeau & Grimaldi Bensouda

Page 1: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 1/58

Lamiae Grimaldi-Bensouda, La-Ser, CNAM

Martin Chalumeau, Necker Hospital for Sick Children, Paris Descartes

University, Inserm U953PRES Paris Sorbonne

Drug evaluation in children:

observational approaches

Methodological Approaches to Overcome the Challenges

of Drug Evaluation in Children

EUCROF/RIPPS/EMA Conference, London, 2013

Page 2: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 2/58

Observational approachesto evaluate drugs in pediatrics

2 clinical examples highlighting theimportance of observational studies

to evaluate drugs in pediatrics:- rare adverse events- long term adverse events

These examples allow discussing methods inobservational studies.

Page 3: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 3/58

Observational approachesto evaluate drugs in pediatrics

Clinical situation 1

Page 4: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 4/58

Ibuprofento treat fever without source

As a physician / pharmacist / parent you prescribe / deliver / giveibuprofen to a 2 years old girl withisolated fever.

72 hours later the patient ishospitalized for acute necrotizingfasciitis related to a Group AStreptococcus infection.

Page 5: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 5/58

Biological plausibilityIn vitro and animal studies

Decrease in neutrophil function after exposures to NSAIDs

Page 6: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 6/58

Ibuprofento treat fever without source

As a physician / pharmacist / parent you prescribe / deliver / giveibuprofen to a 2 years old girl withisolated fever.

72 hours later the patient ishospitalized for acute necrotizingfasciitis related to a Group AStreptococcus infection.

You report the case to the pharmacovigilance system.

What can you learn from this system?

Page 7: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 7/58

Spontaneous reporting of ADRLimitations

Essential for drug monitoring and signal generating butquantitative measures of risk nearly impossible given:

Incomplete numerator (underreporting)

Absence of real denominator (n exposed to the drug)

Others:

- Selection bias / novelty bias- Information bias: data collection is different / exposure- Confusion / inference- Not for delayed events and events with high-baseline risk

Page 8: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 8/58

RCT to evaluate rare adverse events

Number of NF at 30 days: 0

Which inference (enough power for rare events)?

Page 9: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 9/58

RCT to evaluate rare adverse events

Usual inference drawn:

NF nearly does not exist in the 30 daysafter exposure to ibuprofen in children… 

Is it possible to refine this inference?

Page 10: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 10/58

Inference / Rare AEBernouilli trial and Binomial distribution

Page 11: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 11/58

RCT to evaluate rare adverse events

Given zero events in a sample size of 55785,

the exact inference is:

it is fairly unlikely (< 2.5%) that the trueprobability of adverse events is higher than

1/15000

Page 12: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 12/58

RCT to evaluate rare adverse events

>1/15000:rare (or not so rare?)

- Frequency of the treated disease- Existence of safe alternative treatment- Severity of the AE- Severity of the treated disease

Here: which inference on ibuprofen safety after

this huge RCT?

Page 13: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 13/58

Observational approachesto evaluate drug safety in pediatrics

To make inference, you need information.

Here, you need cases.

Page 14: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 14/58

Observational approachesto evaluate drug safety in pediatrics

Cohort studies

or

Case-control studies

Page 15: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 15/58

Observational approachesto evaluate drug safety in pediatrics

Cohort studies would offer similarpower than RCTs

(not useful for rare events)

Page 16: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 16/58

Case-controlto evaluate drug safety in pediatrics

Page 17: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 17/58

Case-controlto evaluate drug safety in pediatrics

Page 18: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 18/58

Case-control studiesavoiding protopathic bias

Page 19: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 19/58

Case-controlto evaluate drug safety in pediatrics

Page 20: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 20/58

Case-controlto evaluate drug safety in pediatrics

1st inference:

NF does exist in the 30 days afterexposure to ibuprofen in children

Page 21: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 21/58

Case-controlto evaluate drug safety in pediatrics

2nd inference:

Exposure to ibuprofen (in the last 7 days) ismore frequent among cases than controls- strenght of the association- statistical significance of the association

- (dose relationship issues)

Page 22: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 22/58

Case-control studiesWarning

Selection of controls

Measure of exposure (retrospective)

Recal bias: potentially differential

Page 23: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 23/58

Case-control and cohort studiesAre mix approaches possible?

Would it be possible:to gain ‘‘cases’’ (using a case-control design)while avoiding (differential) recal bias

and selection bias?

Page 24: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 24/58

Nested case-control studieswithin an automated data-base cohort

Page 25: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 25/58

Nested case-control studieswithin an automated data-base cohort

Page 26: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 26/58

Nested case-control studieswithin an automated data-base cohort

Statistical power

Less risk of selection biasLess risk of (differential) recal bias

Page 27: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 27/58

Nested case-control studiesinside a cohort

Page 28: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 28/58

Nested case-control studiesinside a cohort

Page 29: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 29/58

Observational studiesfor rare adverse events

Which inference on ibuprofen safety afterthese various observational studies?

Page 30: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 30/58

Observational approachesto evaluate drugs in pediatrics

Clinical situation 2

Page 31: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 31/58

Prolonged sedation/analgesiain very preterm infants

As a pediatrician, you wonder if youshould prescribe sedative or opioiddrugs to a 3 days old girl, born after30 weeks of gestation, admitted to

the NICU for respiratory distress

Given:- these drugs are not labeled in this age group for this indication(prolonged sedation/analgesia)

- there are concerns about the neurological safety of these drugsrelated to immaturity… 

Page 32: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 32/58

Prolonged sedation/analgesiathe alert (1/2)

Page 33: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 33/58

Prolonged sedation/analgesiathe alert (2/2)

Page 34: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 34/58

Inference problemsin observational studies

Confounding

Page 35: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 35/58

Confirming the biaslook at covariates

Page 36: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 36/58

Theoretical solutionsfor confusion by indication

ethical?

a priori

a posteriori

Page 37: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 37/58

Nonrandomized solutionsLimits

n binary confounders2n combinations

logistic regression model:

P(Y/X1,2,3,...n) = 1 / [1 + e-( 0 1 1+ 2 2 3 3 ... n n ]

To avoid ‘‘over adjustment’’: n < Y events /10

Page 38: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 38/58

Propensityfor what?

Page 39: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 39/58

Why a scoreof propensity?

Page 40: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 40/58

Propensity scoreChanging the predicted variable

P(Y/X1,2,3,...n) = 1 / [1 + e-( 0 1 1+ 2 2 3 3 ... n n ]

Page 41: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 41/58

Propensity scoreChoosing predicting variables

Page 42: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 42/58

Variables includedExample

Page 43: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 43/58

How to use the score?3 main approaches

Page 44: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 44/58

How to use the score?(1) stratification

Page 45: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 45/58

How to use the score?(2) matching

Page 46: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 46/58

 

P(Y/X1,2,3,...n) = 1 / [1 + e-(0 1 1

+2 2 3 3 ]

P(Y/X1,2,3,...n) = 1 / [1 + e-(0 1 1

+2 2 3 3

...n n ]

How to use the score?(3) adjustment - principles

Page 47: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 47/58

How to use the score?(3) adjustment - results

Page 48: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 48/58

Propensity scoresLimits

Page 49: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 49/58

Propensity scoresPotential applications

To study safety and effectiveness of drugs in children:

- when cohort data is available

- with data on potential confounders- with a non homogenous pattern of treatment

Not a magic bullet

Just another way to deal with confounding (by indication)

Page 50: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 50/58

Prolonged sedation/analgesiain very preterm infants

As a physician, you wonder if youshould prescribe sedative or opioid toa 3 days old girl, born after 30 weeksof gestation, admitted to the NICU

for respiratory distress.

Questions:

Does the lack of license (or labeled indication) is a limitation to the useof prolonged sedation/analgesia?

Would it be possible to obtain a license without RCTs in this indication?

Page 51: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 51/58

Observational approachesto evaluate drugs in pediatrics

In pediatrics,well-performed observational studies are very

important tools to evaluate :

- rare adverse events (no alternative design)- long-term safety (no alternative design)

- effectiveness (no alternative design)

Page 52: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 52/58

Page 53: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 53/58

Page 54: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 54/58

Observational approachesto evaluate drug efficacy in pediatrics

Existing examples (with license):

- Precocious puberty and GnRH agonists;- Turner Sd and GH;- Burkitt lymphoma and Wollner-MTX = LSAL2.

Page 55: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 55/58

Open label, n = 11

Page 56: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 56/58

Open

label,n = 4

Page 57: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 57/58

Statistical inference with 4 observations

Ob l h

Page 58: Chalumeau & Grimaldi Bensouda

7/30/2019 Chalumeau & Grimaldi Bensouda

http://slidepdf.com/reader/full/chalumeau-grimaldi-bensouda 58/58

Observational approachesto evaluate drug efficacy in pediatrics

Candidate situations:- Very serious conditions

- Outcome: in steel- Perfectly known natural history- Effect size: important (visible to the naked eye)