About
Discord Stateoftheart AI
GitHub

Publications

Cited by

16190

Susan Murphy

sequential decision making in mobile healthstatistical reinforcement learning

Harvard University

Papers and Citations

1 - 50
Marginal mean models for dynamic regimes
2001
Susan Murphy
James M Robins
Conduct Problems Prevention Research Group
+1
Cited by 313
A generalization error for Q-learning
2005
Susan Murphy
Cited by 186
From ads to interventions: Contextual bandits in mobile health
2017
Susan Murphy
A Tewari
Cited by 86
Efficient reinforcement learning with multiple reward functions for randomized controlled trial analysis
2010
Susan Murphy
Michael Bowling
Daniel Lizotte
Cited by 80
Linear Fitted-Q Iteration with Multiple Reward Functions
2012
Michael Bowling
Susan Murphy
Daniel Lizotte
Cited by 76
Adaptive confidence intervals for the test error in classification
2011
Susan Murphy
Eric Laber
Cited by 65
Sample size calculations for micro‐randomized trials in mHealth
2016
A Tewari
P Liao
Predrag Klasnja
+1
Cited by 57
Batch mode reinforcement learning based on the synthesis of artificial trajectories
2013
Susan Murphy
Damien Ernst
Louis Wehenkel
+1
Cited by 53
An actor-critic contextual bandit algorithm for personalized mobile health interventions
2017
A Tewari
Huitian Lei
Susan Murphy
Cited by 36
Action centered contextual bandits
2017
Ambuj Tewari
Predrag Klasnja
P Klasnja
+3
Cited by 33
Micro-randomized trials in mHealth
2015
P Liao
A Tewari
Susan Murphy
+1
Cited by 27
Model-free Monte Carlo-like policy evaluation
2010
Damien Ernst
Louis Wehenkel
Raphael Fonteneau
+1
Cited by 27
Inferring bounds on the performance of a control policy from a sample of trajectories
2009
Louis Wehenkel
Raphael Fonteneau
Susan Murphy
+1
Cited by 21
A batch, off-policy, actor-critic algorithm for optimizing the average reward
2016
K Witkiewitz
Y Deng
Hamid Maei
+3
Cited by 19
A cautious approach to generalization in reinforcement learning
2010
Susan Murphy
Louis Wehenkel
Raphael Fonteneau
+1
Cited by 17
Towards min max generalization in reinforcement learning
2011
Susan Murphy
Raphael Fonteneau
Damien Ernst
+1
Cited by 15
Active learning for developing personalized treatment
2012
Susan Murphy
Kun Deng
Joelle Pineau
Cited by 14
Active learning for personalizing treatment
2011
Kun Deng
Joelle Pineau
Susan Murphy
Cited by 11
Inference for batched bandits
2020
Lucas Janson
Susan Murphy
Kelly W. Zhang
Cited by 9
Rejoinder of “Dynamic treatment regimes: Technical challenges and applications
2014
Susan Murphy
Daniel Lizotte
William E. Pelham Jr.
+2
Cited by 7
Small sample inference for generalization error in classification using the CUD bound
2008
Susan Murphy
Eric Laber
Cited by 6
Budgeted learning for developing personalized treatment
2014
Susan Murphy
Russ Greiner
Kun Deng
Cited by 5
Generating informative trajectories by using bounds on the return of control policies
2010
Damien Ernst
Susan Murphy
Louis Wehenkel
+1
Cited by 5
Addressing the Computational Challenges of Personalized Medicine (Dagstuhl Seminar 17472)
2018
Niko Beerenwinkel
Susan Murphy
Holger Fröhlich
Cited by 4
Assessing confidence in policies learned from sequential randomized trials
2009
Susan Murphy
Eric Laber
Daniel Lizotte
Cited by 3
Active exploration by searching for experiments that falsify the computed control policy
2011
Raphael Fonteneau
Susan Murphy
Louis Wehenkel
+1
Cited by 3
Power-Constrained Bandits
2020
Finale Doshi
F Doshi-Velez
Susan Murphy
+3
Cited by 2
Intelligent pooling in Thompson sampling for rapid personalization in mobile health
2019
P Liao
P Liao
Serena Yeung
+3
Cited by 2
Personalizing Intervention Probabilities By Pooling
2018
Predrag Klasnja
Susan Murphy
Sabina Tomkins
Cited by 1
IntelligentPooling: Practical Thompson Sampling for mHealth
2020
P Liao
P Liao
Predrag Klasnja
+2
Cited by 1
Estimation Monte Carlo sans modèle de politiques de décision
2011
Louis Wehenkel
Damien Ernst
Raphael Fonteneau
+1
Cited by 1
Supplement to Action Centered Contextual Bandits
A Tewari
Susan Murphy
Kristjan Greenewald
+1
Cited by
Statistical Inference with M-Estimators on Bandit Data
2021
Kelly W. Zhang
Lucas Janson
Susan Murphy
Cited by
Streamlined Empirical Bayes Fitting of Linear Mixed Models in Mobile Health
2020
Sabina Tomkins
Marianne Menictas
Susan Murphy
Cited by
Stitched Trajectories for Off-Policy Learning
F Doshi-Velez
S Sussex
Susan Murphy
+3
Cited by
qlaci R Package for Using Q-Learning to Construct Adaptive Interventions Using Data From a SMART
2014
AT Wagner
Aaron T Wagner
SA Murphy
+5
Cited by
Learning Treatment Policies for Mobile Health Using Randomized Least-Squares Value Iteration
C Liang
P Liao
Serena Yeung
+1
Cited by
Stratégies d'échantillonnage pour l'apprentissage par renforcement batch
2013
Raphael Fonteneau
Damien Ernst
Louis Wehenkel
+1
Cited by
Dynamic treatment regimes using reinforcement learning: a cautious generalization approach
2009
Raphael Fonteneau
Louis Wehenkel
Susan Murphy
+1
Cited by
Apprentissage actif par modification de la politique de décision courante
2011
Raphael Fonteneau
Louis Wehenkel
Susan Murphy
+1
Cited by
Inferring bounds on the performance of a control policy from a sample of one-step system transitions
2009
Raphael Fonteneau
Louis Wehenkel
Damien Ernst
+1
Cited by
Apprentissage par renforcement batch fondé sur la reconstruction de trajectoires artificielles
2014
Louis Wehenkel
Susan Murphy
Raphael Fonteneau
+1
Cited by
Small Sample Prediction Intervals for the Test Error In Classification
Eric Laber
Susan Murphy
Cited by
1 Appendix I: Additional experimental results
Eric Laber
Susan Murphy
Cited by