About
Discord Stateoftheart AI
GitHub

Publications

355

Cited by

13359

Doina Precup

artificial intelligencemachine learningreinforcement learning
McGill University

Canada

Papers and Citations

1 - 50
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
1999
Richard S. Sutton
Satinder Singh
Doina Precup
Cited by 2603
Deep reinforcement learning that matters
2018
David Meger
Philip Bachman
Riashat Islam
+3
Cited by 898
Fast gradient-descent methods for temporal-difference learning with linear function approximation
2009
Doina Precup
Richard S. Sutton
Shalabh Bhatnagar
+4
Cited by 466
The option-critic architecture
2017
Doina Precup
Pierre-Luc Bacon
Jean Harb
Cited by 465
Eligibility traces for off-policy policy evaluation
2000
Richard S. Sutton
Doina Precup
Satinder Singh
Cited by 442
Horde: A scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction
2011
Thomas Degris
Patrick M. Pilarski
Doina Precup
+4
Cited by 321
Off-policy temporal-difference learning with function approximation
2001
Richard S. Sutton
Doina Precup
Sanjoy Dasgupta
Cited by 309
Algorithms for multi-armed bandit problems
2014
Doina Precup
V Kuleshov
Cited by 294
Learning options in reinforcement learning
2002
Doina Precup
M Stolle
Cited by 279
Off-policy deep reinforcement learning without exploration
2019
David Meger
Scott Fujimoto
Doina Precup
Cited by 234
Convergent temporal-difference learning with arbitrary smooth function approximation
2009
Doina Precup
David Silver
Shalabh Bhatnagar
+3
Cited by 222
Abstract
1887
Doina Precup
Balaraman Ravindran
Satinder Singh
+1
Cited by 221
Automatic basis function construction for approximate dynamic programming and reinforcement learning
2006
Doina Precup
Shie Mannor
PW Keller
Cited by 181
Metrics for Finite Markov Decision Processes.
2004
Doina Precup
Prakash Panangaden
Norm Ferns
Cited by 179
Exploring uncertainty measures in deep networks for multiple sclerosis lesion detection and segmentation
2020
Douglas Lorne Arnold, MD, FRCP(C)
T Nair
Tal Arbel
+2
Cited by 162
Activity and gait recognition with time-delay embeddings.
2010
Shie Mannor
Doina Precup
Jordan Frank
Cited by 158
Learning with pseudo-ensembles
2014
Doina Precup
Ouais Alsharif
Philip Bachman
Cited by 156
Reproducibility of benchmarked deep reinforcement learning tasks for continuous control
2017
Peter Henderson
Maziar Gomrokchi
Doina Precup
+2
Cited by 156
Intra-Option Learning about Temporally Abstract Actions.
1998
Doina Precup
Satinder Singh
Richard S. Sutton
Cited by 154
Theoretical results on reinforcement learning with temporally abstract options
1998
Richard S. Sutton
Doina Precup
Satinder Singh
Cited by 147
Multi-time models for temporally abstract planning
1998
Doina Precup
Richard S. Sutton
Cited by 143
Conditional computation in neural networks for faster models
2015
Emmanuel Bengio
Pierre-Luc Bacon
Doina Precup
+1
Cited by 143
An information-theoretic approach to curiosity-driven reinforcement learning
2012
Doina Precup
S Still
Cited by 122
Sparse distributed memories for on-line value-based reinforcement learning
2004
Doina Precup
B Ratitch
Cited by 118
Wikispeedia: An online game for inferring semantic distances between concepts
2009
Joelle Pineau
Robert West
Doina Precup
Cited by 114
A convergent form of approximate policy iteration
2003
Theodore J. Perkins
Doina Precup
Cited by 104
Classification of normal and hypoxic fetuses from systems modeling of intrapartum cardiotocography
2010
Doina Precup
Philip Warrick
EF Hamilton
+1
Cited by 102
Learning from limited demonstrations
2013
Amir-massoud Farahmand
Joelle Pineau
Doina Precup
+1
Cited by 84
Partial model completion in model driven engineering using constraint logic programming
2007
S Sen
Doina Precup
Benoit Baudry
Cited by 78
Active learning in partially observable markov decision processes
2005
Joelle Pineau
Doina Precup
R Jaulmes
Cited by 73
Time series analysis using geometric template matching
2012
Doina Precup
Shie Mannor
Joelle Pineau
+1
Cited by 72
Using options for knowledge transfer in reinforcement learning
1999
Theodore J. Perkins
Doina Precup
Cited by 68
Learning to schedule straight-line code
1998
Paul E Utgoff
J Eliot B Moss
David Scheeff
+4
Cited by 62
Methods for computing state similarity in Markov decision processes
2012
Prakash Panangaden
Norm Ferns
Doina Precup
+1
Cited by 61
When waiting is not an option: Learning options with a deliberation cost
2017
Doina Precup
Jean Harb
Martin Klissarov
+1
Cited by 59
Hierarchical probabilistic Gabor and MRF segmentation of brain tumours in MRI volumes
2013
Nagesh Subbanna
D. Louis Collins
Tal Arbel
+1
Cited by 57
Improved switching among temporally abstract actions
1999
Richard S. Sutton
Balaraman Ravindran
Doina Precup
+1
Cited by 56
Metrics for Markov decision processes with infinite state spaces
2012
Prakash Panangaden
Doina Precup
Norm Ferns
Cited by 56
Learning in non-stationary partially observable Markov decision processes
2005
Joelle Pineau
Doina Precup
R Jaulmes
Cited by 52
Constructive function approximation
1998
PE Utgoff
Doina Precup
Cited by 49
Independently controllable factors
2017
Valentin Thomas
Joelle Pineau
Philippe Beaudoin
+6
Cited by 49
Smart exploration in reinforcement learning using absolute temporal difference errors
2013
Clement Gehring
Doina Precup
Cited by 47
Bisimulation metrics for continuous Markov decision processes
2011
Prakash Panangaden
Doina Precup
Norm Ferns
Cited by 47
Data generation as sequential decision making
2015
Philip Bachman
Doina Precup
Cited by 46
Redagent-2003: An autonomous market-based supply-chain management agent
2004
PW Keller
FO Duguay
Doina Precup
Cited by 45
Using finite experiments to study asymptotic performance
2002
C McGeoch
Paul R. Cohen
Doina Precup
+2
Cited by 45
Planning with closed-loop macro actions
1997
Doina Precup
Satinder Singh
Richard S. Sutton
Cited by 44
Combining TD-learning with cascade-correlation networks
2003
Doina Precup
Francois Rivest
Cited by 44
Bounding performance loss in approximate MDP homomorphisms
2009
P Panagaden
Doina Precup
Jonathan Taylor
Cited by 43
Combined reinforcement learning via abstract representations
2019
Yoshua Bengio
Joelle Pineau
Vincent François-Lavet
+1
Cited by 43