Kaixhin/Rainbow
Kaixhin/Rainbow has 1,674 GitHub stars and 294 forks. GitHot measured 0 stars in 24 hours, 0 in 7 days, and 0 in 15 days. Last checked 2026-11-19 01:14 UTC. Last push 2022-01-13.
측정된 스타 증가
- in 24h
- 0
- in 7 days
- 0
- in 15 days
- 0
- in 1 month
- 기록 수집 중
서로 겹치는 기간의 순증가량이며 일별 합계가 아닙니다. 측정값이 없으면 비워 둡니다. 스타는 관심도를 나타내며 품질을 보장하지 않습니다.
소개
Rainbow: Combining Improvements in Deep Reinforcement Learning
머신러닝README.md
OriginalRainbow
Rainbow: Combining Improvements in Deep Reinforcement Learning [1].
Results and pretrained models can be found in the releases.
- DQN [2]
- Double DQN [3]
- Prioritised Experience Replay [4]
- Dueling Network Architecture [5]
- Multi-step Returns [6]
- Distributional RL [7]
- Noisy Nets [8]
Run the original Rainbow with the default arguments:
python main.py
Data-efficient Rainbow [9] can be run using the following options (note that the "unbounded" memory is implemented here in practice by manually setting the memory capacity to be the same as the maximum number of timesteps):
python main.py --target-update 2000 \
--T-max 100000 \
--learn-start 1600 \
--memory-capacity 100000 \
--replay-frequency 1 \
--multi-step 20 \
--architecture data-efficient \
--hidden-size 256 \
--learning-rate 0.0001 \
--evaluation-interval 10000
Note that pretrained models from the 1.3 release used a (slightly) incorrect network architecture. To use these, change the padding in the first convolutional layer from 0 to 1 (DeepMind uses "valid" (no) padding).
Requirements
To install all dependencies with Anaconda run conda env create -f environment.yml and use source activate rainbow to activate the environment.
Available Atari games can be found in the atari-py ROMs folder.
Acknowledgements
- @floringogianu for categorical-dqn
- @jvmancuso for Noisy layer
- @jaara for AI-blog
- @openai for Baselines
- @mtthss for implementation details
References
[1] Rainbow: Combining Improvements in Deep Reinforcement Learning
[2] Playing Atari with Deep Reinforcement Learning
[3] Deep Reinforcement Learning with Double Q-learning
[4] Prioritized Experience Replay
[5] Dueling Network Architectures for Deep Reinforcement Learning
[6] Reinforcement Learning: An Introduction
[7] A Distributional Perspective on Reinforcement Learning
[8] Noisy Networks for Exploration
[9] When to Use Parametric Models in Reinforcement Learning?