DeepMind Research

This repository contains implementations and illustrative code to accompany DeepMind publications. Along with publishing papers to accompany research conducted at DeepMind, we release open-source environments, data sets, and code to enable the broader research community to engage with our work and build upon it, with the ultimate goal of accelerating scientific progress to benefit society. For example, you can build on our implementations of the Deep Q-Network or Differential Neural Computer, or experiment in the same environments we use for our research, such as DeepMind Lab or StarCraft II.

If you enjoy building tools, environments, software libraries, and other infrastructure of the kind listed below, you can view open positions to work in related areas on our careers page.

For a full list of our publications, please see https://deepmind.com/research/publications/

Projects

• Magnetic control of tokamak plasmas through deep reinforcement learning, Nature 2022
• Pushing the Frontiers of Density Functionals by Solving the Fractional Electron Problem, Science 2021
• Mind the Gap: Assessing Temporal Generalization in Neural Language Models, NeurIPS 2021
• The Difficulty of Passive Learning in Deep Reinforcement Learning, NeurIPS 2021
• Skilful precipitation nowcasting using deep generative models of radar, Nature 2021
• Compute-Aided Design as Language
• Encoders and ensembles for continual learning
• Towards mental time travel: a hierarchical memory for reinforcement learning agents
• Perceiver IO: A General Architecture for Structured Inputs & Outputs
• Solving Mixed Integer Programs Using Neural Networks
• A Realistic Simulation Framework for Learning with Label Noise
• Rapid Task-Solving in Novel Environments, ICLR 2021
• WikiGraphs: A Wikipedia - Knowledge Graph Paired Dataset, TextGraphs 2021
• Behavior Priors for Efficient Reinforcement Learning
• Learning Mesh-Based Simulation with Graph Networks, ICLR 2021
• Open Graph Benchmark - Large-Scale Challenge (OGB-LSC)
• Synthetic Returns for Long-Term Credit Assignment
• A Deep Learning Approach for Characterizing Major Galaxy Mergers
• Better, Faster Fermionic Neural Networks (KFAC implementation)
• Object-based attention for spatio-temporal reasoning
• Effective gene expression prediction from sequence by integrating long-range interactions
• Satore: First-order logic saturation with atom rewriting
• Characterizing signal propagation to close the performance gap in unnormalized ResNets, ICLR 2021
• Uncovering the Limits of Adversarial Training against Norm-Bounded Adversarial Examples
• Learning rich touch representations through cross-modal self-supervision, CoRL 2020
• Functional Regularisation for Continual Learning, ICLR 2020
• The Autoencoding Variational Autoencoder, NeurIPS 2020
• Self-Supervised MultiModal Versatile Networks, NeurIPS 2020
• ODE-GAN: Training GANs by Solving Ordinary Differential Equations, NeurIPS 2020
• Algorithms for Causal Reasoning in Probability Trees
• Gated Linear Networks, NeurIPS 2020
• Value-driven Hindsight Modelling, NeurIPS 2020
• Targeted free energy estimation via learned mappings, Journal of Chemical Physics 2020
• Learning to Simulate Complex Physics with Graph Networks, ICML 2020
• Physically Embedded Planning Problems
• PolyGen: PolyGen: An Autoregressive Generative Model of 3D Meshes, ICML 2020
• Bootstrap Your Own Latent
• Catch & Carry: Reusable Neural Controllers for Vision-Guided Whole-Body Tasks, SIGGRAPH 2020
• MEMO: A Deep Network For Flexible Combination Of Episodic Memories, ICLR 2020
• RL Unplugged: Benchmarks for Offline Reinforcement Learning
• Disentangling by Subspace Diffusion (GEOMANCER), NeurIPS 2020
• What can I do here? A theory of affordances in reinforcement learning, ICML 2020
• Scaling data-driven robotics with reward sketching and batch reinforcement learning, RSS 2020
• Path-Specific Counterfactual Fairness, AAAI 2019
• The Option Keyboard: Combining Skills in Reinforcement Learning, NeurIPS 2019
• VISR - Fast Task Inference with Variational Intrinsic Successor Features, ICLR 2020
• Unveiling the predictive power of static structure in glassy systems, Nature Physics 2020
• Multi-Object Representation Learning with Iterative Variational Inference (IODINE)
• AlphaFold CASP13, Nature 2020
• Unrestricted Adversarial Challenge
• Hierarchical Probabilistic U-Net (HPU-Net)
• Training Language GANs from Scratch, NeurIPS 2019
• Temporal Value Transport, Nature Communications 2019
• Continual Unsupervised Representation Learning (CURL), NeurIPS 2019
• Unsupervised Learning of Object Keypoints (Transporter), NeurIPS 2019
• BigBiGAN, NeurIPS 2019
• Deep Compressed Sensing, ICML 2019
• Side Effects Penalties
• PrediNet Architecture and Relations Game Datasets
• Unsupervised Adversarial Training, NeurIPS 2019
• Graph Matching Networks for Learning the Similarity of Graph Structured Objects, ICML 2019
• REGAL: Transfer Learning for Fast Optimization of Computation Graphs
• Deep Ensembles: A Loss Landscape Perspective
• Powerpropagation
• Physics Inspired Models

Disclaimer

This is not an official Google product.