Your Daily AI Research tl;dr — 2022–07–10 🧠

Mastering Code Generation, Predicting Models’ Generalization Abilities and a Special Investigation into Cruise

Welcome to your official daily AI research tl;dr (often with code and news) for AI enthusiasts where I share the most exciting papers I find daily, along with a one-liner summary to help you quickly determine if the article (and code) is worth investigating. I will also take this opportunity to share daily exciting news in the field.

Let’s get started with this iteration!

1️⃣ CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning

A new framework for program synthesis (Code Generation) tasks through pretrained LMs and deep reinforcement learning (RL).

Link to the paper: https://arxiv.org/pdf/2207.01780.pdf

Code: https://github.com/salesforce/CodeRL

2️⃣ Neural Networks and the Chomsky Hierarchy

Really interesting paper by DeepMind: “In this work, we conduct an extensive empirical study (2200 models, 16 tasks) to investigate whether insights from the theory of computation can predict…