Member-only story
Your Daily AI Research tl;dr 2022–07–11 🧠
IBM used Watson to Predict who will Win Wimbledon (spoilers: it failed), LViT applied to medical imaging, and beating power law scaling via data pruning
Welcome to your official daily AI research tl;dr (often with code and news) for AI enthusiasts where I share the most exciting papers I find daily, along with a one-liner summary to help you quickly determine if the article (and code) is worth investigating. I will also take this opportunity to share daily exciting news in the field.
Let’s get started with this iteration!
1️⃣ Beyond neural scaling laws: beating power law scaling via data pruning
They “show how both in theory and practice [they] can break beyond power-law scaling and reduce it to exponential scaling instead if we have access to a high-quality data pruning metric that ranks the order in which training examples should be discarded to achieve any pruned dataset size.”
Link to the paper: https://arxiv.org/pdf/2206.14486v1.pdf