Past Talks
2024
Gabriela Kadlecova (Charles University Prague) - GRAF: Performance Prediction with Neural Graph Features (video)
Tennison Liu and Nicolas Astorga (University of Cambridge) - Large Language Models to Enhance Bayesian Optimization (video)
Robert Lange (SakanaAI) - The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery (video)
Linus Eriksson (University of Edinburgh) - einspace: Searching for Neural Architectures from Fundamental Operations (video)
Ganesh Jawahar (Google Deepmind) - Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts (video)
Carl Hvarfner (Lund University, WASP) - Vanilla Bayesian Optimization Performs Great in High Dimensions (video)
Łukasz Dudziak (Samsung) - Neural Fine-Tuning Search for Few-Shot Learning (video)
Julien Siems (University of Freiburg) and Riccardo Grazzi (IIT) - Is Mamba Capable of In-Context Learning? (video)
Sebastian Pineda (University of Freiburg) - Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How (video)
Xingyou (Richard) Song (Google) - OmniPred: Towards Universal Regressors with Language Models (video)
Arber Zela (University of Freiburg) - Multi-objective Differentiable Neural Architecture Search (video)
Nick Erickson (AWS) - AutoGluon 1.0: Shattering the SOTA with Zeroshot-HPO & Dynamic Stacking (video)
Rhea Sukthanker (University of Freiburg) and Samuel Dooley (Abacus.ai) : Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face-Recognition (video)
Andreas Müller (Microsoft) - MotherNet: A Foundational Hypernetwork for Tabular Classification (video)
2023
Arkadiy Dushatskiy (CWI) - Multi-Objective Population Based Training (video)
Elliot Crowley (University of Edinburgh) - Zero-cost proxies and expanding search spaces with program transformations in NAS
Noah Hollmann (University of Freiburg) - LLMs for Automated Data Science: Introducing CAAFE for Context-Aware Automated Feature Engineering (video)
Jean Kaddour and Oscar Key (UCL) - No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models (video)
Theresa Eimer (University of Hannover) - Challenges in Hyperparameter Optimization for Reinforcement Learning - Understanding AutoRL Through an AutoML Lens (video)
Alina Selega (Lunenfeld-Tanenbaum Research Institute, Vector Institute) - Multi-objective Bayesian optimization with heuristic objectives for biomedical and molecular data analysis workflows (video)
Robert Lange (TU Berlin) - Discovering Black-Box Optimizers via Evolutionary Meta-Learning (video)
Nicholas Roberts, Samuel Guo, Cong Xu (AutoML Decathlon Team) - AutoML Decathlon: Diverse Tasks, Modern Methods, and Efficiency at Scale (video)
Carola Doerr (Sorbonne Université) - Hyperparameter optimization and algorithm configuration from a black-box optimization perspective (video)
Xingyou (Richard) Song (Google) - Open Source Vizier: Distributed Infrastructure and API for Reliable and Flexible Blackbox Optimization (video)(slides)
Kartik Chandra and Audrey Xie (MIT) - Gradient Descent: The Ultimate Optimizer (video)
Subho Mukherjee (Microsoft) - AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers (video)
2022
Lisa Dunlap (UC Berkley) - Hyperparameter Tuning on the Cloud (video)
Łukasz Dudziak (Samsung) - Challenges of federated and zero-cost NAS (video)
Xingchen Wan (University of Oxford) - Bayesian Generational Population-Based Training (video)
Jiaming Song (NVIDIA) - A General Recipe for Likelihood-free Bayesian Optimization (video)
Mohamed Abdelfattah (Cornell University) - Fast and Hardware-Aware Neural Architecture Search (video)
Yutian Chen (Deepmind) - Towards Learning Universal Hyperparameter Optimizers with Transformers (video)
Samuel Mueller (University of Freiburg) - Transformers can do Bayesian Inference (video)
Greg Yang (Microsoft) - Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer (video)
Zi Wang (Google) - Pre-training helps Bayesian optimization too (video)
Ruohan Wang (UCL) - Global labels and few-shot learning (video)
Martin Wistuba (AWS) - Few-Shot Bayesian Optimization (video)
Antonio Carta (University of Pisa) - Avalanche: an End-to-End Library for Continual Learning (video)
David Salinas (Amazon) - Tutorial on Syne Tune (video)
David Eriksson (Meta) - “High-Dimensional Bayesian Optimization” (video)
Jonas Rothfuss (ETH Zurich) -“Meta-Learning Reliable Priors for Bayesian Optimization”
2021
Willie Neiswanger (Stanford University) -“Going Beyond Global Optima with Bayesian Algorithm Execution”(video)
Ameet Talwalkar (Carnegie Mellon University & Determined AI) - “Automating Architecture Design for Emerging ML Tasks”(video)
Xavier Bouthillier (Université de Montréal) - “Reliability of benchmarks and why HPO is important”(ref)(video)
Bilge Celik (Eindhoven University of Technology), “Adaptation Strategies for Automated Machine Learning on Evolving Data”(video)
Debadeepta Dey (Microsoft Research) - “Ranking Architectures by their Feature Extraction Capabilities”(video)
Jörg Franke (University of Freiburg) - “Sample-Efficient Automated Deep Reinforcement Learning”(video)
Yan Wu (ETH Zurich) - “NAS as Sparse Supernet” & “Trilevel NAS for Efficient Single Image Super-Resolution” (video)
Louis Tiao (University of Sydney) - “Bayesian Optimization by Classification” (video)
Gabriel Bender (Google Brain) - “Can weight sharing outperform random architecture search? An investigation with TuNAS” (video)
Wuyang Chen (University of Texas at Austin) - “Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective” (video)
Xuanyi Dong (University of Technology Sydney) - Extending the Search from Architecture to Hyperparameter, Hardware, and System (video)
Josif Grabocka (University of Freiburg) - “Deep Learning for Tabular Datasets”
Marius Lindauer (University of Hannover) - “Towards Explainable AutoML: xAutoML”
Arber Zela (University of Freiburg & ELLIS) - “Neural Ensemble Search for Uncertainty Estimation and Dataset Shift”
Jeff Clune (OpenAI) - “Learning to Continually Learn”
2020
Binxin (Robin) Ru (University of Oxford) - Interpretable Neural Architecture Search
Sebastian Flennerhag (Deepmind) - Jointly learning a model and its learning rule
Colin White (Abacus.ai) - Bananas, Encodings, and Local Search: Insights into Neural Architecture Search (ref1,ref2,ref3)
Zohar Karnin (Amazon AWS) - Practical and sample efficient zero-shot HPO
Rodolphe Jenatton (Google Brain) - Hyperparameter Ensembles for Robustness and Uncertainty Quantification
Matthias Polozeck (Uber AI) - Scalable Bayesian optimization for Industrial Applications
Joaquin Vanschoren (Eindhoven University of Technology) - Towards ever-learning AutoML
Frank Hutter (University of Freiburg) - Neural Architecture Search: Coming of Age(slides)
Valerio Perrone (Amazon): “Fair Bayesian Optimization”(ICML Video)
Matthias Seeger (Amazon): “Model-based Asynchronous Hyperparameter and Neural Architecture Search”
Fabio Maria Carlucci (Huawei): Why NAS evaluation is frustratingly hard and how Generator-based optimization can help” (Slides)
David Salinas (Naver Labs): “A quantile-based approach for hyperparameter transfer learning”