Mechanical Dirk

Mechanical Dreams

Science EN ↓ 153 episodes

An automatically generated podcast about machine learning and natural language processing. The two fictional hosts talk about papers that I want to learn more about on my way to work. It's not good, but it's useful.

Author

Mechanical Dirk

Category

Science

Latest episode

May 27, 2026

Where to listen?

Podcasts in the app Replaio Radio Coming soon

Podcasts are coming to the app soon. Install now and be the first to see a whole new take on podcasts

Get it on Google Play Install for free Android 5M+ downloads · 4.8 rating iOS soon

Episodes

Phi-4 14.12.2024
Rephrasing natural text data with different languages and quality levels 13.12.2024
Unveiling and Consulting Core Experts in Retrieval-Augmented MoE-based LLMs 12.12.2024
EXAONE 3.5 11.12.2024
Model soups - averaging weights of multiple fine-tuned models improves accuracy without increasing inference time 09.12.2024
Model-Aware Data Selection for Efficient Pretraining with Data Influence Models 06.12.2024
Nemotron-CC 05.12.2024
Tülu 3 02.12.2024
The Zamba2 Suite 29.11.2024
Small-scale proxies for large-scale Transformer training instabilities 26.11.2024
Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training 25.11.2024

I slightly tweaked the personality of the hosts.

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations 19.11.2024
Understanding WSD Learning Rates 18.11.2024
Toward Understanding Why Adam Converges Faster Than SGD for Transformers 16.11.2024

New generation algorithm! Should make the episodes longer, more detailed, and more coherent.

Amuro & Char - Analyzing the Relationship between Pre-Training and Fine-Tuning of Large Language Models 08.11.2024
Evaluation data contamination in LLMs: How do we measure it and (when) does it matter? 07.11.2024
How Does Critical Batch Size Scale in Pre-training? 04.11.2024
The Road Less Scheduled 01.11.2024
Learning-Rate-Free Learning by D-Adaptation 31.10.2024
Scaling FP8 Training to Trillion Token LLMs 30.10.2024
Geometric Dynamics of Signal Propagation Predict Trainability of Transformers 29.10.2024
A Survey on Model MoErging 28.10.2024
Liquid Time-constant Networks 27.10.2024
Scaling Laws for Predicting Downstream Performance in LLMs 26.10.2024
A Spectral Condition for Feature Learning 25.10.2024

Listen to the Mechanical Dreams podcast in Replaio

Radio and podcasts in one app - free, with no sign-up. Install today and do not miss the launch

Get it on Google Play

Replaio is not a podcast publisher; show names, artwork and audio belong to their authors and are distributed through public RSS feeds.