Jeremy Howard on Practical Deep-Learning Research

The fast.ai co-founder discusses incentives, transfer learning and active learning.

JHJeremy Howardゲスト · fast.ai
チャンネル
Lex Fridman
公開日
2019年9月10日
動画
4:39
読了時間
1 分
原文
英語
YouTube で開く
スクロールすると動画は右下に小さくなって再生を続けます。字幕は閲覧言語に合わせて切り替わります。
閲覧言語2 言語で読めます
この記事はまだ日本語に翻訳されていないため、英語の原文を表示しています。
要約

30 秒でわかる

Howard argues that research should address practical needs and recounts a transfer-learning project.

  1. 1IncentivesHoward criticizes publication incentives.
  2. 2TransferHe values using less data.
  3. 3Active learningHe describes selecting examples for labeling.
  4. 4Career pressureHe acknowledges junior researchers’ constraints.

ポイント

  1. He questions publication incentives.
  2. Transfer and active learning can reduce resource demands.
  3. Career pressures affect research choices.
全文

チャプターごとに整えた全文を読む

文字起こしのみ
01

Research incentives

Lex Fridman asks fast.ai co-founder Jeremy Howard about the gap between deep-learning theory and practical work.

Lex Fridman asks fast.ai co-founder Jeremy Howard about the gap between deep-learning theory and practical work.

Howard criticizes research incentives that he believes favor incremental work on familiar topics over practical impact. This is his assessment of the field.

02

Transfer and active learning

He argues that transfer learning can enable useful work with fewer resources and data, and says he considers it insufficiently studied.

He argues that transfer learning can enable useful work with fewer resources and data, and says he considers it insufficiently studied.

Howard also highlights active learning, where a system helps select which examples people should label.

He describes a practical reason for prioritizing difficult examples: labeling everything can be slow and expensive.

03

A practical project

Howard recounts work with Sebastian Ruder on transfer learning for natural-language processing and says the project began as a practical teaching need.

Howard recounts work with Sebastian Ruder on transfer learning for natural-language processing and says the project began as a practical teaching need.

He says their prototype performed strongly on a benchmark and was later written up and published.

Howard acknowledges that junior researchers may face different incentives and pressure to select safer, familiar topics.

同じチャンネルの記事

スライド 3 枚3:34:27EN
Lex Fridman· 2026年10月26日ポッドキャスト · 4 人AI, Mathematics, and the Meaning of a Proofゲスト Steven Brunton, Ankur Moitra, Alex Kontorovich · ホスト Lex FridmanLex Fridman and three mathematicians discuss recent AI-generated research, hard open problems and what human understanding contributes.MathematicsAI for scienceAI research+2
3:36:56EN
Lex Fridman· 2026年9月16日ポッドキャストPsychiatry Has Never Found Its Penicillinホスト Lex FridmanHistorian Andrew Scull tells Lex Fridman why the field can ease symptoms, has never cured a major mental illness, and keeps paying for overconfidence with patients' lives.Mental HealthPublic HealthNeuroscience
5:15:51EN
Lex Fridman· 2026年8月26日ポッドキャスト · 2 人DHH Did Not Write a Line of Omarchy Quattroゲスト DHH · ホスト Lex FridmanThirteen months after a skeptical conversation with Lex Fridman, the Rails creator describes how Opus 4.5, a swarm of coding agents, and a one-minute Linux installer ended his era of hand-chiseled Ruby.コーディングエージェントVibe Codingエージェント工学+3
3:12:58EN
Lex Fridman· 2026年8月12日ポッドキャスト · 2 人One Cold Shower, Twenty Champions: How Khabib Nurmagomedov Was Forgedゲスト Khabib Nurmagomedov · ホスト Lex FridmanIn a Makhachkala school gym, seventy men shared one shower, and the water was only cold.Martial ArtsCombat SportsCoaching+3
3:46:18EN
Lex Fridman· 2026年7月28日ポッドキャスト · 2 人If You Take Slavery Out of the Picture, There Is No Civil Warゲスト Gary Gallagher · ホスト Lex FridmanIn 1860, enslaved people were worth more than every railroad and factory in the United States combined.Political PhilosophyLeadershipHistory
3:51:47EN
Lex Fridman· 2026年6月30日ポッドキャスト · 2 人Forty-Six Percent of Emperors Were Overthrown. The Empire Lasted Anywayゲスト Anthony Kaldellis · ホスト Lex FridmanHistorian Anthony Kaldellis walks Lex Fridman through 2,200 years of Roman history and argues that what we call Byzantium was Rome itself.Political PhilosophyGeopoliticsLeadership