Kürzlich aktualisierte Kanäle

Wählen, um nur diesen Kanal zu sehenAlle Kanäle →

Ergebnisse

64 Artikel
Sortieren
1:46:41EN
Cognitive Revolution "How AI Changes Everything"· 21. Dez. 2024PodcastFrontier Models Hit the 10th–40th Percentile on Real AI R&DModeration: Nathan LabenzNeev Parikh of METR walks Nathan Labenz through REBench, a seven-task test of whether agents can do machine learning research—and what happened when one of them decided not to train.Evals & ObservabilityEvalsBenchmarks+3
1:49:41EN
Cognitive Revolution "How AI Changes Everything"· 21. Nov. 2024PodcastA Team of Fifteen Matched Meta’s Post-Training on Meta’s Own BaseModeration: Nathan LabenzNathan Lambert walks through Tulu 3: the three-stage recipe, the 1 percent versus 14 percent lesson, and why open post-training now lives or dies on data and evals.Modelle & TrainingPost-trainingData quality & curation+3
1:23:37EN
Cognitive Revolution "How AI Changes Everything"· 23. Okt. 2024PodcastNine of the top ten research ideas were Claude'sModeration: Nathan LabenzStanford PhD student Chenglei Si ran a blind study pitting Claude 3.5 Sonnet against more than a hundred NLP researchers on novel research ideas.Evals & ObservabilityEvalsBenchmarks+3
2:37:47EN
Cognitive Revolution "How AI Changes Everything"· 19. Okt. 2024PodcastThe intern who wrote GELU now wants humanity's last examModeration: Nathan LabenzDan Hendrycks on activation functions, five-year benchmarks, jailbreaks that do not yield to scale, and stacking defenses because no single layer is trustworthy.SicherheitAI securitySicherheit & Governance+3
2:25:53EN
Cognitive Revolution "How AI Changes Everything"· 16. Okt. 2024PodcastWhen GPT-4's Base Model Introduced Itself, 75% of the Answers Were About AIModeration: Nathan LabenzOwain Evans tells Michael Trazzi why situational awareness and out-of-context reasoning are leading indicators of deceptive alignment, and why a pretrained model with almost no self-knowledge still kept talking about being an AI.SicherheitSicherheit & GovernanceEvals+3
1:09:09EN
Cognitive Revolution "How AI Changes Everything"· 2. Okt. 2024Podcast30 Percent on SWE-bench: Cosine Taught Genie How Engineers Actually ThinkModeration: Nathan LabenzAlistair Pullen tells Latent Space how Cosine reconstructed human problem-solving, fine-tuned on billions of tokens, and took the top score on software engineering’s hardest public test.Coding-AgentenAgent EngineeringFine-Tuning+3
1:54:17EN
Cognitive Revolution "How AI Changes Everything"· 28. Aug. 2024PodcastMetaculus Flagged Covid in January 2020. Now It Is Putting AI on the Forecasting DeskModeration: Nathan LabenzNathan Labenz talks with Metaculus CEO Deger Turan about epistemic security, a year-long bot tournament, and why a useful forecast is harder than an accurate one.Evals & ObservabilityEvalsBenchmarks+3
1:56:03EN
Cognitive Revolution "How AI Changes Everything"· 13. Juli 2024PodcastHumans Near a Perfect Score. The Best AI Still Gets 39%Moderation: Nathan LabenzZapier co-founder Mike Knoop and François Chollet put $1 million on ARC-AGI, a 2019 test of sample-efficient intelligence that language models still cannot crack under a one-cent-per-puzzle budget.Evals & ObservabilityAGIBenchmarks+3
55:13EN
Sequoia Capital· 2. Juli 2024PodcastThe Best AI Scores 39% on This Test. Zapier’s Co-Founder Put $1 Million on Beating ItFrançois Chollet designed ARC to measure skill-acquisition efficiency; five years later humans still crush it and frontier models do not.Evals & ObservabilityBenchmarksAGI Timelines+3
26:00EN
No Priors: AI, Machine Learning, Tech, & Startups· 11. Juni 2024Podcast · 2 StimmenWhy a Zapier founder thinks AGI research has been stalled for four yearsModeration: Sarah Guo, Elad GilMike Knoop and François Chollet put more than a million dollars on beating ARC-AGI, the eval they say actually measures general intelligence.Evals & ObservabilityAGIBenchmarks+3
4 Folien17:12EN
MBMatthew Berman· 30. Apr. 2024Testing the Mystery 'gpt2-chatbot' Model in April 2024Matthew Berman · Forward FutureMatthew Berman tries an anonymous model on coding, arithmetic and reasoning tasks while its identity remains uncertain.BenchmarksModelle & TrainingCoding-Agenten+1
3 Folien16:28EN
MBMatthew Berman· 23. Apr. 2024Testing Reka Core: Multimodal Benchmarks, Coding and ReasoningMatthew Berman · Forward FutureMatthew Berman reviews Reka’s reported model comparisons and tests Core on code, logic and image understanding.Multimodal AIBenchmarksModelle & Training+1
1:20:44EN
Cognitive Revolution "How AI Changes Everything"· 30. März 2024PodcastSeeing Like a Mamba: Vision, Rotting States, and a Cell Model in 90 DaysModeration: Nathan LabenzNathan Labenz and Jason Meaux survey the vision papers, long-context experiments, and biology work that followed the original Mamba release.Modelle & TrainingAI researchTransformers & attention+3
1:25:35EN
Cognitive Revolution "How AI Changes Everything"· 21. Mai 2023PodcastTwo and a Half Years From 33.3% to 86.5%: Google Sent Foundation Models to Medical SchoolModeration: Nathan LabenzVivek Natarajan walks Nathan Labenz through Med-PaLM and Med-PaLM 2: the data-light techniques, the nine-axis clinician evals, and why a high USMLE-style score is the wrong trophy.Modelle & TrainingAI in healthcareFine-Tuning+3
58:24EN
Cognitive Revolution "How AI Changes Everything"· 11. Mai 2023PodcastAmong 100 Random Doctors, Zak Kohane Would Be Surprised If One Beat GPT-4Moderation: Nathan LabenzHarvard's biomedical informatics chair on a rare newborn case, why drug-style trials will not certify a general medical model, and why the AI should still work for the patient.AI in healthcareEvalsHuman-AI Collaboration+3
53:37EN
No Priors: AI, Machine Learning, Tech, & Startups· 9. März 2023Podcast · 2 Stimmen30 models, 42 scenarios, 7 metrics: Percy Liang's public checkup for language modelsModeration: Sarah Guo, Elad GilA PubMed-only model once led the U.S. medical licensing exam — until a system roughly 200 times larger overtook it.Evals & ObservabilityAI researchFoundation Models+3
2:34:20EN
Lex Fridman· 30. Aug. 2020Podcast · 2 StimmenIntelligence Is How Efficiently You Acquire Skills You Were Not Prepared ForGast: François Chollet · Moderation: Lex FridmanFrançois Chollet tells Lex Fridman why skill is not intelligence, why GPT-3 is still pattern matching, and why a grid puzzle called ARC still separates children from machines.Evals & ObservabilityBenchmarksAI research+3
1:49:51EN
Lex Fridman· 27. Juni 2020Podcast · 2 StimmenThe Idea Once Called a Devolution Now Powers Almost Every New ChipGast: David Patterson · Moderation: Lex FridmanTuring Award winner David Patterson talks with Lex Fridman about RISC, RAID, Moore's Law, open hardware, and why chips without a software stack die.Infrastruktur & DeploymentOpen-source ecosystemsBenchmarks+1
16:03EN
Lex Fridman· 22. Feb. 2020Podcast · 2 StimmenQuantum Supremacy Is a Well-Defined Speedup, Not a Useful TaskGast: Scott Aaronson · Moderation: Lex FridmanScott Aaronson explains what Google's 53-qubit experiment actually demonstrated, how it was verified, and why complexity theory can offer evidence but not proof against classical spoofing.BenchmarksScience Communication
5 Folien57:57EN
JSJane Street· 8. Mai 2019Sebastian Funk on a Fast, Safe and Maintainable Packet ProcessorSebastian Funk · Jane StreetA single-core market-data case study shows how latency targets, allocation control and generated code can coexist with high-level abstractions.Software engineeringBenchmarksInfrastruktur & Deployment
11:11EN
Lex FridmanPodcast · 2 StimmenYann LeCun on Benchmarks, Interactive Environments, and Why Human Intelligence Is Not GeneralGast: Yann Lecun · Moderation: Lex FridmanIn a 2019 clip, LeCun defends benchmarks as a test of AI claims, explains why interactive environments break the usual train-test protocol, and argues that "general intelligence" is a misnomer.Modelle & TrainingBenchmarksAGI+3
1:22:57EN
Cognitive Revolution "How AI Changes Everything"PodcastHuman-Level but Not Human-Like: A GPT-4 Red Teamer on What He Saw Behind the MaskModeration: Nathan LabenzNathan Labenz recounts two months of full-time testing of an early GPT-4, from the AI doctor of his dreams to a model that would plan assassinations on request.SicherheitAI securitySicherheit & Governance+3
14:41EN
Lex FridmanPodcast · 2 StimmenTalking for 20 Minutes: How the Alexa Prize Turns Real Customers into a Testbed for Conversational AIGast: Rohit Prasad · Moderation: Lex FridmanRohit Prasad, head scientist of Amazon Alexa, explains the Alexa Prize grand challenge, how it is judged and why true conversation still needs reasoning.Produkt & UXSprach-KIAI research+3
16:41EN
Lex FridmanPodcastAlphaFold 2 and the Protein-Folding Breakthrough: Why Lex Fridman Calls It a Landmark for AI and BiologyModeration: Lex FridmanA quick explainer on DeepMind's CASP14 result, how protein folding works, how AlphaFold 1 and 2 likely differ, and what the advance could unlock.Modelle & TrainingAI for scienceDeep Learning+2
Mehr laden24 von 64 angezeigt