Kürzlich aktualisierte Kanäle

Wählen, um nur diesen Kanal zu sehenAlle Kanäle →

Ergebnisse

269 Artikel
Sortieren
3 Folien9:46EN
Matthew Berman· 17. Juli 2023Orca Mini V2 vs. OpenOrca: A 2023 Informal Model ComparisonMatthew Berman · Forward FutureMatthew Berman tests two Orca-inspired models on coding, writing and reasoning, with results shaped by prompt setup and subjective scoring.BenchmarksOpen-weight modelsReasoning & test-time compute+2
5 Folien8:04EN
Matthew Berman· 11. Juli 2023WizardLM 13B v1.1 Tested on Coding, Writing and LogicMatthew Berman · Forward FutureMatthew Berman tries an instruction-tuned model on a small set of prompts, with mixed results and several subjective scoring choices.EvalsOpen-weight modelsModelle & Training+1
3 Folien12:20EN
Matthew Berman· 10. Juli 2023Testing UltraLM 13B: A Small Model’s Strengths and Reasoning ErrorsMatthew Berman · Forward FutureA 2023 local test finds useful writing and simple coding alongside failures in games, arithmetic and logic.Open-weight modelsEvalsModelle & Training+1
54:00EN
20VC with Harry Stebbings· 30. Juni 2023Podcast · 2 StimmenDouwe Kiela on Data, Retrieval and Enterprise AIGast: Douwe Kiela · Moderation: Harry StebbingsThe Contextual AI CEO discusses language model trade-offs, evaluation, open models and the hurdles to enterprise use.Enterprise-KIRetrieval-Augmented GenerationData quality & curation+2
6 Folien18:08EN
Matthew Berman· 29. Juni 2023Six Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.BenchmarksOpen-weight modelsModelle & Training+1
4 Folien7:21EN
Matthew Berman· 26. Juni 2023Testing Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.Open-weight modelsEvalsDistillation+2
4 Folien13:50EN
Matthew Berman· 23. Juni 2023MPT-30B: Running MosaicML’s Model Locally and Testing Its Chat VariantMatthew Berman · Forward FutureMatthew Berman reviews MosaicML’s June 2023 release, demonstrates a local setup, and puts the hosted chat model through an informal prompt rubric.Open-weight modelsLocal inferenceQuantization+2
4 Folien10:23EN
Matthew Berman· 15. Juni 2023Testing Hosted Falcon 40B and Document Chat in h2oGPTMatthew Berman · Forward FutureMatthew Berman tries H2O.ai’s 2023 hosted Falcon 40B interface on coding, writing and reasoning prompts, then demonstrates document chat.Open-weight modelsEvalsAI research+1
6 Folien11:49EN
Matthew Berman· 1. Juni 2023Testing Wizard-Vicuna 30B: Responses, Reasoning, and CodeMatthew Berman · Forward FutureMatthew Berman examines a model marketed as uncensored, demonstrates a 2023 cloud setup, and runs an informal collection of tests.Modelle & TrainingEvalsAI Safety+1
1:33:51EN
Cognitive Revolution "How AI Changes Everything"· 23. Mai 2023PodcastGPT-4 still writes SQL that will not run. She put a guardrail on the modelModeration: Nathan LabenzShreya Rajpal built Guardrails AI so developers can encode what “correct” means, validate the pieces, and send failures back to the model instead of hoping the prompt holds.SicherheitEvalsHuman-in-the-Loop-Validierung+3
1:25:35EN
Cognitive Revolution "How AI Changes Everything"· 21. Mai 2023PodcastTwo and a Half Years From 33.3% to 86.5%: Google Sent Foundation Models to Medical SchoolModeration: Nathan LabenzVivek Natarajan walks Nathan Labenz through Med-PaLM and Med-PaLM 2: the data-light techniques, the nine-axis clinician evals, and why a high USMLE-style score is the wrong trophy.Modelle & TrainingAI in healthcareFine-Tuning+3
42:18EN
No Priors: AI, Machine Learning, Tech, & Startups· 18. Mai 2023Podcast · 2 StimmenTen Percent of Search Is Health — and the Doctor Is Googling TooModeration: Sarah Guo, Elad GilGoogle researcher Karan Singhal on Med-PaLM 2, the real bar for medical language models, and why medicine is a harder alignment lab than chatbots.Modelle & TrainingAI in healthcareSicherheit & Governance+3
1:28:43EN
Cognitive Revolution "How AI Changes Everything"· 16. Mai 2023PodcastClinical Guidelines Are 11% Evidence. Curai’s Founder Still Wants GPT-4 in the Exam RoomModeration: Nathan LabenzNeal Khosla of Curai Health argues that large language models already match median U.S. physicians on today’s tests — and that the real work is scaffolding, supervision, and a doctor’s signature.Unternehmen & StrategieAI in healthcareProduct Strategy+3
58:24EN
Cognitive Revolution "How AI Changes Everything"· 11. Mai 2023PodcastAmong 100 Random Doctors, Zak Kohane Would Be Surprised If One Beat GPT-4Moderation: Nathan LabenzHarvard's biomedical informatics chair on a rare newborn case, why drug-style trials will not certify a general medical model, and why the AI should still work for the patient.AI in healthcareEvalsHuman-AI Collaboration+3
2 Folien6:53EN
Matthew Berman· 4. Mai 2023StableVicuna’s 2023 Release: An Early RLHF Chatbot Put to the TestMatthew Berman · Forward FutureMatthew Berman reviews the 13-billion-parameter model and tests poetry, simple code, reasoning and a resignation email.Open-weight modelsReinforcement LearningEvals+1
1:21:06EN
Cognitive Revolution "How AI Changes Everything"· 27. Apr. 2023PodcastEveryone Talks About RLHF. Almost Nobody Is Doing It.Moderation: Nathan LabenzHumanloop CEO Raza Habib on why an LLM API is maybe five percent of a working product, and what actually fills the rest.Produkt & UXEvalsObservability & Zuverlässigkeit+3
5 Folien6:24EN
Matthew Berman· 6. Apr. 2023BloombergGPT: Mixing Financial and General Data for a Language ModelMatthew Berman · Forward FutureMatthew Berman examines the 2023 finance-focused research model, its training corpus, evaluation and decision not to release weights.KI im FinanzwesenModelle & TrainingEvals+1
1:56:16EN
Cognitive Revolution "How AI Changes Everything"· 6. Apr. 2023PodcastThey Used Humans as Stand-In AIs. Now 250,000 People Run Elicit.Moderation: Nathan LabenzOught's founders tell Nathan Labenz why open-ended reasoning has to be decomposed, supervised, and grounded—not scaled until it merely looks persuasive.RAG & WissenAgent EngineeringEvals+3
1:23:53EN
Cognitive Revolution "How AI Changes Everything"· 17. März 2023PodcastGPT-4, 24 Hours Later: No Safety Locks, a Captcha Hire, and a U.S.–China DeadlockModeration: Nathan LabenzA day after OpenAI shipped GPT-4, ChinaTalk sat a red teamer, a pessimist, and a policy researcher down to argue over capability, safety, and a race nobody can brake.SicherheitRed TeamingSicherheit & Governance+3
3 Folien11:53EN
Matthew Berman· 14. März 2023Testing GPT-4 Against GPT-3.5 at LaunchMatthew Berman · Forward FutureMatthew Berman reviews OpenAI's March 2023 GPT-4 announcement and compares the models on scheduling, reasoning, safety and travel prompts.OpenAIFoundation ModelsEvals+1
1:13:06EN
Lex Fridman· 19. Aug. 2019Podcast · 2 StimmenLockheed Martin's CTO on Autonomy, the Moon, and the Culture of Not Getting It WrongGast: Keoki Jackson · Moderation: Lex FridmanKeoki Jackson tells Lex Fridman why going back to the Moon is the easy part—and why proving a learning system will still do the right thing is not.SicherheitSicherheit & GovernanceHuman-in-the-Loop-Validierung+3
1:45:49EN
Cognitive Revolution "How AI Changes Everything"PodcastTrust at Scale: Elicit's Founders on Reasoning Languages, World Models and Automating the CompanyModeration: Nathan LabenzAndreas Stuhlmüller and Jungwon Byun explain how Elicit keeps frontier models checkable for high-stakes science, and where they think AI reasoning is heading.AgentenWorld modelsReasoning & test-time compute+3
1:25:13EN
Lenny's PodcastPodcastCodex Is Not Just a Coding Tool: OpenAI's Plan for an Agent That Behaves Like a TeammateModeration: Lenny RachitskyCodex product lead Alexander Embiricos explains the 20x growth, why every useful agent may need to write code, and why human review speed is the real bottleneck.Coding-AgentenCode review & verificationDeveloper productivity+3
1:33:50EN
Lenny's PodcastPodcastEvals Are the New PRDs: Inside Anthropic's Research Product TeamModeration: Lenny RachitskyDianne Penn, Anthropic's head of product for research and Labs, explains how the company found its identity, how her team turns user feedback into evals, and why human judgment still matters.Produkt & UXAI Product ManagementProduct Strategy+3
Mehr laden24 von 269 angezeigt