Results
326 articlesSort
1:09:09EN
Cognitive Revolution "How AI Changes Everything"· Oct 2, 2024Podcast30 Percent on SWE-bench: Cosine Taught Genie How Engineers Actually ThinkHost Nathan LabenzAlistair Pullen tells Latent Space how Cosine reconstructed human problem-solving, fine-tuned on billions of tokens, and took the top score on software engineering’s hardest public test.
10:57EN
Matthew Berman· Sep 13, 2024Testing OpenAI o1-preview: Tetris, Physical Reasoning and a North Pole ErrorMatthew Berman · Forward FutureIn September 2024, Matthew Berman runs the new reasoning-model preview through a personal rubric and examines where its answers succeed or fail.
21:21ENMatthew Berman· Sep 12, 2024OpenAI o1’s 2024 Launch: Reasoning Benchmarks and Early TestsMatthew Berman · Forward FutureMatthew Berman reviews o1-preview and o1-mini, OpenAI’s reported evaluations, and his own early coding experiments.
1:31:56ENMatthew Berman· Sep 12, 2024Testing OpenAI o1 on Puzzles, Code and Reasoning: A Launch-Day LivestreamMatthew Berman · Forward FutureMatthew Berman tries o1-preview and o1-mini on word counts, Tetris, physical reasoning and a word puzzle, with viewers checking the results.
51:15EN
Sequoia Capital· Sep 10, 2024PodcastAGI Has One Problem Left: Spend a Million Times More on a TokenMagic founder Eric Steinberger tells Sequoia’s Training Data why he trains his own models, why a software engineer is the MVP of AGI, and why 96% still is not a colleague.
37:47EN
No Priors: AI, Machine Learning, Tech, & Startups· Aug 30, 2024Podcast · 2 speakersWorking Backwards from AGI: Magic's Five-Million-Token BetHost Sarah Guo, Elad GilEric Steinberger wants a coding colleague you trust like a teammate — and a world that is still a good place thirty years after AGI.
1:30:24ENMatthew Berman· Aug 30, 2024Daniel Miessler and Matthew Berman on AI Privacy, Coding, and Generated WorldsMatthew Berman, Daniel Miessler, Melissa, Alex · Forward FutureA 2024 live conversation explores Recall, open models, AI-assisted programming, a Doom simulator and questions about security, energy and employment.
18:37ENMatthew Berman· Aug 29, 2024GameNGen Simulates Doom as AI Coding, Safety and Inference News AccelerateMatthew Berman · Forward FutureMatthew Berman reviews a 2024 game-simulation paper, Cursor, robotics, AI safety debates and new enterprise tools.
19:46ENMatthew Berman· Aug 28, 2024Linus Torvalds and Dirk Hohndel on AI Coding, Bugs and HypeMatthew Berman, Linus Torvalds, Dirk Hohndel · Forward FutureMatthew Berman reacts to two conversations about AI-assisted programming, code review, automation and open data.
18:39ENMatthew Berman· Aug 17, 2024AI Scientist, Grok-2 and Agent Q: Matthew Berman’s August 2024 AI News RoundupMatthew Berman · Forward FutureA week of model releases, web agents and AI research raises questions about benchmarks, automation and the gap between prototypes and predictions.
1:07:34ENSequoia Capital· Aug 6, 2024PodcastGitHub Didn’t Believe Copilot Was Writing 25% of the CodeThomas Dohmke tells Sequoia how an unplanned GPT-3 experiment became Copilot, why GitHub still will not train its own foundation model, and how he wants a billion people writing software by 2030.
13:40ENMatthew Berman· Jul 29, 2024Testing Llama 3.1 8B: Benchmark Gains and Mixed Practical ResultsMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and other prompts on the small model and finds several failures despite stronger reported benchmarks.
25:56ENNo Priors: AI, Machine Learning, Tech, & Startups· Jul 11, 2024Podcast · 2 speakersA Prompt Cannot Hold a Good Design: Six AI Practitioners at Midyear 2024Host Sarah Guo, Elad GilSarah Guo and Elad Gil stitch together clips from Stripe, Figma, Figure, OpenAI's Sora team, Cognition, and Scale into a half-year snapshot of what people actually shipping AI were willing to claim.
59:11ENSequoia Capital· Jun 25, 2024PodcastDon't Train a Model. Factory's Founders Say Go Dig for GoldMatan Grinberg and Eno Reyes tell Sequoia's Training Data why they sell a fleet of job-specific droids on top of other people's models — and how that stack just took SWE-bench from 14% to 19%.
10:57ENMatthew Berman· Jun 24, 2024Testing Claude 3.5 Sonnet: Coding, Reasoning, and VisionMatthew Berman · Forward FutureMatthew Berman puts Anthropic’s June 2024 model through informal coding, math, puzzle, and image-understanding prompts.
27:37ENMatthew Berman· Jun 17, 2024Leo Pekelis on Extending Llama 3 to a Million-Token ContextMatthew Berman, Leo Pekelis · Forward FutureGradient’s chief scientist explains long-context training, coding use cases, inference costs and why retrieval benchmarks tell only part of the story.
17:03ENMatthew Berman· Jun 8, 2024Qwen2 0.5B and 72B: A Hands-On ComparisonMatthew Berman · Forward FutureMatthew Berman tests coding, arithmetic and reasoning prompts on the smallest and largest Qwen2 models in a 2024 demonstration.
25:00ENMatthew Berman· May 23, 2024Microsoft Build 2024: Copilot+ PCs, Phi-3 and AI DemosMatthew Berman, Satya Nadella, Sam Altman, Seth Juarez · Forward FutureMatthew Berman reviews selected Microsoft keynote announcements, product demonstrations and a conversation with Sam Altman.
20:00ENMatthew Berman· May 7, 2024GitHub Copilot Workspace, Amazon Q and Sam Altman on AI’s Next StepsMatthew Berman, Sam Altman · Forward FutureA May 2024 roundup examines task-centered coding assistants, Rabbit R1, AI infrastructure, generated video and voice cloning.
29:28ENNo Priors: AI, Machine Learning, Tech, & Startups· May 2, 2024Podcast · 2 speakersDevin Will Not Replace Engineers. It Will Multiply Them, Says Cognition’s Scott WuHost Sarah Guo, Elad GilThe IOI champion behind Devin explains why an AI software engineer that you can watch over the shoulder creates more human engineers, not fewer.
17:12ENMatthew Berman· Apr 30, 2024Testing the Mystery 'gpt2-chatbot' Model in April 2024Matthew Berman · Forward FutureMatthew Berman tries an anonymous model on coding, arithmetic and reasoning tasks while its identity remains uncertain.
12:51ENMatthew Berman· Apr 21, 2024Llama 3 70B on Groq: Fast Inference and an Informal Prompt TestMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and repeated prompts on Groq’s April 2024 Llama 3 service, with mixed results and several scoring caveats.
15:35ENMatthew Berman· Apr 18, 2024Meta Llama 3 Launch: Benchmarks, a Snake Test and the Meta AI AssistantMatthew Berman · Forward FutureMatthew Berman reviews the April 2024 release, tries a generated game and considers what downloadable models mean for developers.
12:02ENMatthew Berman· Apr 13, 2024Testing Karasu Mixtral 8x22B on Coding and Reasoning TasksMatthew Berman · Forward FutureMatthew Berman tries an early community fine-tune of Mistral's large mixture-of-experts model on a Snake game, arithmetic and logic puzzles.Load moreShowing 24 of 326