Results
341 articlesSort
13:40EN
Matthew Berman· Jul 29, 2024Testing Llama 3.1 8B: Benchmark Gains and Mixed Practical ResultsMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and other prompts on the small model and finds several failures despite stronger reported benchmarks.
25:56EN
No Priors: AI, Machine Learning, Tech, & Startups· Jul 11, 2024Podcast · 2 speakersA Prompt Cannot Hold a Good Design: Six AI Practitioners at Midyear 2024Host Sarah Guo, Elad GilSarah Guo and Elad Gil stitch together clips from Stripe, Figma, Figure, OpenAI's Sora team, Cognition, and Scale into a half-year snapshot of what people actually shipping AI were willing to claim.
59:11EN
Sequoia Capital· Jun 25, 2024PodcastDon't Train a Model. Factory's Founders Say Go Dig for GoldMatan Grinberg and Eno Reyes tell Sequoia's Training Data why they sell a fleet of job-specific droids on top of other people's models — and how that stack just took SWE-bench from 14% to 19%.
10:57ENMatthew Berman· Jun 24, 2024Testing Claude 3.5 Sonnet: Coding, Reasoning, and VisionMatthew Berman · Forward FutureMatthew Berman puts Anthropic’s June 2024 model through informal coding, math, puzzle, and image-understanding prompts.
27:37ENMatthew Berman· Jun 17, 2024Leo Pekelis on Extending Llama 3 to a Million-Token ContextMatthew Berman, Leo Pekelis · Forward FutureGradient’s chief scientist explains long-context training, coding use cases, inference costs and why retrieval benchmarks tell only part of the story.
17:03ENMatthew Berman· Jun 8, 2024Qwen2 0.5B and 72B: A Hands-On ComparisonMatthew Berman · Forward FutureMatthew Berman tests coding, arithmetic and reasoning prompts on the smallest and largest Qwen2 models in a 2024 demonstration.
25:00ENMatthew Berman· May 23, 2024Microsoft Build 2024: Copilot+ PCs, Phi-3 and AI DemosMatthew Berman, Satya Nadella, Sam Altman, Seth Juarez · Forward FutureMatthew Berman reviews selected Microsoft keynote announcements, product demonstrations and a conversation with Sam Altman.
20:00ENMatthew Berman· May 7, 2024GitHub Copilot Workspace, Amazon Q and Sam Altman on AI’s Next StepsMatthew Berman, Sam Altman · Forward FutureA May 2024 roundup examines task-centered coding assistants, Rabbit R1, AI infrastructure, generated video and voice cloning.
29:28ENNo Priors: AI, Machine Learning, Tech, & Startups· May 2, 2024Podcast · 2 speakersDevin Will Not Replace Engineers. It Will Multiply Them, Says Cognition’s Scott WuHost Sarah Guo, Elad GilThe IOI champion behind Devin explains why an AI software engineer that you can watch over the shoulder creates more human engineers, not fewer.
17:12ENMatthew Berman· Apr 30, 2024Testing the Mystery 'gpt2-chatbot' Model in April 2024Matthew Berman · Forward FutureMatthew Berman tries an anonymous model on coding, arithmetic and reasoning tasks while its identity remains uncertain.
12:51ENMatthew Berman· Apr 21, 2024Llama 3 70B on Groq: Fast Inference and an Informal Prompt TestMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and repeated prompts on Groq’s April 2024 Llama 3 service, with mixed results and several scoring caveats.
15:35ENMatthew Berman· Apr 18, 2024Meta Llama 3 Launch: Benchmarks, a Snake Test and the Meta AI AssistantMatthew Berman · Forward FutureMatthew Berman reviews the April 2024 release, tries a generated game and considers what downloadable models mean for developers.
12:02ENMatthew Berman· Apr 13, 2024Testing Karasu Mixtral 8x22B on Coding and Reasoning TasksMatthew Berman · Forward FutureMatthew Berman tries an early community fine-tune of Mistral's large mixture-of-experts model on a Snake game, arithmetic and logic puzzles.
13:59ENMatthew Berman· Apr 5, 2024SWE-agent Tutorial: Navigating Repositories and Attempting GitHub FixesMatthew Berman, Carlos · Forward FutureMatthew Berman sets up a research coding agent, hits an installation problem and a cost limit, then shows an author’s successful SymPy benchmark example.
14:58ENMatthew Berman· Mar 30, 2024OpenDevin’s Early Coding Agent: A 2024 Installation and DemoMatthew Berman · Forward FutureMatthew Berman installs an early open-source coding-agent project and tries a calculator and a simple web page, while encountering setup and browser issues.
19:51ENMatthew Berman· Mar 15, 2024Devin’s 2024 Launch: Coding-Agent Demos and Benchmark ClaimsMatthew Berman, Scott Wu, Neal, Walden · Forward FutureMatthew Berman examines Cognition’s software-agent demonstrations, interface and SWE-bench comparison alongside earlier coding projects.
1:25:10EN
Cognitive Revolution "How AI Changes Everything"· Mar 12, 2024PodcastWriting Code Is Only 30% of the Job. CodiumAI Wants the Other 70%Host Nathan LabenzItamar Friedman argues that completion is already a commodity, that code integrity is where AI still lags, and that flow engineering—not fancier prompts—is how GPT-4 doubled its score on coding contests.
13:57ENMatthew Berman· Feb 27, 2024Mistral Large: A 2024 Review of Coding, Reasoning and Safety ResponsesMatthew Berman · Forward FutureMatthew Berman reviews Mistral’s launch claims and tests the model with a small set of prompts.
11:14ENMatthew Berman· Feb 8, 2024Gemini Advanced and Ultra 1.0: A First Look and Hands-On TestMatthew Berman · Forward FutureIn February 2024, Matthew Berman reviews Google’s Bard rebrand and tests its new paid Gemini experience on coding, logic and image recognition.
46:36ENNo Priors: AI, Machine Learning, Tech, & Startups· Jan 18, 2024Podcast · 2 speakersAfter a decade of code search, Sourcegraph’s CTO says the coding-AI fight is outside the modelHost Sarah Guo, Elad GilBeyang Liu on Cody, why keyword search still does most of RAG, and why CS fundamentals get more valuable as AI compresses the middleware.
24:54ENMatthew Berman· Dec 22, 2023Matthew Berman's 2023 Prediction for AI and the Future of ProgrammingMatthew Berman, Matt Welsh, McKay Wrigley · Forward FutureBerman argues that natural-language interfaces and AI agents could transform software development, while acknowledging the limits of coding tools and his uncertain timeline.
17:08ENMatthew Berman· Dec 21, 2023Building and Testing a Login App With GPT PilotMatthew Berman · Forward FutureMatthew Berman demonstrates the 2023 VS Code workflow for AI-assisted planning, coding and debugging an authentication prototype.
0:29ENMatthew Berman· Dec 20, 2023A ServiceNow Partner Demonstrates AI-Assisted Code GenerationMatthew Berman · Forward FutureA short promotional demonstration shows code generated from a natural-language instruction in ServiceNow.
1:22:59ENCognitive Revolution "How AI Changes Everything"· Dec 2, 2023PodcastIf Your Agent Is Right 80% of the Time, Ten Steps Leave You With 10%Host Nathan LabenzImbue CTO Josh Albrecht tells Nathan Labenz how a 27-person, pre-product research company is putting $200 million and 10,000 H100s toward agents that can actually finish a long job.Load moreShowing 24 of 341