絞り込み結果
244 件並び順
10:57ENTesting OpenAI o1-preview: Tetris, Physical Reasoning and a North Pole ErrorMatthew Berman · Forward FutureIn September 2024, Matthew Berman runs the new reasoning-model preview through a personal rubric and examines where its answers succeed or fail.
21:21ENOpenAI o1’s 2024 Launch: Reasoning Benchmarks and Early TestsMatthew Berman · Forward FutureMatthew Berman reviews o1-preview and o1-mini, OpenAI’s reported evaluations, and his own early coding experiments.
1:31:56ENTesting OpenAI o1 on Puzzles, Code and Reasoning: A Launch-Day LivestreamMatthew Berman · Forward FutureMatthew Berman tries o1-preview and o1-mini on word counts, Tetris, physical reasoning and a word puzzle, with viewers checking the results.
51:15ENAGI Has One Problem Left: Spend a Million Times More on a TokenMagic founder Eric Steinberger tells Sequoia’s Training Data why he trains his own models, why a software engineer is the MVP of AGI, and why 96% still is not a colleague.
37:47ENWorking Backwards from AGI: Magic's Five-Million-Token Betホスト Sarah Guo, Elad GilEric Steinberger wants a coding colleague you trust like a teammate — and a world that is still a good place thirty years after AGI.
1:30:24ENDaniel Miessler and Matthew Berman on AI Privacy, Coding, and Generated WorldsMatthew Berman, Daniel Miessler, Melissa, Alex · Forward FutureA 2024 live conversation explores Recall, open models, AI-assisted programming, a Doom simulator and questions about security, energy and employment.
18:39ENAI Scientist, Grok-2 and Agent Q: Matthew Berman’s August 2024 AI News RoundupMatthew Berman · Forward FutureA week of model releases, web agents and AI research raises questions about benchmarks, automation and the gap between prototypes and predictions.
1:07:34ENGitHub Didn’t Believe Copilot Was Writing 25% of the CodeThomas Dohmke tells Sequoia how an unplanned GPT-3 experiment became Copilot, why GitHub still will not train its own foundation model, and how he wants a billion people writing software by 2030.
13:40ENTesting Llama 3.1 8B: Benchmark Gains and Mixed Practical ResultsMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and other prompts on the small model and finds several failures despite stronger reported benchmarks.
25:56ENA Prompt Cannot Hold a Good Design: Six AI Practitioners at Midyear 2024ホスト Sarah Guo, Elad GilSarah Guo and Elad Gil stitch together clips from Stripe, Figma, Figure, OpenAI's Sora team, Cognition, and Scale into a half-year snapshot of what people actually shipping AI were willing to claim.
59:11ENDon't Train a Model. Factory's Founders Say Go Dig for GoldMatan Grinberg and Eno Reyes tell Sequoia's Training Data why they sell a fleet of job-specific droids on top of other people's models — and how that stack just took SWE-bench from 14% to 19%.
10:57ENTesting Claude 3.5 Sonnet: Coding, Reasoning, and VisionMatthew Berman · Forward FutureMatthew Berman puts Anthropic’s June 2024 model through informal coding, math, puzzle, and image-understanding prompts.
27:37ENLeo Pekelis on Extending Llama 3 to a Million-Token ContextMatthew Berman, Leo Pekelis · Forward FutureGradient’s chief scientist explains long-context training, coding use cases, inference costs and why retrieval benchmarks tell only part of the story.
17:03ENQwen2 0.5B and 72B: A Hands-On ComparisonMatthew Berman · Forward FutureMatthew Berman tests coding, arithmetic and reasoning prompts on the smallest and largest Qwen2 models in a 2024 demonstration.
25:00ENMicrosoft Build 2024: Copilot+ PCs, Phi-3 and AI DemosMatthew Berman, Satya Nadella, Sam Altman, Seth Juarez · Forward FutureMatthew Berman reviews selected Microsoft keynote announcements, product demonstrations and a conversation with Sam Altman.
29:28ENDevin Will Not Replace Engineers. It Will Multiply Them, Says Cognition’s Scott Wuホスト Sarah Guo, Elad GilThe IOI champion behind Devin explains why an AI software engineer that you can watch over the shoulder creates more human engineers, not fewer.
17:12ENTesting the Mystery 'gpt2-chatbot' Model in April 2024Matthew Berman · Forward FutureMatthew Berman tries an anonymous model on coding, arithmetic and reasoning tasks while its identity remains uncertain.
12:51ENLlama 3 70B on Groq: Fast Inference and an Informal Prompt TestMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and repeated prompts on Groq’s April 2024 Llama 3 service, with mixed results and several scoring caveats.
13:59ENSWE-agent Tutorial: Navigating Repositories and Attempting GitHub FixesMatthew Berman, Carlos · Forward FutureMatthew Berman sets up a research coding agent, hits an installation problem and a cost limit, then shows an author’s successful SymPy benchmark example.
1:25:10ENWriting Code Is Only 30% of the Job. CodiumAI Wants the Other 70%ホスト Nathan LabenzItamar Friedman argues that completion is already a commodity, that code integrity is where AI still lags, and that flow engineering—not fancier prompts—is how GPT-4 doubled its score on coding contests.
13:57ENMistral Large: A 2024 Review of Coding, Reasoning and Safety ResponsesMatthew Berman · Forward FutureMatthew Berman reviews Mistral’s launch claims and tests the model with a small set of prompts.
11:14ENGemini Advanced and Ultra 1.0: A First Look and Hands-On TestMatthew Berman · Forward FutureIn February 2024, Matthew Berman reviews Google’s Bard rebrand and tests its new paid Gemini experience on coding, logic and image recognition.
46:36ENAfter a decade of code search, Sourcegraph’s CTO says the coding-AI fight is outside the modelホスト Sarah Guo, Elad GilBeyang Liu on Cody, why keyword search still does most of RAG, and why CS fundamentals get more valuable as AI compresses the middleware.
1:22:59ENIf Your Agent Is Right 80% of the Time, Ten Steps Leave You With 10%ホスト Nathan LabenzImbue CTO Josh Albrecht tells Nathan Labenz how a 27-person, pre-product research company is putting $200 million and 10,000 H100s toward agents that can actually finish a long job.
もっと見る244 件中 24 件を表示









