필터 결과
269개정렬
16:28EN
Matthew Berman· 2024년 4월 23일Testing Reka Core: Multimodal Benchmarks, Coding and ReasoningMatthew Berman · Forward FutureMatthew Berman reviews Reka’s reported model comparisons and tests Core on code, logic and image understanding.
12:51ENMatthew Berman· 2024년 4월 21일Llama 3 70B on Groq: Fast Inference and an Informal Prompt TestMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and repeated prompts on Groq’s April 2024 Llama 3 service, with mixed results and several scoring caveats.
15:01ENMatthew Berman· 2024년 4월 19일Testing Llama 3 at Launch: Code, Reasoning and Image GenerationMatthew Berman · Forward FutureMatthew Berman tries Meta AI’s new interface on a snake game, logic puzzles and rapid image generation.
24:32EN
No Priors: AI, Machine Learning, Tech, & Startups· 2024년 4월 18일팟캐스트 · 2명Image Generation Is Still a Loot Box. Suhail Doshi Wants to Scale Pixels진행자 Sarah Guo, Elad GilThe Playground AI founder tells No Priors why he skipped language models, how a noise-sampling trick fixed SDXL's muddy brightness, and what a large vision model would actually do.
12:02ENMatthew Berman· 2024년 4월 13일Testing Karasu Mixtral 8x22B on Coding and Reasoning TasksMatthew Berman · Forward FutureMatthew Berman tries an early community fine-tune of Mistral's large mixture-of-experts model on a Snake game, arithmetic and logic puzzles.
13:59ENMatthew Berman· 2024년 4월 5일SWE-agent Tutorial: Navigating Repositories and Attempting GitHub FixesMatthew Berman, Carlos · Forward FutureMatthew Berman sets up a research coding agent, hits an installation problem and a cost limit, then shows an author’s successful SymPy benchmark example.
1:23:09EN
Cognitive Revolution "How AI Changes Everything"· 2024년 4월 3일팟캐스트The Right Size of an AI Task Is Whatever You Can Check진행자 Nathan LabenzElicit founders Andreas Stuhlmüller and Jungwon Byun walk through how a twelve-person research assistant cut summary hallucinations from 1.5 to 0.5, ships about every week and a half, and treats task decomposition as the way to spend more compute without a black box.
9:02ENMatthew Berman· 2024년 4월 1일Matthew Berman Tries LLM Colosseum, a Street Fighter Model BenchmarkMatthew Berman · Forward FutureA 2024 tutorial shows language models choosing fighting-game moves, explains the game-state prompt and walks through local setup.
14:23ENMatthew Berman· 2024년 3월 31일Testing DBRX: Coding Strengths and Reasoning GapsMatthew Berman · Forward FutureMatthew Berman examines Databricks’ open-weight model and puts it through coding, arithmetic and reasoning prompts.
27:32ENNo Priors: AI, Machine Learning, Tech, & Startups· 2024년 3월 28일팟캐스트 · 2명From a side project to 700 integrations: Harrison Chase on what still blocks agents진행자 Sarah Guo, Elad GilThe LangChain CEO walks through a two-year churn of patterns, and why memory, planning, and few-shot data still matter more than swapping models.
1:28:37ENCognitive Revolution "How AI Changes Everything"· 2024년 3월 14일팟캐스트Twelve Hours After a GPT-4 Demo, He Turned a Decade-Old Legal Startup Around진행자 Nathan LabenzPablo Arredondo, co-founder of CaseText and now VP of CoCounsel at Thomson Reuters, traces legal research from 19th-century citators to a retrieval-anchored GPT-4 product that law firms treat more like a colleague than a search box.
21:16ENMatthew Berman· 2024년 3월 9일ArtPrompt: What a 2024 Study Found About Visual Text and Model SafetyMatthew Berman · Forward FutureMatthew Berman reviews an ASCII-art recognition benchmark and reports mixed results from his own informal tests.
23:00ENMatthew Berman· 2024년 2월 22일Testing Google Gemma 7B at Launch: Setup MattersMatthew Berman · Forward FutureMatthew Berman compares local and hosted tests of Google’s early open-weight model.
1:06:39EN
Unsupervised Learning: With Jacob Effron· 2024년 1월 9일팟캐스트OpenAI's First DevRel Writes 90% of His Code with ChatGPT — and Says Web Agents Still Need Years진행자 Jacob EffronLogan Kilpatrick on picking GPT-3.5 versus GPT-4, why plugins stalled, and why the public internet is not ready for autonomous agents.
19:37ENMatthew Berman· 2023년 12월 13일How Rephrased Test Data Inflated a 13B Model’s Benchmark ScoresMatthew Berman · Forward FutureMatthew Berman examines a 2023 experiment showing how reworded benchmark questions can evade simple contamination checks and inflate model scores.
1:22:59ENCognitive Revolution "How AI Changes Everything"· 2023년 12월 2일팟캐스트If Your Agent Is Right 80% of the Time, Ten Steps Leave You With 10%진행자 Nathan LabenzImbue CTO Josh Albrecht tells Nathan Labenz how a 27-person, pre-product research company is putting $200 million and 10,000 H100s toward agents that can actually finish a long job.
18:29ENMatthew Berman· 2023년 12월 1일OpenAI's 2023 Leadership Crisis, Q* Speculation and Synthetic DataMatthew Berman, Andrew Ross Sorkin, Elon Musk · Forward FutureMatthew Berman connects Sam Altman's return, an Elon Musk interview and Nathan Lambert's discussion of synthetic training data, separating reported events from his own theories.
32:48ENNo Priors: AI, Machine Learning, Tech, & Startups· 2023년 11월 16일팟캐스트 · 2명Fourteen People, $200 Million of Compute, and the Reliability Bottleneck for Agents진행자 Sarah Guo, Elad GilImbue co-founders Kanjun Qiu and Josh Albrecht on why agents fail, why language models cannot learn general algorithms, and why they are spending a giant round on GPUs rather than headcount.
1:23:10ENCognitive Revolution "How AI Changes Everything"· 2023년 9월 19일팟캐스트Luxury Purses Under $500 Beat a Bank's Fraud Model진행자 Nathan LabenzArthur.ai CEO Adam Wenchel on boundary attacks, LLM firewalls, and why a model that eats raw text cannot be secured from the inside.
10:20ENMatthew Berman· 2023년 8월 30일Phind Code Llama 34B vs GPT-4: A 2023 Python Coding TestMatthew Berman · Forward FutureMatthew Berman compares a quantized Phind fine-tune with GPT-4 on games, short functions and refactoring, with mixed results.
55:08ENCognitive Revolution "How AI Changes Everything"· 2023년 8월 29일팟캐스트One Model Inside 38 Products: Paige Bailey on How Google Trains and Ships PaLM 2진행자 Nathan LabenzAt Google I/O in May 2023, PaLM 2 arrived already running in more than two dozen products — and its lead product manager walks through what that actually took.
39:45ENNo Priors: AI, Machine Learning, Tech, & Startups· 2023년 7월 27일팟캐스트 · 2명Palantir's 13th Employee: The Model Is a Stochastic Genie. Ontology Is the Stake That Tethers It진행자 Sarah Guo, Elad GilCTO Shyam Sankar on 550 microservices, air-gapped submarines, and why Palantir's ontology is what large language models were waiting for.
5:34ENMatthew Berman· 2023년 7월 26일FreeWilly2: A 2023 Prompt Test with Uncertain FormattingMatthew Berman · Forward FutureMatthew Berman retries an instruction-tuned Llama 2 model after a poor first run, finding mixed results and a likely template problem.
4:59ENMatthew Berman· 2023년 7월 25일Testing Airoboros L2 70B on Coding, Writing and ReasoningMatthew Berman · Forward FutureMatthew Berman runs a small set of prompts against a Llama 2 fine-tune, finding useful structured output alongside failures on code and logic.더 보기269개 중 24개 표시