Resultados
248 artículosOrdenar
14:23EN
Matthew Berman· 31 mar 2024Testing DBRX: Coding Strengths and Reasoning GapsMatthew Berman · Forward FutureMatthew Berman examines Databricks’ open-weight model and puts it through coding, arithmetic and reasoning prompts.
27:32EN
No Priors: AI, Machine Learning, Tech, & Startups· 28 mar 2024Pódcast · 2 vocesFrom a side project to 700 integrations: Harrison Chase on what still blocks agentsPresenta: Sarah Guo, Elad GilThe LangChain CEO walks through a two-year churn of patterns, and why memory, planning, and few-shot data still matter more than swapping models.
1:28:37EN
Cognitive Revolution "How AI Changes Everything"· 14 mar 2024PódcastTwelve Hours After a GPT-4 Demo, He Turned a Decade-Old Legal Startup AroundPresenta: Nathan LabenzPablo Arredondo, co-founder of CaseText and now VP of CoCounsel at Thomson Reuters, traces legal research from 19th-century citators to a retrieval-anchored GPT-4 product that law firms treat more like a colleague than a search box.
21:16ENMatthew Berman· 9 mar 2024ArtPrompt: What a 2024 Study Found About Visual Text and Model SafetyMatthew Berman · Forward FutureMatthew Berman reviews an ASCII-art recognition benchmark and reports mixed results from his own informal tests.
23:00ENMatthew Berman· 22 feb 2024Testing Google Gemma 7B at Launch: Setup MattersMatthew Berman · Forward FutureMatthew Berman compares local and hosted tests of Google’s early open-weight model.
1:06:39EN
Unsupervised Learning: With Jacob Effron· 9 ene 2024PódcastOpenAI's First DevRel Writes 90% of His Code with ChatGPT — and Says Web Agents Still Need YearsPresenta: Jacob EffronLogan Kilpatrick on picking GPT-3.5 versus GPT-4, why plugins stalled, and why the public internet is not ready for autonomous agents.
1:22:59ENCognitive Revolution "How AI Changes Everything"· 2 dic 2023PódcastIf Your Agent Is Right 80% of the Time, Ten Steps Leave You With 10%Presenta: Nathan LabenzImbue CTO Josh Albrecht tells Nathan Labenz how a 27-person, pre-product research company is putting $200 million and 10,000 H100s toward agents that can actually finish a long job.
18:29ENMatthew Berman· 1 dic 2023OpenAI's 2023 Leadership Crisis, Q* Speculation and Synthetic DataMatthew Berman, Andrew Ross Sorkin, Elon Musk · Forward FutureMatthew Berman connects Sam Altman's return, an Elon Musk interview and Nathan Lambert's discussion of synthetic training data, separating reported events from his own theories.
32:48ENNo Priors: AI, Machine Learning, Tech, & Startups· 16 nov 2023Pódcast · 2 vocesFourteen People, $200 Million of Compute, and the Reliability Bottleneck for AgentsPresenta: Sarah Guo, Elad GilImbue co-founders Kanjun Qiu and Josh Albrecht on why agents fail, why language models cannot learn general algorithms, and why they are spending a giant round on GPUs rather than headcount.
1:23:10ENCognitive Revolution "How AI Changes Everything"· 19 sept 2023PódcastLuxury Purses Under $500 Beat a Bank's Fraud ModelPresenta: Nathan LabenzArthur.ai CEO Adam Wenchel on boundary attacks, LLM firewalls, and why a model that eats raw text cannot be secured from the inside.
10:20ENMatthew Berman· 30 ago 2023Phind Code Llama 34B vs GPT-4: A 2023 Python Coding TestMatthew Berman · Forward FutureMatthew Berman compares a quantized Phind fine-tune with GPT-4 on games, short functions and refactoring, with mixed results.
55:08ENCognitive Revolution "How AI Changes Everything"· 29 ago 2023PódcastOne Model Inside 38 Products: Paige Bailey on How Google Trains and Ships PaLM 2Presenta: Nathan LabenzAt Google I/O in May 2023, PaLM 2 arrived already running in more than two dozen products — and its lead product manager walks through what that actually took.
39:45ENNo Priors: AI, Machine Learning, Tech, & Startups· 27 jul 2023Pódcast · 2 vocesPalantir's 13th Employee: The Model Is a Stochastic Genie. Ontology Is the Stake That Tethers ItPresenta: Sarah Guo, Elad GilCTO Shyam Sankar on 550 microservices, air-gapped submarines, and why Palantir's ontology is what large language models were waiting for.
4:59ENMatthew Berman· 25 jul 2023Testing Airoboros L2 70B on Coding, Writing and ReasoningMatthew Berman · Forward FutureMatthew Berman runs a small set of prompts against a Llama 2 fine-tune, finding useful structured output alongside failures on code and logic.
9:46ENMatthew Berman· 17 jul 2023Orca Mini V2 vs. OpenOrca: A 2023 Informal Model ComparisonMatthew Berman · Forward FutureMatthew Berman tests two Orca-inspired models on coding, writing and reasoning, with results shaped by prompt setup and subjective scoring.
8:04ENMatthew Berman· 11 jul 2023WizardLM 13B v1.1 Tested on Coding, Writing and LogicMatthew Berman · Forward FutureMatthew Berman tries an instruction-tuned model on a small set of prompts, with mixed results and several subjective scoring choices.
12:20ENMatthew Berman· 10 jul 2023Testing UltraLM 13B: A Small Model’s Strengths and Reasoning ErrorsMatthew Berman · Forward FutureA 2023 local test finds useful writing and simple coding alongside failures in games, arithmetic and logic.
54:00EN
20VC with Harry Stebbings· 30 jun 2023Pódcast · 2 vocesDouwe Kiela on Data, Retrieval and Enterprise AIInvitado: Douwe Kiela · Presenta: Harry StebbingsThe Contextual AI CEO discusses language model trade-offs, evaluation, open models and the hurdles to enterprise use.
18:08ENMatthew Berman· 29 jun 2023Six Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.
7:21ENMatthew Berman· 26 jun 2023Testing Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.
10:23ENMatthew Berman· 15 jun 2023Testing Hosted Falcon 40B and Document Chat in h2oGPTMatthew Berman · Forward FutureMatthew Berman tries H2O.ai’s 2023 hosted Falcon 40B interface on coding, writing and reasoning prompts, then demonstrates document chat.
11:49ENMatthew Berman· 1 jun 2023Testing Wizard-Vicuna 30B: Responses, Reasoning, and CodeMatthew Berman · Forward FutureMatthew Berman examines a model marketed as uncensored, demonstrates a 2023 cloud setup, and runs an informal collection of tests.
1:33:51ENCognitive Revolution "How AI Changes Everything"· 23 may 2023PódcastGPT-4 still writes SQL that will not run. She put a guardrail on the modelPresenta: Nathan LabenzShreya Rajpal built Guardrails AI so developers can encode what “correct” means, validate the pieces, and send failures back to the model instead of hoping the prompt holds.
1:25:35ENCognitive Revolution "How AI Changes Everything"· 21 may 2023PódcastTwo and a Half Years From 33.3% to 86.5%: Google Sent Foundation Models to Medical SchoolPresenta: Nathan LabenzVivek Natarajan walks Nathan Labenz through Med-PaLM and Med-PaLM 2: the data-light techniques, the nine-axis clinician evals, and why a high USMLE-style score is the wrong trophy.Cargar másMostrando 24 de 248