Resultados
241 artículosOrdenar
55:34ENAndrew Hunter on Performance Engineering for Low-Latency SystemsYaron Minsky, Andrew Hunter · Jane StreetWhy small optimizations pay at hyperscale, why trading latency is harder to measure, and how profiling, tracing, language design and hardware fit together.
17:43ENOpenAI DevDay 2023: GPT-4 Turbo, Custom GPTs and Developer ToolsMatthew Berman, Sam Altman, Satya Nadella · Forward FutureMatthew Berman reviews OpenAI’s 2023 announcements, from longer context and cheaper API calls to custom GPTs and their implications for developers.
1:19:52EN1,000 H100s Take 115 Days; 22,000 Take FivePresenta: Nathan LabenzNathan Labenz and Trey Kollmer walk through cluster math that turns GPT-4-scale training into a weekly experiment, then four papers on search-augmented models, recursive code improvers, spatial maps inside Llama 2, and what networks do when they have no idea.
7:02ENConnecting AutoGen to a RunPod-Hosted Model with Text Generation WebUIMatthew Berman · Forward FutureIn a 2023 walkthrough, Matthew Berman connects AutoGen to Dolphin 2.1 Mistral 7B through an OpenAI-compatible API and tests a small coding task.
4:42ENConnecting AutoGen to a Local Model With LM StudioMatthew Berman · Forward FutureMatthew Berman demonstrates an early local-model setup and explains where agent behavior still needs work.
30:03ENA Dinner-Plate Chip Cut Training From 60 Days to 3.5Presenta: Sarah Guo, Elad GilCerebras CEO Andrew Feldman tells No Priors why wafer-scale silicon, not another GPU, is the answer to the compute crunch — and why most production models will stay at 13 billion parameters or below.
4:35ENRunning WizardCoder on a Cloud GPU: A 2023 RunPod WalkthroughMatthew Berman · Forward FutureMatthew Berman demonstrates downloading a quantized 13B coding model into a hosted text-generation interface, then explains how to stop the pod and avoid ongoing charges.
38:13ENChatGPT Runs on His Framework. He Still Doesn't Want You Training a ModelPresenta: Sarah Guo, Elad GilVercel founder Guillermo Rauch tells No Priors why frontend is the last mile of AI, why first-generation AI frameworks will be rewritten, and why bots are already stealing your tokens.
1:01:26ENAlexNet Used Two GPUs. GPT-4 Took Twenty Thousand. The Shortage Will Be Back.Presenta: Nathan LabenzRun:ai CTO Ronen Dar on filling idle accelerators, why H100s can be cheaper per experiment, and why Llama 2 undercuts compute governance.
3:08:46ENWho owns the off switch? George Hotz on tinygrad, open-source AI, and GodInvitado: George Hotz · Presenta: Lex FridmanOn his third Lex Fridman podcast, the comma.ai and tiny corp founder argues that compute, intelligence, and the off switch should live in people's houses, not in a trusted few.
8:17ENUsing OpenLLM to Serve Open Models Through an APIMatthew Berman · Forward FutureMatthew Berman demonstrates a local model server, its interactive API and a Python client in a 2023 walkthrough.
9:46ENInstalling Text Generation WebUI on Windows: A 2023 Local-Model WalkthroughMatthew Berman · Forward FutureMatthew Berman installs an early version of Text Generation WebUI, resolves setup errors and explains model downloads and interface settings. The steps and packages are historical; consult the project’s current documentation for a modern installation.
3:34:03ENPython Isn't Finished: Chris Lattner on Mojo and the Hardware MessInvitado: Chris Lattner · Presenta: Lex FridmanThe LLVM creator returns to Lex Fridman to argue that Python should grow C-like performance instead of forcing people out of the language.
11:49ENTesting Wizard-Vicuna 30B: Responses, Reasoning, and CodeMatthew Berman · Forward FutureMatthew Berman examines a model marketed as uncensored, demonstrates a 2023 cloud setup, and runs an informal collection of tests.
7:51ENRunning Guanaco 65B on a Cloud GPU with Runpod and Text Generation Web UIMatthew Berman · Forward FutureMatthew Berman demonstrates a 2023 workflow for renting a GPU, loading a quantized model and generating text. Model requirements, pricing and interfaces depend on the chosen version.
1:20:49ENA Wafer-Scale Chip So AI Stops Waiting on AmdahlPresenta: Nathan LabenzAndrew Feldman, CEO of Cerebras, tells Nathan Labenz why one 2.5-trillion-transistor die, sparse linear algebra, and a 16-machine supercomputer are a better shape than a GPU cluster.
54:56ENKevin Scott Seized Microsoft's GPU Budget, Bet on OpenAI, and Still Didn't See ChatGPT ComingPresenta: Sarah Guo, Elad GilFive months after ChatGPT launched, Microsoft's CTO walked No Priors through the all-in bet, the Copilot stack, and why he is still bullish on jobs.
6:42ENEzio on Linux Engineering and Collaboration at Jane StreetEzio · Jane StreetA London engineer explains his team’s infrastructure work, the Pride community group and why new hires should ask questions.
3:03ENRajan on IT, Collaboration and Learning at Jane StreetRajan · Jane StreetRajan describes the IT team's role supporting critical systems and the problem-solving skills he brought from studying chemistry.
52:11ENJensen Huang: For 25 Years, 99 Percent Were Right. NVIDIA Bet on the 1 PercentPresenta: Sarah Guo, Elad GilThe NVIDIA CEO tells No Priors how CUDA survived a decade without customers, why the company tries to stay lazy, and what he wants built for drugs and climate.
8:05ENA 2023 Guide to Running the Original GPT4All Model LocallyMatthew Berman · Forward FutureMatthew Berman demonstrates an early CPU-based GPT4All release, its terminal installation and the resources available for fine-tuning.
37:26ENWithout Open Source, Machine Learning Would Be Decades BehindPresenta: Sarah Guo, Elad GilHugging Face CEO Clem Delangue on the Tamagotchi pivot, why the company never hired a community manager, and why he does not believe one model will rule them all.
1:00:28ENElla Ehrlich on Modernizing a Critical Trading SystemYaron Minsky, Ella Ehrlich · Jane StreetJane Street’s Gord team rebuilt parts of a legacy data pipeline while preserving availability, and Ehrlich describes the recruiting programs she helped develop.
1:09:10ENThe Same Snapdragon That Flies on Mars Powers a Galaxy PhoneInvitado: Cristiano Amon · Presenta: Lex FridmanQualcomm CEO Cristiano Amon talks with Lex Fridman about 5G, Snapdragon, cars, the chip shortage, and how to map the border of your own competence.
Cargar másMostrando 24 de 241









