Kürzlich aktualisierte Kanäle

Wählen, um nur diesen Kanal zu sehenAlle Kanäle →

Ergebnisse

201 Artikel
Sortieren
5 Folien10:20EN
Matthew Berman· 30. Aug. 2023Phind Code Llama 34B vs GPT-4: A 2023 Python Coding TestMatthew Berman · Forward FutureMatthew Berman compares a quantized Phind fine-tune with GPT-4 on games, short functions and refactoring, with mixed results.Open-weight modelsCoding-AgentenEvals+2
Folien2:25EN
Matthew Berman· 1. Aug. 2023Gorilla: Generating API Calls with Language ModelsMatthew Berman · Forward FutureMatthew Berman introduces a 2023 research project on using retrieved documentation to help language models generate tool calls.AI agentsMCP & ToolsBenchmarks
3 Folien5:34EN
Matthew Berman· 26. Juli 2023FreeWilly2: A 2023 Prompt Test with Uncertain FormattingMatthew Berman · Forward FutureMatthew Berman retries an instruction-tuned Llama 2 model after a poor first run, finding mixed results and a likely template problem.Open-weight modelsBenchmarksFine-Tuning+1
7 Folien9:40EN
Matthew Berman· 20. Juli 2023Testing Llama 2 70B on Coding, Writing and ReasoningMatthew Berman · Forward FutureMatthew Berman tries Meta’s 70-billion-parameter chat model through a hosted interface, highlighting both useful outputs and inconsistent reasoning.Open-weight modelsBenchmarksModelle & Training+2
3 Folien9:46EN
Matthew Berman· 17. Juli 2023Orca Mini V2 vs. OpenOrca: A 2023 Informal Model ComparisonMatthew Berman · Forward FutureMatthew Berman tests two Orca-inspired models on coding, writing and reasoning, with results shaped by prompt setup and subjective scoring.BenchmarksOpen-weight modelsReasoning & test-time compute+2
6 Folien18:08EN
Matthew Berman· 29. Juni 2023Six Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.BenchmarksOpen-weight modelsModelle & Training+1
7 Folien4:36EN
Matthew Berman· 20. Juni 2023Testing WizardCoder 15B as a Local Coding AssistantMatthew Berman · Forward FutureMatthew Berman runs the 2023 WizardCoder model locally, testing small Python exercises and a longer Snake game.Modelle & TrainingLocal inferenceSoftware engineering+2
5 Folien19:38EN
Matthew Berman· 9. Juni 2023Orca: Teaching a Smaller Model with GPT-4 ExplanationsMatthew Berman · Forward FutureMatthew Berman reviews Microsoft Research’s 2023 Orca paper and its approach to training a 13-billion-parameter model on detailed teacher responses.DistillationFine-TuningSynthetic data+2
2 Folien10:40EN
Matthew Berman· 7. Juni 2023Testing Nous Hermes 13B Locally: Mixed Reasoning and Unsafe ResponsesMatthew Berman · Forward FutureMatthew Berman compares a 2023 quantized model on hosted and local hardware, with uneven results across coding, logic and safety.Open-weight modelsLocal inferenceBenchmarks+1
4 Folien11:42EN
Matthew Berman· 31. Mai 2023Guanaco and QLoRA: A 2023 Fine-Tuning and Model TestMatthew Berman · Forward FutureMatthew Berman reviews the QLoRA paper, explains the reported memory savings and tries Guanaco 65B on an informal prompt set.Fine-TuningQuantizationOpen-weight models+1
1:25:35EN
Cognitive Revolution "How AI Changes Everything"· 21. Mai 2023PodcastTwo and a Half Years From 33.3% to 86.5%: Google Sent Foundation Models to Medical SchoolModeration: Nathan LabenzVivek Natarajan walks Nathan Labenz through Med-PaLM and Med-PaLM 2: the data-light techniques, the nine-axis clinician evals, and why a high USMLE-style score is the wrong trophy.Modelle & TrainingAI in healthcareFine-Tuning+3
4 Folien10:16EN
Matthew Berman· 21. Mai 2023DarkBERT: Adapting a Language Model to Dark-Web TextMatthew Berman · Forward FutureMatthew Berman reviews research on a RoBERTa-based model and its cybersecurity evaluations.AI securityPretraining & midtrainingBenchmarks+1
4 Folien11:07EN
Matthew Berman· 16. Mai 2023Testing MosaicML MPT-7B Chat and StoryWriter in 2023Matthew Berman · Forward FutureMatthew Berman examines MPT-7B model variants, their licenses and a mixed set of local tests.Open-weight modelsBenchmarksModelle & Training+1
58:24EN
Cognitive Revolution "How AI Changes Everything"· 11. Mai 2023PodcastAmong 100 Random Doctors, Zak Kohane Would Be Surprised If One Beat GPT-4Moderation: Nathan LabenzHarvard's biomedical informatics chair on a rare newborn case, why drug-style trials will not certify a general medical model, and why the AI should still work for the patient.AI in healthcareEvalsHuman-AI Collaboration+3
4 Folien9:58EN
Matthew Berman· 26. Apr. 2023HuggingChat’s 2023 Debut: Testing Writing, Reasoning and Python CodeMatthew Berman · Forward FutureMatthew Berman tries the early OpenAssistant-powered HuggingChat on writing, arithmetic, logic and a Snake game, then compares a few outputs with GPT-3.5 and GPT-4. The results illustrate both promise and limitations in this small historical test.Open-weight modelsBenchmarksModelle & Training+2
53:37EN
No Priors: AI, Machine Learning, Tech, & Startups· 9. März 2023Podcast · 2 Stimmen30 models, 42 scenarios, 7 metrics: Percy Liang's public checkup for language modelsModeration: Sarah Guo, Elad GilA PubMed-only model once led the U.S. medical licensing exam — until a system roughly 200 times larger overtook it.Evals & ObservabilityAI researchFoundation Models+3
2:34:20EN
Lex Fridman· 30. Aug. 2020Podcast · 2 StimmenIntelligence Is How Efficiently You Acquire Skills You Were Not Prepared ForGast: François Chollet · Moderation: Lex FridmanFrançois Chollet tells Lex Fridman why skill is not intelligence, why GPT-3 is still pattern matching, and why a grid puzzle called ARC still separates children from machines.Evals & ObservabilityBenchmarksAI research+3
1:49:51EN
Lex Fridman· 27. Juni 2020Podcast · 2 StimmenThe Idea Once Called a Devolution Now Powers Almost Every New ChipGast: David Patterson · Moderation: Lex FridmanTuring Award winner David Patterson talks with Lex Fridman about RISC, RAID, Moore's Law, open hardware, and why chips without a software stack die.Infrastruktur & DeploymentOpen-source ecosystemsBenchmarks+1
16:03EN
Lex Fridman· 22. Feb. 2020Podcast · 2 StimmenQuantum Supremacy Is a Well-Defined Speedup, Not a Useful TaskGast: Scott Aaronson · Moderation: Lex FridmanScott Aaronson explains what Google's 53-qubit experiment actually demonstrated, how it was verified, and why complexity theory can offer evidence but not proof against classical spoofing.BenchmarksScience Communication
5 Folien57:57EN
Jane Street· 8. Mai 2019Sebastian Funk on a Fast, Safe and Maintainable Packet ProcessorSebastian Funk · Jane StreetA single-core market-data case study shows how latency targets, allocation control and generated code can coexist with high-level abstractions.Software engineeringBenchmarksInfrastruktur & Deployment
11:11EN
Lex FridmanPodcast · 2 StimmenYann LeCun on Benchmarks, Interactive Environments, and Why Human Intelligence Is Not GeneralGast: Yann Lecun · Moderation: Lex FridmanIn a 2019 clip, LeCun defends benchmarks as a test of AI claims, explains why interactive environments break the usual train-test protocol, and argues that "general intelligence" is a misnomer.Modelle & TrainingBenchmarksAGI+3
1:22:57EN
Cognitive Revolution "How AI Changes Everything"PodcastHuman-Level but Not Human-Like: A GPT-4 Red Teamer on What He Saw Behind the MaskModeration: Nathan LabenzNathan Labenz recounts two months of full-time testing of an early GPT-4, from the AI doctor of his dreams to a model that would plan assassinations on request.SicherheitAI securitySicherheit & Governance+3
14:41EN
Lex FridmanPodcast · 2 StimmenTalking for 20 Minutes: How the Alexa Prize Turns Real Customers into a Testbed for Conversational AIGast: Rohit Prasad · Moderation: Lex FridmanRohit Prasad, head scientist of Amazon Alexa, explains the Alexa Prize grand challenge, how it is judged and why true conversation still needs reasoning.Produkt & UXSprach-KIAI research+3
16:41EN
Lex FridmanPodcastAlphaFold 2 and the Protein-Folding Breakthrough: Why Lex Fridman Calls It a Landmark for AI and BiologyModeration: Lex FridmanA quick explainer on DeepMind's CASP14 result, how protein folding works, how AlphaFold 1 and 2 likely differ, and what the advance could unlock.Modelle & TrainingAI for scienceDeep Learning+2
Mehr laden24 von 201 angezeigt