Results
243 articlesSort
4:59EN
Matthew Berman· Jul 25, 2023Testing Airoboros L2 70B on Coding, Writing and ReasoningMatthew Berman · Forward FutureMatthew Berman runs a small set of prompts against a Llama 2 fine-tune, finding useful structured output alongside failures on code and logic.
11:07ENMatthew Berman· Jul 24, 2023Installing Llama 2 13B Chat and Testing Its ResponsesMatthew Berman · Forward FutureMatthew Berman demonstrates a 2023 local setup and tests a 13-billion-parameter chat model on coding, writing, arithmetic and reasoning. His small set of prompts illustrates both useful outputs and mistakes.
9:40ENMatthew Berman· Jul 20, 2023Testing Llama 2 70B on Coding, Writing and ReasoningMatthew Berman · Forward FutureMatthew Berman tries Meta’s 70-billion-parameter chat model through a hosted interface, highlighting both useful outputs and inconsistent reasoning.
9:46ENMatthew Berman· Jul 17, 2023Orca Mini V2 vs. OpenOrca: A 2023 Informal Model ComparisonMatthew Berman · Forward FutureMatthew Berman tests two Orca-inspired models on coding, writing and reasoning, with results shaped by prompt setup and subjective scoring.
8:04ENMatthew Berman· Jul 11, 2023WizardLM 13B v1.1 Tested on Coding, Writing and LogicMatthew Berman · Forward FutureMatthew Berman tries an instruction-tuned model on a small set of prompts, with mixed results and several subjective scoring choices.
12:20ENMatthew Berman· Jul 10, 2023Testing UltraLM 13B: A Small Model’s Strengths and Reasoning ErrorsMatthew Berman · Forward FutureA 2023 local test finds useful writing and simple coding alongside failures in games, arithmetic and logic.
9:33ENMatthew Berman· Jun 30, 2023Testing SDXL 0.9: Image Quality, Clipdrop and a Midjourney ComparisonMatthew Berman · Forward FutureIn June 2023, Matthew Berman tries Stability AI’s image model, compares selected prompts with Midjourney and demonstrates Clipdrop’s lighting tool.
18:08ENMatthew Berman· Jun 29, 2023Six Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.
59:36ENMatthew Berman· Jun 27, 2023Pascal Pfeiffer on Retrieval, Open Models, Kaggle and Fine-Tuning with H2O LLM StudioMatthew Berman, Pascal Pfeiffer · Forward FutureIn a 2023 interview, H2O.ai’s Pascal Pfeiffer explains document retrieval and parameter-efficient fine-tuning, reflects on Kaggle competitions and demonstrates LLM Studio. He and Matthew Berman also consider coding assistants and unverified rumors about model architecture.
7:21ENMatthew Berman· Jun 26, 2023Testing Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.
13:50ENMatthew Berman· Jun 23, 2023MPT-30B: Running MosaicML’s Model Locally and Testing Its Chat VariantMatthew Berman · Forward FutureMatthew Berman reviews MosaicML’s June 2023 release, demonstrates a local setup, and puts the hosted chat model through an informal prompt rubric.
8:17ENMatthew Berman· Jun 22, 2023Using OpenLLM to Serve Open Models Through an APIMatthew Berman · Forward FutureMatthew Berman demonstrates a local model server, its interactive API and a Python client in a 2023 walkthrough.
4:36ENMatthew Berman· Jun 20, 2023Testing WizardCoder 15B as a Local Coding AssistantMatthew Berman · Forward FutureMatthew Berman runs the 2023 WizardCoder model locally, testing small Python exercises and a longer Snake game.
9:46ENMatthew Berman· Jun 19, 2023Installing Text Generation WebUI on Windows: A 2023 Local-Model WalkthroughMatthew Berman · Forward FutureMatthew Berman installs an early version of Text Generation WebUI, resolves setup errors and explains model downloads and interface settings. The steps and packages are historical; consult the project’s current documentation for a modern installation.
59:28EN
Cognitive Revolution "How AI Changes Everything"· Jun 16, 2023PodcastFrom $500,000 to $50,000: MosaicML Made Training Your Own Model a Priced ProductHost Nathan LabenzJonathan Frankle and Abhi Venigalla explain who is training custom LLMs, why extraction beats chat, and how ALiBi stretches a 65k context window.
10:23ENMatthew Berman· Jun 15, 2023Testing Hosted Falcon 40B and Document Chat in h2oGPTMatthew Berman · Forward FutureMatthew Berman tries H2O.ai’s 2023 hosted Falcon 40B interface on coding, writing and reasoning prompts, then demonstrates document chat.
19:38ENMatthew Berman· Jun 9, 2023Orca: Teaching a Smaller Model with GPT-4 ExplanationsMatthew Berman · Forward FutureMatthew Berman reviews Microsoft Research’s 2023 Orca paper and its approach to training a 13-billion-parameter model on detailed teacher responses.
2:41:58EN
Lex Fridman· Jun 8, 2023Podcast · 2 speakersZuckerberg showed up as Mark Elliott — then argued for many AIs, not oneGuest Mark Zuckerberg · Host Lex FridmanOn his second Lex Fridman podcast, the Meta CEO treats a disguised first jiu-jitsu tournament, an open research model called LLaMA, and a future of many agents as the same bet: ship before it is perfect, and do not build a single god model.
10:40ENMatthew Berman· Jun 7, 2023Testing Nous Hermes 13B Locally: Mixed Reasoning and Unsafe ResponsesMatthew Berman · Forward FutureMatthew Berman compares a 2023 quantized model on hosted and local hardware, with uneven results across coding, logic and safety.
8:51ENMatthew Berman· Jun 2, 2023Falcon 40B: A 2023 Leaderboard Result and a Slow GPU TestMatthew Berman · Forward FutureMatthew Berman tries a quantized Falcon 40B Instruct checkpoint on a hosted GPU and finds useful output but slow generation.
11:42ENMatthew Berman· May 31, 2023Guanaco and QLoRA: A 2023 Fine-Tuning and Model TestMatthew Berman · Forward FutureMatthew Berman reviews the QLoRA paper, explains the reported memory savings and tries Guanaco 65B on an informal prompt set.
7:51ENMatthew Berman· May 30, 2023Running Guanaco 65B on a Cloud GPU with Runpod and Text Generation Web UIMatthew Berman · Forward FutureMatthew Berman demonstrates a 2023 workflow for renting a GPU, loading a quantized model and generating text. Model requirements, pricing and interfaces depend on the chosen version.
1:20:49ENCognitive Revolution "How AI Changes Everything"· May 25, 2023PodcastA Wafer-Scale Chip So AI Stops Waiting on AmdahlHost Nathan LabenzAndrew Feldman, CEO of Cerebras, tells Nathan Labenz why one 2.5-trillion-transistor die, sparse linear algebra, and a 16-machine supercomputer are a better shape than a GPU cluster.
1:11:11EN
20VC with Harry Stebbings· May 17, 2023Podcast · 2 speakersEmad Mostaque on Open AI Models, National Data and the Race to DeployGuest Emad Mostaque · Host Harry StebbingsThe Stability AI co-founder describes his 2023 vision for open models, healthcare applications and AI businesses, alongside concerns about a speculative boom.Load moreShowing 24 of 243