Results
152 articlesSort
9:53EN
Matthew Berman· May 28, 2024Testing Microsoft Phi-3 Medium Locally: Mixed Coding and Reasoning ResultsMatthew Berman · Forward FutureMatthew Berman runs a quantized Phi-3 Medium on a MacBook and explores coding, arithmetic and reasoning prompts.
13:37ENMatthew Berman· May 16, 2024Testing Gemini 1.5 Pro’s Long Context and Video UnderstandingMatthew Berman · Forward FutureMatthew Berman’s 2024 tests show useful image and video summaries alongside blocked code and missed details.
16:25ENMatthew Berman· May 8, 2024Visualization-of-Thought and an Open-Source Windows AssistantMatthew Berman · Forward FutureMatthew Berman explains a spatial-reasoning prompting experiment and examines desktop automation demos from the separate PyWinAssistant project.
17:12ENMatthew Berman· Apr 30, 2024Testing the Mystery 'gpt2-chatbot' Model in April 2024Matthew Berman · Forward FutureMatthew Berman tries an anonymous model on coding, arithmetic and reasoning tasks while its identity remains uncertain.
21:47ENMatthew Berman· Apr 24, 2024Phi-3 Mini: Microsoft’s Small Model, Phone Deployment and an Uncertain Local TestMatthew Berman · Forward FutureMatthew Berman reviews Microsoft’s 2024 technical report and runs informal prompts, with an unresolved model label in the demonstration.
16:28ENMatthew Berman· Apr 23, 2024Testing Reka Core: Multimodal Benchmarks, Coding and ReasoningMatthew Berman · Forward FutureMatthew Berman reviews Reka’s reported model comparisons and tests Core on code, logic and image understanding.
14:21ENMatthew Berman· Apr 17, 2024Grok-1.5V Preview: Vision Examples and a New Spatial BenchmarkMatthew Berman · Forward FutureMatthew Berman reviews xAI’s 2024 multimodal model preview, its reported benchmark results and example image tasks.
1:00ENMatthew Berman· Apr 2, 2024LLM Colosseum: Language Models Play Street Fighter IIIMatthew Berman · Forward FutureMatthew Berman watches a short match in which language-model agents choose fighting-game actions from observations of the game.
1:20:44EN
Cognitive Revolution "How AI Changes Everything"· Mar 30, 2024PodcastSeeing Like a Mamba: Vision, Rotting States, and a Cell Model in 90 DaysHost Nathan LabenzNathan Labenz and Jason Meaux survey the vision papers, long-context experiments, and biology work that followed the original Mamba release.
8:26ENMatthew Berman· Mar 18, 2024Testing Grok on X After the 2024 Grok-1 Weight ReleaseMatthew Berman · Forward FutureMatthew Berman tries coding and reasoning prompts in the hosted Grok interface, with mixed results.
13:57ENMatthew Berman· Feb 27, 2024Mistral Large: A 2024 Review of Coding, Reasoning and Safety ResponsesMatthew Berman · Forward FutureMatthew Berman reviews Mistral’s launch claims and tests the model with a small set of prompts.
30:39ENMatthew Berman· Feb 25, 2024NVIDIA’s GEAR Research, Gemini 1.5 and Fast AI InferenceMatthew Berman · Forward FutureMatthew Berman reviews embodied-agent research and a February 2024 set of AI releases and demonstrations.
11:14ENMatthew Berman· Feb 8, 2024Gemini Advanced and Ultra 1.0: A First Look and Hands-On TestMatthew Berman · Forward FutureIn February 2024, Matthew Berman reviews Google’s Bard rebrand and tests its new paid Gemini experience on coding, logic and image recognition.
9:25ENMatthew Berman· Jan 31, 2024Matthew Berman Tests Meta’s Code Llama 70B on a Snake GameMatthew Berman · Forward FutureA 2024 look at Meta’s coding-model release, a SQL-focused fine-tune and a hands-on test that did not work on the first attempt.
0:42ENMatthew Berman· Jan 31, 2024LLaVA 1.6 Adds Higher-Resolution Image UnderstandingMatthew Berman · Forward FutureMatthew Berman reviews the January 2024 release of LLaVA 1.6 and its local availability through Ollama.
14:04ENMatthew Berman· Dec 15, 2023Mistral Medium in 2023: API Pricing and Informal Model TestsMatthew Berman · Forward FutureMatthew Berman compares the original Mistral Medium prototype with Mixtral and GPT-4, then tests coding, writing and reasoning through the API.
7:48ENMatthew Berman· Nov 26, 2023Testing Dolphin 2.2 Yi 34B on Coding and Reasoning TasksMatthew Berman · Forward FutureMatthew Berman runs a quantized Yi fine-tune through informal coding, writing and logic prompts in November 2023, with uneven results.
10:37ENMatthew Berman· Nov 17, 2023Testing DeepSeek Coder on Forms, Bugs and a Snake GameMatthew Berman · Forward FutureMatthew Berman puts the 2023 coding model through a small hands-on rubric, from JSON and unit tests to a playable game.
11:05ENMatthew Berman· Nov 7, 2023Testing Dolphin 2.2, a Mistral 7B Fine-TuneMatthew Berman · Forward FutureMatthew Berman tries a small open-weight model on coding, formatting and reasoning prompts, with mixed results.
12:49ENMatthew Berman· Sep 14, 2023Falcon 180B: A 2023 Review of TII’s Open-Weight ModelMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and writing prompts while examining the model’s training scale and license.
2:25ENMatthew Berman· Aug 1, 2023Gorilla: Generating API Calls with Language ModelsMatthew Berman · Forward FutureMatthew Berman introduces a 2023 research project on using retrieved documentation to help language models generate tool calls.
9:46ENMatthew Berman· Jul 17, 2023Orca Mini V2 vs. OpenOrca: A 2023 Informal Model ComparisonMatthew Berman · Forward FutureMatthew Berman tests two Orca-inspired models on coding, writing and reasoning, with results shaped by prompt setup and subjective scoring.
18:08ENMatthew Berman· Jun 29, 2023Six Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.
4:36ENMatthew Berman· Jun 20, 2023Testing WizardCoder 15B as a Local Coding AssistantMatthew Berman · Forward FutureMatthew Berman runs the 2023 WizardCoder model locally, testing small Python exercises and a longer Snake game.Load moreShowing 24 of 152