Resultados
223 artículosOrdenar
19:51EN
Matthew Berman· 15 mar 2024Devin’s 2024 Launch: Coding-Agent Demos and Benchmark ClaimsMatthew Berman, Scott Wu, Neal, Walden · Forward FutureMatthew Berman examines Cognition’s software-agent demonstrations, interface and SWE-bench comparison alongside earlier coding projects.
13:57ENMatthew Berman· 27 feb 2024Mistral Large: A 2024 Review of Coding, Reasoning and Safety ResponsesMatthew Berman · Forward FutureMatthew Berman reviews Mistral’s launch claims and tests the model with a small set of prompts.
30:39ENMatthew Berman· 25 feb 2024NVIDIA’s GEAR Research, Gemini 1.5 and Fast AI InferenceMatthew Berman · Forward FutureMatthew Berman reviews embodied-agent research and a February 2024 set of AI releases and demonstrations.
11:14ENMatthew Berman· 8 feb 2024Gemini Advanced and Ultra 1.0: A First Look and Hands-On TestMatthew Berman · Forward FutureIn February 2024, Matthew Berman reviews Google’s Bard rebrand and tests its new paid Gemini experience on coding, logic and image recognition.
9:25ENMatthew Berman· 31 ene 2024Matthew Berman Tests Meta’s Code Llama 70B on a Snake GameMatthew Berman · Forward FutureA 2024 look at Meta’s coding-model release, a SQL-focused fine-tune and a hands-on test that did not work on the first attempt.
0:42ENMatthew Berman· 31 ene 2024LLaVA 1.6 Adds Higher-Resolution Image UnderstandingMatthew Berman · Forward FutureMatthew Berman reviews the January 2024 release of LLaVA 1.6 and its local availability through Ollama.
14:04ENMatthew Berman· 15 dic 2023Mistral Medium in 2023: API Pricing and Informal Model TestsMatthew Berman · Forward FutureMatthew Berman compares the original Mistral Medium prototype with Mixtral and GPT-4, then tests coding, writing and reasoning through the API.
19:37ENMatthew Berman· 13 dic 2023How Rephrased Test Data Inflated a 13B Model’s Benchmark ScoresMatthew Berman · Forward FutureMatthew Berman examines a 2023 experiment showing how reworded benchmark questions can evade simple contamination checks and inflate model scores.
20:49ENMatthew Berman· 12 dic 2023Mixtral 8x7B: Mixture-of-Experts Architecture, Setup and Early TestsMatthew Berman · Forward FutureMatthew Berman reviews Mistral AI’s December 2023 open-weight model, demonstrates a cloud setup and tests its coding and reasoning responses.
26:52ENMatthew Berman· 7 dic 2023Google’s Gemini Launch: Multimodal Demos, Benchmarks and Research ApplicationsMatthew Berman · Forward FutureMatthew Berman reviews Google’s December 2023 Gemini report and promotional demonstrations, from visual reasoning to scientific literature screening.
7:48ENMatthew Berman· 26 nov 2023Testing Dolphin 2.2 Yi 34B on Coding and Reasoning TasksMatthew Berman · Forward FutureMatthew Berman runs a quantized Yi fine-tune through informal coding, writing and logic prompts in November 2023, with uneven results.
10:37ENMatthew Berman· 17 nov 2023Testing DeepSeek Coder on Forms, Bugs and a Snake GameMatthew Berman · Forward FutureMatthew Berman puts the 2023 coding model through a small hands-on rubric, from JSON and unit tests to a playable game.
11:05ENMatthew Berman· 7 nov 2023Testing Dolphin 2.2, a Mistral 7B Fine-TuneMatthew Berman · Forward FutureMatthew Berman tries a small open-weight model on coding, formatting and reasoning prompts, with mixed results.
13:11ENMatthew Berman· 5 oct 2023Testing Mistral 7B OpenOrca: A 2023 Cloud Setup and Prompt TrialMatthew Berman · Forward FutureMatthew Berman runs a quantized OpenOrca variant on a rented GPU and reviews coding, writing and reasoning examples.
12:49ENMatthew Berman· 14 sept 2023Falcon 180B: A 2023 Review of TII’s Open-Weight ModelMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and writing prompts while examining the model’s training scale and license.
10:20ENMatthew Berman· 30 ago 2023Phind Code Llama 34B vs GPT-4: A 2023 Python Coding TestMatthew Berman · Forward FutureMatthew Berman compares a quantized Phind fine-tune with GPT-4 on games, short functions and refactoring, with mixed results.
2:25ENMatthew Berman· 1 ago 2023Gorilla: Generating API Calls with Language ModelsMatthew Berman · Forward FutureMatthew Berman introduces a 2023 research project on using retrieved documentation to help language models generate tool calls.
5:34ENMatthew Berman· 26 jul 2023FreeWilly2: A 2023 Prompt Test with Uncertain FormattingMatthew Berman · Forward FutureMatthew Berman retries an instruction-tuned Llama 2 model after a poor first run, finding mixed results and a likely template problem.
9:40ENMatthew Berman· 20 jul 2023Testing Llama 2 70B on Coding, Writing and ReasoningMatthew Berman · Forward FutureMatthew Berman tries Meta’s 70-billion-parameter chat model through a hosted interface, highlighting both useful outputs and inconsistent reasoning.
9:46ENMatthew Berman· 17 jul 2023Orca Mini V2 vs. OpenOrca: A 2023 Informal Model ComparisonMatthew Berman · Forward FutureMatthew Berman tests two Orca-inspired models on coding, writing and reasoning, with results shaped by prompt setup and subjective scoring.
18:08ENMatthew Berman· 29 jun 2023Six Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.
4:36ENMatthew Berman· 20 jun 2023Testing WizardCoder 15B as a Local Coding AssistantMatthew Berman · Forward FutureMatthew Berman runs the 2023 WizardCoder model locally, testing small Python exercises and a longer Snake game.
19:38ENMatthew Berman· 9 jun 2023Orca: Teaching a Smaller Model with GPT-4 ExplanationsMatthew Berman · Forward FutureMatthew Berman reviews Microsoft Research’s 2023 Orca paper and its approach to training a 13-billion-parameter model on detailed teacher responses.
10:40ENMatthew Berman· 7 jun 2023Testing Nous Hermes 13B Locally: Mixed Reasoning and Unsafe ResponsesMatthew Berman · Forward FutureMatthew Berman compares a 2023 quantized model on hosted and local hardware, with uneven results across coding, logic and safety.Cargar másMostrando 24 de 223