絞り込み結果
226 件並び順
19:51EN
Matthew Berman· 2024年3月15日Devin’s 2024 Launch: Coding-Agent Demos and Benchmark ClaimsMatthew Berman, Scott Wu, Neal, Walden · Forward FutureMatthew Berman examines Cognition’s software-agent demonstrations, interface and SWE-bench comparison alongside earlier coding projects.
13:57ENMatthew Berman· 2024年2月27日Mistral Large: A 2024 Review of Coding, Reasoning and Safety ResponsesMatthew Berman · Forward FutureMatthew Berman reviews Mistral’s launch claims and tests the model with a small set of prompts.
30:39ENMatthew Berman· 2024年2月25日NVIDIA’s GEAR Research, Gemini 1.5 and Fast AI InferenceMatthew Berman · Forward FutureMatthew Berman reviews embodied-agent research and a February 2024 set of AI releases and demonstrations.
11:14ENMatthew Berman· 2024年2月8日Gemini Advanced and Ultra 1.0: A First Look and Hands-On TestMatthew Berman · Forward FutureIn February 2024, Matthew Berman reviews Google’s Bard rebrand and tests its new paid Gemini experience on coding, logic and image recognition.
9:25ENMatthew Berman· 2024年1月31日Matthew Berman Tests Meta’s Code Llama 70B on a Snake GameMatthew Berman · Forward FutureA 2024 look at Meta’s coding-model release, a SQL-focused fine-tune and a hands-on test that did not work on the first attempt.
0:42ENMatthew Berman· 2024年1月31日LLaVA 1.6 Adds Higher-Resolution Image UnderstandingMatthew Berman · Forward FutureMatthew Berman reviews the January 2024 release of LLaVA 1.6 and its local availability through Ollama.
14:04ENMatthew Berman· 2023年12月15日Mistral Medium in 2023: API Pricing and Informal Model TestsMatthew Berman · Forward FutureMatthew Berman compares the original Mistral Medium prototype with Mixtral and GPT-4, then tests coding, writing and reasoning through the API.
19:37ENMatthew Berman· 2023年12月13日How Rephrased Test Data Inflated a 13B Model’s Benchmark ScoresMatthew Berman · Forward FutureMatthew Berman examines a 2023 experiment showing how reworded benchmark questions can evade simple contamination checks and inflate model scores.
20:49ENMatthew Berman· 2023年12月12日Mixtral 8x7B: Mixture-of-Experts Architecture, Setup and Early TestsMatthew Berman · Forward FutureMatthew Berman reviews Mistral AI’s December 2023 open-weight model, demonstrates a cloud setup and tests its coding and reasoning responses.
26:52ENMatthew Berman· 2023年12月7日Google’s Gemini Launch: Multimodal Demos, Benchmarks and Research ApplicationsMatthew Berman · Forward FutureMatthew Berman reviews Google’s December 2023 Gemini report and promotional demonstrations, from visual reasoning to scientific literature screening.
7:48ENMatthew Berman· 2023年11月26日Testing Dolphin 2.2 Yi 34B on Coding and Reasoning TasksMatthew Berman · Forward FutureMatthew Berman runs a quantized Yi fine-tune through informal coding, writing and logic prompts in November 2023, with uneven results.
10:37ENMatthew Berman· 2023年11月17日Testing DeepSeek Coder on Forms, Bugs and a Snake GameMatthew Berman · Forward FutureMatthew Berman puts the 2023 coding model through a small hands-on rubric, from JSON and unit tests to a playable game.
11:05ENMatthew Berman· 2023年11月7日Testing Dolphin 2.2, a Mistral 7B Fine-TuneMatthew Berman · Forward FutureMatthew Berman tries a small open-weight model on coding, formatting and reasoning prompts, with mixed results.
13:11ENMatthew Berman· 2023年10月5日Testing Mistral 7B OpenOrca: A 2023 Cloud Setup and Prompt TrialMatthew Berman · Forward FutureMatthew Berman runs a quantized OpenOrca variant on a rented GPU and reviews coding, writing and reasoning examples.
12:49ENMatthew Berman· 2023年9月14日Falcon 180B: A 2023 Review of TII’s Open-Weight ModelMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and writing prompts while examining the model’s training scale and license.
10:20ENMatthew Berman· 2023年8月30日Phind Code Llama 34B vs GPT-4: A 2023 Python Coding TestMatthew Berman · Forward FutureMatthew Berman compares a quantized Phind fine-tune with GPT-4 on games, short functions and refactoring, with mixed results.
2:25ENMatthew Berman· 2023年8月1日Gorilla: Generating API Calls with Language ModelsMatthew Berman · Forward FutureMatthew Berman introduces a 2023 research project on using retrieved documentation to help language models generate tool calls.
5:34ENMatthew Berman· 2023年7月26日FreeWilly2: A 2023 Prompt Test with Uncertain FormattingMatthew Berman · Forward FutureMatthew Berman retries an instruction-tuned Llama 2 model after a poor first run, finding mixed results and a likely template problem.
11:16ENMatthew Berman· 2023年7月21日AI News in July 2023: Llama 2, Generated Video and Model BehaviorMatthew Berman · Matthew BermanMatthew Berman surveys a week of AI announcements, research and reporting, from entertainment experiments to enterprise tools and Meta’s Llama 2.
9:40ENMatthew Berman· 2023年7月20日Testing Llama 2 70B on Coding, Writing and ReasoningMatthew Berman · Forward FutureMatthew Berman tries Meta’s 70-billion-parameter chat model through a hosted interface, highlighting both useful outputs and inconsistent reasoning.
9:46ENMatthew Berman· 2023年7月17日Orca Mini V2 vs. OpenOrca: A 2023 Informal Model ComparisonMatthew Berman · Forward FutureMatthew Berman tests two Orca-inspired models on coding, writing and reasoning, with results shaped by prompt setup and subjective scoring.
18:08ENMatthew Berman· 2023年6月29日Six Language Models Compared on an Informal 2023 Prompt SetMatthew Berman · Forward FutureMatthew Berman tests coding, writing and reasoning with H2O GPT, finding a tie under a small and subjective rubric.
4:36ENMatthew Berman· 2023年6月20日Testing WizardCoder 15B as a Local Coding AssistantMatthew Berman · Forward FutureMatthew Berman runs the 2023 WizardCoder model locally, testing small Python exercises and a longer Snake game.
19:38ENMatthew Berman· 2023年6月9日Orca: Teaching a Smaller Model with GPT-4 ExplanationsMatthew Berman · Forward FutureMatthew Berman reviews Microsoft Research’s 2023 Orca paper and its approach to training a 13-billion-parameter model on detailed teacher responses.もっと見る226 件中 24 件を表示