Résultats
46 articlesTrier
51:11EN
Matthew Berman· 22 mars 2024Inside Groq’s LPU: Compilers, Chip Networks and Fast InferenceMatthew Berman, Andrew Ling, Igor Arsovski · Forward FutureGroq engineers Andrew Ling and Igor Arsovski explain their hardware and software design in a sponsored 2024 interview.
30:39ENMatthew Berman· 25 févr. 2024NVIDIA’s GEAR Research, Gemini 1.5 and Fast AI InferenceMatthew Berman · Forward FutureMatthew Berman reviews embodied-agent research and a February 2024 set of AI releases and demonstrations.
0:51ENMatthew Berman· 21 févr. 2024A Fast Groq Inference Demo Using MixtralMatthew Berman · Forward FutureMatthew Berman demonstrates a Python code request and explains why fast model output could matter for applications.
20:49ENMatthew Berman· 12 déc. 2023Mixtral 8x7B: Mixture-of-Experts Architecture, Setup and Early TestsMatthew Berman · Forward FutureMatthew Berman reviews Mistral AI’s December 2023 open-weight model, demonstrates a cloud setup and tests its coding and reasoning responses.
12:49ENMatthew Berman· 14 sept. 2023Falcon 180B: A 2023 Review of TII’s Open-Weight ModelMatthew Berman · Forward FutureMatthew Berman tests coding, reasoning and writing prompts while examining the model’s training scale and license.
5:53ENMatthew Berman· 18 juil. 2023Petals: Distributing Large Language Model Inference Across DevicesMatthew Berman · Forward FutureIn 2023, Matthew Berman explains Petals as a way to use large models through a network of participating computers rather than loading every layer on one device.
9:33ENMatthew Berman· 30 juin 2023Testing SDXL 0.9: Image Quality, Clipdrop and a Midjourney ComparisonMatthew Berman · Forward FutureIn June 2023, Matthew Berman tries Stability AI’s image model, compares selected prompts with Midjourney and demonstrates Clipdrop’s lighting tool.
7:21ENMatthew Berman· 26 juin 2023Testing Orca Mini 13B, an Unofficial Model Inspired by OrcaMatthew Berman · Forward FutureMatthew Berman loads a quantized Orca Mini 13B and tries coding, reasoning, arithmetic, and summarization prompts. His 2023 informal test produces several failures and a few successes.
8:17ENMatthew Berman· 22 juin 2023Using OpenLLM to Serve Open Models Through an APIMatthew Berman · Forward FutureMatthew Berman demonstrates a local model server, its interactive API and a Python client in a 2023 walkthrough.