Four Personal AI Agents on Nine Tasks: A User’s Test

Claire Vo compares work and family workflows while acknowledging uneven access and subjective scoring.

CVClaire Voホスト
チャンネル
How I AI
公開日
2026年10月28日
動画
35:10
読了時間
3 分
原文
英語
YouTube で開く
スクロールすると動画は右下に小さくなって再生を続けます。字幕は閲覧言語に合わせて切り替わります。
閲覧言語2 言語で読めます
この記事はまだ日本語に翻訳されていないため、英語の原文を表示しています。
要約

30 秒でわかる

Claire Vo tests Grok Bot, Dot, Muse and Claude Duet on nine personal tasks. Different operator agents, connectors and prior context limit direct comparison; the ranking reflects her own non-blind judgments and an unclear score calculation.

  1. 1Nine personal tasksThe tasks reflect one user’s work and family workflows.
  2. 2Unequal setupDifferent operators, connections and memories limit direct comparison.
  3. 3One bug fixThe coding results concern one issue and were judged in this particular run.
  4. 4Personal artifactsDesign and presentation preferences influenced the reviewer’s rankings.
  5. 5Unclear scoringThe final percentages lacked a clear calculation and are not general accuracy rates.

ポイント

  1. The tasks reflect one user’s work and family workflows.
  2. Different operators, connections and memories limit direct comparison.
  3. The coding results concern one issue and were judged in this particular run.
  4. Design and presentation preferences influenced the reviewer’s rankings.
  5. The final percentages lacked a clear calculation and are not general accuracy rates.
全文

チャプターごとに整えた全文を読む

文字起こしのみ
01

Benchmark setup

Vo describes nine tasks and the limitations of her setup.

Claire Vo compares four personal agents—Grok Bot, Dot, Muse and Claude Duet—on nine tasks in October 2026. This is her personal, exploratory test, not a standardized or independently replicated benchmark.

She asked the agents for common tasks and selected overlapping use cases. The prompts were short and written in her usual style, covering work, creative production and family needs.

An operator agent controlled each assistant through computer use. Claude operated Dot, while Codex operated the other three; Vo also intervened when automation broke or needed nudging. Different operators are a significant confounder.

Vo tried to align available connections and skills but forgot to connect Muse to several business tools. Assistants also had different histories and memories, and she scored the outputs knowing which system produced them.

The nine tasks include a Slack reply, short video editing, a Sentry bug fix, a Figma thumbnail, inbox triage, a family newspaper, a child’s physics question, shoe shopping and a product launch video.

Vo reports that Dot and Grok completed all nine tasks, while Muse and Duet completed seven in her setup. Muse lacked some connections, and Vo says the automation itself sometimes needed help; completion counts should be read in that context.

She reports that Muse was fastest on several tasks and Duet was often slower, while permission requests varied. Speed and asking for approval are different dimensions from correctness and appropriateness.

02

Work and creative tasks

Replies, video, coding, thumbnails and inbox triage yield mixed results.

For the Slack reply, Muse lacked access. Vo says the available drafts were broadly usable; she preferred Dot’s inclusion of compensation and remote participation because those matched her personal preferences.

For a short-form video, Duet did not complete the requested download and edit in this run. Vo preferred Muse’s cuts and layout, placed Dot next, and disliked aspects of Grok’s overlay. Her visual ranking is subjective.

On a Sentry bug, Muse had no GitHub connection. Vo says Dot came closest to the expected fix, while Duet also identified another bug; she criticizes Grok’s fix for loosening validation. These are assessments of one issue, not a general coding benchmark.

For a Figma thumbnail, she disliked Muse’s design, found Dot and Duet usable but conservative, and preferred Grok’s alternative ideas. The result depends on her template, materials and aesthetic preferences.

All the tools with relevant access found inbox tasks, but Vo preferred Grok’s document format. Muse saw only her Gmail, while she found Dot’s brief message less useful for this workflow.

03

Personal tasks

The agents handle a family newspaper, homework and shopping.

For a family newspaper, Vo liked Muse’s visual presentation and Grok’s organization. She says Duet had only her work calendar and produced an outline, while Dot’s layout did not meet her taste. Unequal access affects this comparison.

All four answered the selected velocity-versus-time homework question correctly according to Vo. She preferred Muse because it responded quickly; one exercise does not measure overall educational reliability.

For shoe shopping, she preferred Grok’s comparison and found Muse nearly as useful with some steering. Duet encountered blocked sites and mismatched the requested colors; she judged Dot’s search incomplete.

04

Launch video and ranking

The reviewer scores outputs and discusses her preferences.

For a product launch video, Duet produced the version Vo preferred. Grok followed more of her established style but had layout overflow; Muse lacked repository access and invented details, demonstrating why output claims need checking.

Vo feeds her spoken judgments into Claude for a final ranking, where Grok comes first and Muse follows. She says she does not know exactly how the displayed percentages were calculated; they should not be treated as reproducible accuracy rates.

Her practical takeaway is to choose tools by task and to check connectors, speed, output presentation and approval behavior. She personally favors Grok for several work tasks and Muse for family-oriented tasks in this setup.

For coding, Vo says the Dot and Duet results were strongest in her test, but she would generally use the underlying coding tools directly. All conclusions remain specific to the prompts, access, operators and judgments used here.

同じチャンネルの記事

スライド 5 枚29:40EN
How I AI· 2026年10月26日ポッドキャスト · 2 人How Reddit Proto Connects Design, Live Data and Production Codeゲスト Blair Metcalf · ホスト Claire VoBlair Metcalf demonstrates Reddit’s internal prototyping harness and its design-system mapping for Figma and Cursor.プロダクトと UXAI Product Management開発ワークフローとテスト+1
スライド 13 枚16:22EN
How I AI· 2026年10月21日ポッドキャストClaire Vo: Claude Duet Is Beautiful, but It Is Not My Number One Agentホスト Claire VoAnthropic’s phone-based personal agent has the most polished launch Claire Vo has seen: thoughtful onboarding, task lists, first-class artifacts, and Slack-style channels. Polish is not enough when every other agent is competing for the same attention.Personal agentsAnthropicAI interface design+2
36:33EN
How I AI· 2026年10月19日ポッドキャスト · 2 人How Brooke Lacey Uses Claude Code to Edit Short Videosゲスト Brooke Lacey · ホスト Claire VoA creator combines local media tools, timed cut lists and human feedback.Generative mediaCreator Economy
24:05EN
How I AI· 2026年10月14日ポッドキャストA First Look at Meta Muse Wonder on Agent and Design Tasksホスト Claire VoClaire Vo reports strengths and weaknesses from her own small evaluation.評価(Evals)AI agents
37:47EN
How I AI· 2026年10月12日ポッドキャスト · 2 人Designing Meta Muse: Status, Personalization and Everyday Agentsゲスト Alex Cornell · ホスト Claire VoAlex Cornell discusses consumer agent design and his own experiments with Muse.Product DesignPersonal agentsHuman-AI Collaboration
35:41EN
How I AI· 2026年10月5日ポッドキャスト · 2 人ChatGPT Sites for Work, Music and Gamesゲスト Kath Korevec · ホスト Claire VoOpenAI’s Kath Korevec demonstrates connected sites and personal projects.Product DesignWorkflow automationAI agents