Four Personal AI Agents on Nine Tasks: A User’s Test

Claire Vo compares work and family workflows while acknowledging uneven access and subjective scoring.

CVClaire Vo진행자
채널
How I AI
게시일
2026년 10월 28일
영상
35:10
읽기
3분
원문
영어
YouTube에서 열기
스크롤하면 영상이 오른쪽 아래로 작아져 계속 재생됩니다. 자막은 읽기 언어를 따릅니다.
읽기 언어2개 언어로 읽을 수 있음
이 글은 아직 한국어 번역이 없어 영어 원문으로 표시합니다.
요약

30초 요약

Claire Vo tests Grok Bot, Dot, Muse and Claude Duet on nine personal tasks. Different operator agents, connectors and prior context limit direct comparison; the ranking reflects her own non-blind judgments and an unclear score calculation.

  1. 1Nine personal tasksThe tasks reflect one user’s work and family workflows.
  2. 2Unequal setupDifferent operators, connections and memories limit direct comparison.
  3. 3One bug fixThe coding results concern one issue and were judged in this particular run.
  4. 4Personal artifactsDesign and presentation preferences influenced the reviewer’s rankings.
  5. 5Unclear scoringThe final percentages lacked a clear calculation and are not general accuracy rates.

핵심 정리

  1. The tasks reflect one user’s work and family workflows.
  2. Different operators, connections and memories limit direct comparison.
  3. The coding results concern one issue and were judged in this particular run.
  4. Design and presentation preferences influenced the reviewer’s rankings.
  5. The final percentages lacked a clear calculation and are not general accuracy rates.
전문

챕터별로 다듬은 전문 읽기

원본 자막만 보기
01

Benchmark setup

Vo describes nine tasks and the limitations of her setup.

Claire Vo compares four personal agents—Grok Bot, Dot, Muse and Claude Duet—on nine tasks in October 2026. This is her personal, exploratory test, not a standardized or independently replicated benchmark.

She asked the agents for common tasks and selected overlapping use cases. The prompts were short and written in her usual style, covering work, creative production and family needs.

An operator agent controlled each assistant through computer use. Claude operated Dot, while Codex operated the other three; Vo also intervened when automation broke or needed nudging. Different operators are a significant confounder.

Vo tried to align available connections and skills but forgot to connect Muse to several business tools. Assistants also had different histories and memories, and she scored the outputs knowing which system produced them.

The nine tasks include a Slack reply, short video editing, a Sentry bug fix, a Figma thumbnail, inbox triage, a family newspaper, a child’s physics question, shoe shopping and a product launch video.

Vo reports that Dot and Grok completed all nine tasks, while Muse and Duet completed seven in her setup. Muse lacked some connections, and Vo says the automation itself sometimes needed help; completion counts should be read in that context.

She reports that Muse was fastest on several tasks and Duet was often slower, while permission requests varied. Speed and asking for approval are different dimensions from correctness and appropriateness.

02

Work and creative tasks

Replies, video, coding, thumbnails and inbox triage yield mixed results.

For the Slack reply, Muse lacked access. Vo says the available drafts were broadly usable; she preferred Dot’s inclusion of compensation and remote participation because those matched her personal preferences.

For a short-form video, Duet did not complete the requested download and edit in this run. Vo preferred Muse’s cuts and layout, placed Dot next, and disliked aspects of Grok’s overlay. Her visual ranking is subjective.

On a Sentry bug, Muse had no GitHub connection. Vo says Dot came closest to the expected fix, while Duet also identified another bug; she criticizes Grok’s fix for loosening validation. These are assessments of one issue, not a general coding benchmark.

For a Figma thumbnail, she disliked Muse’s design, found Dot and Duet usable but conservative, and preferred Grok’s alternative ideas. The result depends on her template, materials and aesthetic preferences.

All the tools with relevant access found inbox tasks, but Vo preferred Grok’s document format. Muse saw only her Gmail, while she found Dot’s brief message less useful for this workflow.

03

Personal tasks

The agents handle a family newspaper, homework and shopping.

For a family newspaper, Vo liked Muse’s visual presentation and Grok’s organization. She says Duet had only her work calendar and produced an outline, while Dot’s layout did not meet her taste. Unequal access affects this comparison.

All four answered the selected velocity-versus-time homework question correctly according to Vo. She preferred Muse because it responded quickly; one exercise does not measure overall educational reliability.

For shoe shopping, she preferred Grok’s comparison and found Muse nearly as useful with some steering. Duet encountered blocked sites and mismatched the requested colors; she judged Dot’s search incomplete.

04

Launch video and ranking

The reviewer scores outputs and discusses her preferences.

For a product launch video, Duet produced the version Vo preferred. Grok followed more of her established style but had layout overflow; Muse lacked repository access and invented details, demonstrating why output claims need checking.

Vo feeds her spoken judgments into Claude for a final ranking, where Grok comes first and Muse follows. She says she does not know exactly how the displayed percentages were calculated; they should not be treated as reproducible accuracy rates.

Her practical takeaway is to choose tools by task and to check connectors, speed, output presentation and approval behavior. She personally favors Grok for several work tasks and Muse for family-oriented tasks in this setup.

For coding, Vo says the Dot and Duet results were strongest in her test, but she would generally use the underlying coding tools directly. All conclusions remain specific to the prompts, access, operators and judgments used here.

같은 채널의 다른 글

슬라이드 5장29:40EN
How I AI· 2026년 10월 26일팟캐스트 · 2명How Reddit Proto Connects Design, Live Data and Production Code게스트 Blair Metcalf · 진행자 Claire VoBlair Metcalf demonstrates Reddit’s internal prototyping harness and its design-system mapping for Figma and Cursor.제품과 UXAI Product Management개발 워크플로와 테스트+1
슬라이드 13장16:22EN
How I AI· 2026년 10월 21일팟캐스트Claire Vo: Claude Duet Is Beautiful, but It Is Not My Number One Agent진행자 Claire VoAnthropic’s phone-based personal agent has the most polished launch Claire Vo has seen: thoughtful onboarding, task lists, first-class artifacts, and Slack-style channels. Polish is not enough when every other agent is competing for the same attention.Personal agentsAnthropicAI interface design+2
36:33EN
How I AI· 2026년 10월 19일팟캐스트 · 2명How Brooke Lacey Uses Claude Code to Edit Short Videos게스트 Brooke Lacey · 진행자 Claire VoA creator combines local media tools, timed cut lists and human feedback.Generative mediaCreator Economy
24:05EN
How I AI· 2026년 10월 14일팟캐스트A First Look at Meta Muse Wonder on Agent and Design Tasks진행자 Claire VoClaire Vo reports strengths and weaknesses from her own small evaluation.평가(Evals)AI agents
37:47EN
How I AI· 2026년 10월 12일팟캐스트 · 2명Designing Meta Muse: Status, Personalization and Everyday Agents게스트 Alex Cornell · 진행자 Claire VoAlex Cornell discusses consumer agent design and his own experiments with Muse.Product DesignPersonal agentsHuman-AI Collaboration
35:41EN
How I AI· 2026년 10월 5일팟캐스트 · 2명ChatGPT Sites for Work, Music and Games게스트 Kath Korevec · 진행자 Claire VoOpenAI’s Kath Korevec demonstrates connected sites and personal projects.Product DesignWorkflow automationAI agents