Four Personal AI Agents on Nine Tasks: A User’s Test

Claire Vo compares work and family workflows while acknowledging uneven access and subjective scoring.

CVClaire VoModeration
Kanal
How I AI
Veröffentlicht
28. Okt. 2026
Video
35:10
Lesezeit
3 Min.
Original
Englisch
Auf YouTube öffnen
Beim Scrollen schrumpft das Video in die rechte untere Ecke und läuft weiter. Untertitel folgen Ihrer Lesesprache.
LesespracheIn 2 Sprachen verfügbar
Diesen Artikel gibt es noch nicht auf Deutsch, daher wird das Original (Englisch) angezeigt.
ZUSAMMENFASSUNG

In 30 Sekunden

Claire Vo tests Grok Bot, Dot, Muse and Claude Duet on nine personal tasks. Different operator agents, connectors and prior context limit direct comparison; the ranking reflects her own non-blind judgments and an unclear score calculation.

  1. 1Nine personal tasksThe tasks reflect one user’s work and family workflows.
  2. 2Unequal setupDifferent operators, connections and memories limit direct comparison.
  3. 3One bug fixThe coding results concern one issue and were judged in this particular run.
  4. 4Personal artifactsDesign and presentation preferences influenced the reviewer’s rankings.
  5. 5Unclear scoringThe final percentages lacked a clear calculation and are not general accuracy rates.

Das Wichtigste

  1. The tasks reflect one user’s work and family workflows.
  2. Different operators, connections and memories limit direct comparison.
  3. The coding results concern one issue and were judged in this particular run.
  4. Design and presentation preferences influenced the reviewer’s rankings.
  5. The final percentages lacked a clear calculation and are not general accuracy rates.
VOLLTEXT

Den bearbeiteten Text nach Kapiteln lesen

Nur das Transkript
01

Benchmark setup

Vo describes nine tasks and the limitations of her setup.

Claire Vo compares four personal agents—Grok Bot, Dot, Muse and Claude Duet—on nine tasks in October 2026. This is her personal, exploratory test, not a standardized or independently replicated benchmark.

She asked the agents for common tasks and selected overlapping use cases. The prompts were short and written in her usual style, covering work, creative production and family needs.

An operator agent controlled each assistant through computer use. Claude operated Dot, while Codex operated the other three; Vo also intervened when automation broke or needed nudging. Different operators are a significant confounder.

Vo tried to align available connections and skills but forgot to connect Muse to several business tools. Assistants also had different histories and memories, and she scored the outputs knowing which system produced them.

The nine tasks include a Slack reply, short video editing, a Sentry bug fix, a Figma thumbnail, inbox triage, a family newspaper, a child’s physics question, shoe shopping and a product launch video.

Vo reports that Dot and Grok completed all nine tasks, while Muse and Duet completed seven in her setup. Muse lacked some connections, and Vo says the automation itself sometimes needed help; completion counts should be read in that context.

She reports that Muse was fastest on several tasks and Duet was often slower, while permission requests varied. Speed and asking for approval are different dimensions from correctness and appropriateness.

02

Work and creative tasks

Replies, video, coding, thumbnails and inbox triage yield mixed results.

For the Slack reply, Muse lacked access. Vo says the available drafts were broadly usable; she preferred Dot’s inclusion of compensation and remote participation because those matched her personal preferences.

For a short-form video, Duet did not complete the requested download and edit in this run. Vo preferred Muse’s cuts and layout, placed Dot next, and disliked aspects of Grok’s overlay. Her visual ranking is subjective.

On a Sentry bug, Muse had no GitHub connection. Vo says Dot came closest to the expected fix, while Duet also identified another bug; she criticizes Grok’s fix for loosening validation. These are assessments of one issue, not a general coding benchmark.

For a Figma thumbnail, she disliked Muse’s design, found Dot and Duet usable but conservative, and preferred Grok’s alternative ideas. The result depends on her template, materials and aesthetic preferences.

All the tools with relevant access found inbox tasks, but Vo preferred Grok’s document format. Muse saw only her Gmail, while she found Dot’s brief message less useful for this workflow.

03

Personal tasks

The agents handle a family newspaper, homework and shopping.

For a family newspaper, Vo liked Muse’s visual presentation and Grok’s organization. She says Duet had only her work calendar and produced an outline, while Dot’s layout did not meet her taste. Unequal access affects this comparison.

All four answered the selected velocity-versus-time homework question correctly according to Vo. She preferred Muse because it responded quickly; one exercise does not measure overall educational reliability.

For shoe shopping, she preferred Grok’s comparison and found Muse nearly as useful with some steering. Duet encountered blocked sites and mismatched the requested colors; she judged Dot’s search incomplete.

04

Launch video and ranking

The reviewer scores outputs and discusses her preferences.

For a product launch video, Duet produced the version Vo preferred. Grok followed more of her established style but had layout overflow; Muse lacked repository access and invented details, demonstrating why output claims need checking.

Vo feeds her spoken judgments into Claude for a final ranking, where Grok comes first and Muse follows. She says she does not know exactly how the displayed percentages were calculated; they should not be treated as reproducible accuracy rates.

Her practical takeaway is to choose tools by task and to check connectors, speed, output presentation and approval behavior. She personally favors Grok for several work tasks and Muse for family-oriented tasks in this setup.

For coding, Vo says the Dot and Duet results were strongest in her test, but she would generally use the underlying coding tools directly. All conclusions remain specific to the prompts, access, operators and judgments used here.

Mehr aus diesem Kanal

5 Folien29:40EN
How I AI· 26. Okt. 2026Podcast · 2 StimmenHow Reddit Proto Connects Design, Live Data and Production CodeGast: Blair Metcalf · Moderation: Claire VoBlair Metcalf demonstrates Reddit’s internal prototyping harness and its design-system mapping for Figma and Cursor.Produkt & UXAI Product ManagementEntwicklungs-Workflows & Tests+1
13 Folien16:22EN
How I AI· 21. Okt. 2026PodcastClaire Vo: Claude Duet Is Beautiful, but It Is Not My Number One AgentModeration: Claire VoAnthropic’s phone-based personal agent has the most polished launch Claire Vo has seen: thoughtful onboarding, task lists, first-class artifacts, and Slack-style channels. Polish is not enough when every other agent is competing for the same attention.Personal agentsAnthropicAI interface design+2
36:33EN
How I AI· 19. Okt. 2026Podcast · 2 StimmenHow Brooke Lacey Uses Claude Code to Edit Short VideosGast: Brooke Lacey · Moderation: Claire VoA creator combines local media tools, timed cut lists and human feedback.Generative mediaCreator Economy
24:05EN
How I AI· 14. Okt. 2026PodcastA First Look at Meta Muse Wonder on Agent and Design TasksModeration: Claire VoClaire Vo reports strengths and weaknesses from her own small evaluation.EvalsAI agents
37:47EN
How I AI· 12. Okt. 2026Podcast · 2 StimmenDesigning Meta Muse: Status, Personalization and Everyday AgentsGast: Alex Cornell · Moderation: Claire VoAlex Cornell discusses consumer agent design and his own experiments with Muse.Product DesignPersonal agentsHuman-AI Collaboration
35:41EN
How I AI· 5. Okt. 2026Podcast · 2 StimmenChatGPT Sites for Work, Music and GamesGast: Kath Korevec · Moderation: Claire VoOpenAI’s Kath Korevec demonstrates connected sites and personal projects.Product DesignWorkflow automationAI agents