SUMMARY
In 30 seconds
Bin Liu says his team found that structurally correct JSON or XML did not ensure an attractive video. They turned to HTML, CSS, and JavaScript as a representation that language models could use to express visual decisions.
- 1Structured output was not enoughBin says JSON and XML could be correct without yielding a visually compelling result.
- 2Move to web codeHis team turned to HTML, CSS, and JavaScript to express visual choices.
- 3Edit through conversationHe says the approach lets users direct an agent to revise videos.
Takeaways
- A structurally valid data format does not guarantee a good visual result.
- Bin’s team chose web code to express layout, styling, and behavior.
- He believes this representation makes conversational video editing more practical.
FULL TEXT
Read the edited text by chapter
01
From structured data to visual code
Bin explains his team’s approach to AI video editing.
Bin Liu says his team found that an agent could produce structurally correct JSON or XML without ensuring the resulting video looked good. They turned to HTML, CSS, and JavaScript as a way to express both information and visual styling. In his view, web code gives the model a useful representation for creating and revising videos through conversation. This is an account of his team’s experience, rather than a claim that a particular format guarantees visual quality.
More from this channel
46:40EN
Peter Yang· Nov 8, 2026Podcast · 2 speakersAshley Alexander: How AI Helps Me Care for My Parents With CancerGuest Ashley Alexander · Host Peter YangA caregiver uses AI to prepare for appointments, organize records and ask better questions—while keeping doctors at the center of treatment.
17:50ENPeter Yang· Nov 4, 2026PodcastPeter Yang’s Five Steps for Using AI to Help Care for His MotherYang uses a shared care brief and organized records to navigate appointments, while making time for family.
15:03ENPeter Yang· Nov 3, 2026PodcastHow Peter Yang Used an AI Phone Agent to Negotiate His Internet BillAn AI call negotiated a lower price and faster service, but Yang still had to approve the change himself.
33:09ENPeter Yang· Nov 1, 2026Podcast · 2 speakersJaclyn Konzelmann: When AI Can Build More, Choose What Deserves to ExistGuest Jaclyn Konzelmann · Host Peter YangGoogle Labs pairs short strategy documents with prototypes, user co-creation and lessons from experiments that end.
13:05ENPeter Yang· Oct 28, 2026PodcastPeter Yang Tests Genie 4: Convincing Worlds, Unfinished GameplayFive live demonstrations show scenes that respond to prompts and sound, alongside inconsistent actions and limited game mechanics.
1:06ENPeter Yang· Oct 26, 2026PodcastPeter Yang on Setting Up Payroll for a One-Person BusinessIn a paid partnership, Yang describes the paperwork he encountered and a payroll product integrated with a business account.