Twelve Open-Source AI Projects for Agents, Video, Coding and Voice

Matthew Berman surveys tools ranging from long-running agent frameworks to document OCR, skill security and local speech generation.

MBMatthew Berman진행자 · Forward Future
채널
Matthew Berman
게시일
2026년 6월 24일
영상
15:12
읽기
3분
슬라이드
7
원문
영어
YouTube에서 열기
스크롤하면 영상이 오른쪽 아래로 작아져 계속 재생됩니다. 자막은 읽기 언어를 따릅니다.
읽기 언어2개 언어로 읽을 수 있음
이 글은 아직 한국어 번역이 없어 영어 원문으로 표시합니다.
요약

30초 요약

In June 2026, Matthew Berman highlights twelve AI projects and explains the workflow each targets. His tour covers agent-based video production, research, cybersecurity and coding, as well as OCR, skill scanning, video editing and voice. The video is a curated introduction, not an independent evaluation of the projects' performance or security claims.

  1. 1Video production with agentsOpenMontage coordinates production tasks; Hyperframes turns web-based animations into video; Palmier Pro offers a Mac editor with agent integration.
  2. 2Agents for longer tasksDeerFlow combines subagents, memory, sandboxes and skills, while Hermes is presented as another configurable agent option.
  3. 3Security and skill inspectionA cybersecurity skills collection supplies defensive frameworks; NVIDIA's SkillSpector is designed to identify risky patterns before skills are installed.
  4. 4Better coding context and processCodebase Memory MCP indexes code structure, while Matt Pocock's skills and gstack encode engineering workflows.
  5. 5Documents and voiceBaidu's Unlimited-OCR demonstrates page recognition and positioning; Voicebox combines speech output and transcription, including local-model options.

핵심 정리

  1. OpenMontage, Hyperframes and Palmier Pro approach AI-assisted video production in different ways.
  2. DeerFlow and Hermes provide agent frameworks, while coding-oriented skills and MCP tools add workflows or codebase context.
  3. Unlimited-OCR targets document recognition and layout, and Voicebox brings speech generation and transcription into a single interface.
  4. SkillSpector scans agent skills for potential risks, but a scan cannot guarantee safety.
  5. Stars, platform support and performance figures reflect the video’s June 2026 snapshot, not independently verified results.
전문

챕터별로 다듬은 전문 읽기

원본 자막만 보기
01

OpenMontage and DeerFlow

Berman introduces agent-assisted video production and a framework for longer-running research tasks.

I have collected twelve open-source AI projects across video, coding, security, documents and voice. These are introductions to tools worth exploring; their GitHub popularity and the performance figures I cite are a snapshot from June 2026, not independent tests.

OpenMontage aims to turn a coding agent into a video production team. Give it a plain-language idea and it coordinates research, scripting, assets, editing and composition. The example is a science-fiction trailer with generated motion clips and soundtrack, composed with Remotion; the project also describes workflows for explainers, screen demos, animation and other formats.

OpenMontage video-production example
슬라이드 1 / 7OpenMontage video-production exampleThe project page describes a workflow from an idea to a composed video.

ByteDance's DeerFlow is an agent framework for longer tasks. It combines subagents with memory, sandboxes, tools and extensible skills. Examples described in the video include data pipelines, slide decks, dashboards and content workflows; Berman suggests it as another framework to experiment with alongside other agent systems.

02

Cybersecurity skills and Hyperframes

A skills collection applies security frameworks to agent work, while Hyperframes converts web-based animations into video.

The Anthropic Cybersecurity Skills repository packages cybersecurity frameworks and techniques for agents that support skills. Berman suggests using it to help examine and improve a codebase's defenses. He mentions MITRE ATT&CK and NIST among the frameworks and notes that he is not a cybersecurity specialist; having the skills does not itself establish that a system is secure.

HeyGen's Hyperframes takes HTML, CSS, media and seekable animation and renders them as MP4 video. Berman points to product demos, slides and motion graphics as possible uses. It uses Chrome and FFmpeg and can work with animation libraries, turning web-oriented composition into a video production workflow.

03

Code intelligence and engineering skills

Codebase Memory MCP, Matt Pocock's skills and gstack address code navigation and structured development workflows.

Codebase Memory MCP is intended to give coding agents structural knowledge of a repository. Its project page claims fast indexing, support for many languages and lower token use; Berman also points to a three-dimensional code graph. Those are project claims rather than measurements he independently runs in the video.

Codebase Memory MCP
슬라이드 2 / 7Codebase Memory MCPThe project page lists its code-indexing approach and performance claims.

Matt Pocock's skills package development practices as instructions for an agent. Berman highlights an 'Ask Matt' routing skill and a documentation-focused questioning workflow that helps refine a project's domain terminology and records. The idea is to encode an experienced developer's habits into repeatable engineering routines.

Gstack, associated with Garry Tan, organizes agent skills into a development process. Berman describes an office-hours workflow for questioning a startup idea, followed by planning, building, review, testing, shipping and reflection. The skills are meant to pass context from one stage to the next, not merely offer isolated commands.

Gstack development process
슬라이드 3 / 7Gstack development processThe diagram sets out a sequence from thinking and planning through shipping and reflection.
04

OCR and scanning agent skills

Unlimited-OCR reads and locates document content. SkillSpector scans skills for patterns associated with security risks.

Baidu's Unlimited-OCR is an open-weight vision-language model for document recognition. The demonstration highlights passages in a research-paper PDF, showing both extracted text and where content appears on the page. Berman notes that connecting text with its correct position is harder than extracting words alone.

Unlimited-OCR document example
슬라이드 4 / 7Unlimited-OCR document exampleA PDF, extracted text and recognized page regions appear side by side.

NVIDIA's SkillSpector scans agent skills before installation. The project describes checks for patterns such as prompt injection, data exfiltration and excessive permissions, across inputs including repositories, archives and files. Berman recommends inspecting skills; a scan can help surface risks but cannot guarantee that a skill is safe.

SkillSpector scan categories
슬라이드 5 / 7SkillSpector scan categoriesThe project lists types of risks its skill scanner looks for.
05

Editing, agents and local voice

Palmier Pro, Hermes and Voicebox round out the list with editing, agent and speech workflows.

Palmier Pro is a Mac video editor that, at the time of the video, connects to agents through MCP and includes generative AI features. Berman demonstrates the idea of directing an agent to work in the editor. He describes macOS as the available platform at the time and hopes for broader support later.

Palmier Pro agent integration
슬라이드 6 / 7Palmier Pro agent integrationThe editor exposes an MCP interface for compatible agents.

Hermes Agent is another agent framework Berman presents as an alternative to OpenClaw. He highlights its emphasis on improvement over repeated use, including the project's stated ability to address failed skills. He recommends trying it while noting that a full review would require a separate video.

Voicebox combines generated speech and transcription, with the option to use local models. The interface shown lets users create and edit speech, use a timeline-style stories editor and apply audio effects. Berman shows a Qwen model and discusses voice cloning; use of a person's voice requires appropriate consent.

Voicebox interface
슬라이드 7 / 7Voicebox interfaceThe demonstration shows a speech-generation interface and editable audio.

같은 채널의 다른 글

슬라이드 6장25:50EN
MBMatthew Berman· 2026년 10월 24일Kimi K3.1 Pro Tested: Strong 3D Demos, Uneven Results and Competitive PricingMatthew Berman · Forward FutureMatthew Berman tests the open-weight model on coding, 3D rendering and visual explanations, then compares benchmark results and prices.Open-weight modelsBenchmarksAI cost & performance+1
슬라이드 2장32:20EN
MBMatthew Berman· 2026년 10월 23일Who Is Local AI For? The Costs, Trade-offs and a Hybrid FutureMatthew Berman · Forward FutureMatthew Berman weighs data control and independence against hardware cost, setup complexity and inference speed.Local inferenceOpen-weight modelsAI cost & performance+1
45:08EN
MBMatthew Berman· 2026년 10월 21일Sam Altman on AI Discovery, Consciousness, Compute and a Human-Centered FutureMatthew Berman, Sam Altman · Forward FutureIn a conversation with Matthew Berman, Altman discusses scientific progress, personal assistants, recursive self-improvement and the importance of human agency.AI for sciencePersonal agentsConsciousness+2
0:32EN
MBMatthew Berman· 2026년 10월 21일Sam Altman on the Continuing Demand for Software WorkSam Altman, Matthew Berman · OpenAIIn a short interview excerpt, Altman says demand for software may be larger than expected even as AI changes how it is made.Future of WorkSoftware engineering코딩 에이전트
슬라이드 5장12:14EN
MBMatthew Berman· 2026년 10월 14일Gemini 4 Argon Tested: 3D Demos, a Spreadsheet Prototype and Benchmark ResultsMatthew Berman · Forward FutureMatthew Berman tests Google’s model on games and visual projects, then compares reported coding and agent benchmarks.GeminiBenchmarks코딩 에이전트+1
슬라이드 5장10:36EN
MBMatthew Berman· 2026년 10월 13일Meta Muse Wonder Tested: Strong Benchmarks, Mixed Demos and Quota FrictionMatthew Berman · Forward FutureMatthew Berman tests Meta’s models on browser demos and reviews their published benchmark scores, availability and cost.모델과 학습BenchmarksAI cost & performance+1