A 2023 Look at GPT-4 Vision, 3D and Robotics

Early demonstrations across images, speech and physical systems, viewed in their historical context.

Canal
AI Explained
Publicado
26 mar 2023
Vídeo
8:06
Lectura
2 min
Original
inglés
Abrir en YouTube
Al desplazarte, el vídeo se reduce a la esquina inferior derecha y sigue reproduciéndose. Los subtítulos siguen tu idioma de lectura.
Idioma de lecturaDisponible en 2 idiomas
Este artículo aún no está en español, así que se muestra el original en inglés.
RESUMEN

En 30 segundos

A March 2023 video surveys early GPT-4 vision examples and developments in 3D, speech and robotics. Benchmark and medical examples are presented with their limits, and future claims remain predictions.

  1. 1Medical benchmark limitsA research example is not a clinical diagnosis.
  2. 2Visual question answeringThe historical benchmark measures performance on a defined dataset.
  3. 3Text and 3DLanguage instructions are used in 3D creation and search.
  4. 4EmbodimentRobotics demonstrations and investments do not establish general capability.

Conclusiones

  1. Individual demonstrations do not establish reliable general performance.
  2. Medical benchmarks are not clinical validation.
  3. Text, 3D and speech tools were developing in parallel.
  4. Robotics demonstrations do not establish general-purpose autonomy.
  5. The video’s forecasts and comparisons are historical.
TEXTO COMPLETO

Lee el texto editado por capítulos

Solo la transcripción
01

Early vision demonstrations

In March 2023, the presenter surveys early GPT-4 vision demonstrations alongside text-to-3D, speech recognition and robotics. The examples and predictions are historical, not a guide to current product capabilities.

In March 2023, the presenter surveys early GPT-4 vision demonstrations alongside text-to-3D, speech recognition and robotics. The examples and predictions are historical, not a guide to current product capabilities.

He starts with image understanding examples, including reading visual challenges. A few demonstrations cannot establish reliable performance or justify bypassing security controls.

He mentions a medical-image example and a paper evaluating medical questions. The clip says the example did not yield a complete diagnosis; benchmark results are not evidence of clinical reliability or a substitute for medical care.

Other demonstrations involve humor, menus and descriptions for people with visual impairments. The usefulness and risks depend on the actual task, system and user.

02

Reading and benchmarks

The presenter discusses reading text and diagrams in images, using a visual question-answering benchmark as an example. A benchmark is one measurement under a defined dataset and evaluation procedure.

The presenter discusses reading text and diagrams in images, using a visual question-answering benchmark as an example. A benchmark is one measurement under a defined dataset and evaluation procedure.

He compares a historical model score with a human score on that benchmark. The comparison does not establish that a model matches human visual understanding across tasks.

03

3D and speech

The video then looks at language instructions used to create or edit 3D content, including code generation and tools shown by other companies.

The video then looks at language instructions used to create or edit 3D content, including code generation and tools shown by other companies.

A research example embeds language-related information into a reconstructed 3D scene so a user can search for objects or concepts. The presenter also notes imperfect recognition.

The talk turns to speech-to-text tools and a reported benchmark comparison. Results depend on the dataset, language and evaluation conditions.

04

Predictions and robotics

The presenter revisits earlier predictions about AI and professional tasks. Passing a test or producing an answer is distinct from safe, qualified professional practice.

The presenter revisits earlier predictions about AI and professional tasks. Passing a test or producing an answer is distinct from safe, qualified professional practice.

He discusses OpenAI’s earlier robotics research and its investment in 1X as examples of interest in physical systems. Company plans and investment do not establish a robot’s current capabilities.

Other demonstrations show different robot forms and tasks. The presenter sees potential in combining progress across language, vision, audio and physical action, while recognizing that deployment is still difficult.

Más de este canal

3 diapositivas31:00EN
AI Explained· 12 oct 2026Why AI Labs Keep Racing Despite Their Own Warnings of a Major BreachSam Altman, John Schulman · OpenAIAI Explained examines weakening safeguards, the incentives behind the frontier race, and why research breakthroughs make the next 18 months difficult to forecast.AI SafetyAI securityAI Alignment+2
Diapositivas38:28EN
AI Explained· 1 oct 2026AI Agent Security and the Challenge of Recursive Self-ImprovementAI Explained examines reported containment failures, model evaluation and the pressure to accelerate AI research.AI securityAI SafetyAI research+2
5 diapositivas32:54EN
AI Explained· 24 sept 2026Opus 5.5 and the Race Toward Automated AI ResearchAI Explained weighs model progress against the increasingly difficult task of evaluating and governing recursive self-improvement.AI SafetyAI researchSeguridad y gobernanza+2
2 diapositivas24:53EN
AI Explained· 16 sept 2026Why Some Researchers Want to Pace Frontier AIAI Explained surveys possible scaling routes, monitoring concerns and the debate over how capabilities could lead to harm.AI SafetyAI AlignmentSeguridad y gobernanza+1
6 diapositivas29:05EN
AI Explained· 4 sept 2026GPT-6 Astra’s Benchmark Gains and the Challenge of Monitoring Its ReasoningAI Explained examines reported gains across scientific, mathematical and agent benchmarks alongside concerns about less observable reasoning.Modelos y entrenamientoBenchmarksAI Safety
7 diapositivas23:41EN
AI Explained· 27 ago 2026AI Agents, Unintended Training Rewards and the Challenge of OversightAI Explained examines reports on agent coordination, training incentives and the growing use of AI to evaluate other AI systems.AI SafetyIngeniería de agentesModelos y entrenamiento+1