Turning Images into 3D Models with Meta SAM 3D

Matthew Berman starts with an image of Spike from Brawl Stars, converts it into a 3D model using Meta's SAM 3D, and prints the result. He suggests potential uses in games and visual effects as well as printing. Meta partnered with him on this video, a relationship he discloses.

In the SAM Playground, Berman chooses the 3D scene tool and selects a speaker in a sample image. The interface highlights the object and generates a 3D representation. When selecting a record player, the initial mask misses the transparent lid, so he adds the missing region before generating again.

The download dialog offers PLY and GLB formats. Berman says he downloaded GLB and converted it to STL for 3D printing; the exported object can also be edited in a 3D application such as Blender. A printable result may need checks for scale, mesh integrity, supports, and other print-specific requirements.

The interface also allows users to move, rotate, scale, and regenerate objects and apply effects or visual styles. Berman shows examples such as shimmer, gold, toon shading, and environmental filters. These effects are demonstrations, and their usefulness depends on the intended output format and workflow.

Next he uses the 3D body tool on a photo of two people practicing jiu-jitsu. The interface detects both people and estimates their body structures and poses; he shows how to select or remove one person. The bodies overlap, so the reconstruction of hidden parts is an estimate rather than a verified measurement.

Berman tries a building and a game character, refining the selection when a small accessory is missed. The generated character looks convincing from the front, but he observes that the back is imperfect because it was not visible in the source image. A single view leaves many possible unseen shapes, so the result should be inspected and edited for the intended use.

He closes by emphasizing the low barrier to experimentation and says the models and tools are open and free in the context shown. Model licenses, hardware requirements, service availability, and rights to source images should be checked for a particular use.