Scene-SAM3D

Seeing More of the Whole via View Selection and Conflict-Aware Fusion

Method

Pipeline Overview

Training-free multi-view fusion: complementary view selection, latent velocity fusion in canonical space, and lightweight scene-layout optimization.

1 / 1
Comparison

Qualitative Comparisons

Compare reconstruction quality at both the individual-instance and complete-scene levels. Choose any two methods and rotate the synchronized 3D viewers to inspect their differences.

01

Instance-Level Comparison

Shape and appearance quality for individually reconstructed objects.

LEFT
Loading 3D model…
Drag to rotate · Scroll to zoom
RIGHT
Loading 3D model…
Drag to rotate · Scroll to zoom
02

Scene-Level Comparison

Composition, relative pose, and overall consistency of reconstructed scenes.

LEFT
Loading 3D model…
Drag to rotate · Scroll to zoom
RIGHT
Loading 3D model…
Drag to rotate · Scroll to zoom
03

Fine-grained Scene Decomposition Generation

Independently generated instances, assembled into an optimized scene layout.

01 Individual instances

Original generations · Drag each part to inspect

Parts are shown at individual viewing scales.

02 rigid-object gaussian layout refinement

Separated parts → Shared scene layout

Separated parts

Loading assembly…

Drag to rotate · Scroll to zoom
0%

The animation brings the optimized instances into their shared layout; the final frame preserves their optimized relative positions and scales.

04

Zip-NeRF Scenes

Scene reconstruction from real-world observations.

Scene Reference Images Click any image to enlarge
Zip-NeRF scene reference: kitchen counters, cabinets, and cookware
Reference 01
Zip-NeRF scene reference: dining table, chairs, shelves, and windows
Reference 02
Zip-NeRF scene reference: tall cabinets, drawers, and hallway
Reference 03
Zip-NeRF scene reference: cabinets, bookcase, and storage area
Reference 04
Scene-SAM3D (Ours) Reconstructed scene and detail views
Our reconstructed table and chairs with detailed tabletop objects
Table and chairs
Our reconstructed trolley with cookware and kitchen appliances
Trolley
Our reconstructed Zip-NeRF scene viewed from above
Scene overview