LiteReality-Agent

Look into a reconstruction

Live in the browser — orbit the scene, isolate groups, compare render against the real capture, or walk through it in first person.

open full viewer ↗

The scanner app

LiteReality

Our iOS LiDAR room scanner. Walk a room with an iPhone or iPad and it exports one bundle — posed RGB frames, LiDAR depth, ARKit camera poses and the RoomPlan layout — everything the pipeline needs.

Get the app

iOS · iPadOS (LiDAR) — on the App Store

How it works

A deterministic pass rebuilds the empty room from the scan. Then the agent authors it — editing code, rendering, comparing against the capture — until quality control passes.

input

Scan

Posed RGB and LiDAR from the iOS app.

deterministic

Initialize

Walls, openings and cameras rebuilt into a blank room.

agentic loop

Author

The agent edits Room.py, refining against the capture.

gate

QC

Automatic checks before the scene ships.

output

Scene

Realistic, interactive, articulated.

The workspace is Room.py

Geometry, materials and articulation are one Python program. The agent edits lines of code, never raw meshes — so every change is legible, replayable, and exports straight to Blender, glTF or a simulator.

The authoring loop

edit→ render→ compare→ critique↻

render_and_compareselect_viewgrid fetch_materialscriticcompile bashglobreadedit

Applications

Because the scene is a program, a plain-English request becomes a code edit. Every clip below is the same authored office.

Text-based editing

Retexture walls and floors from a typed request — exposed brick, walnut panelling, sage-green paint. The geometry never moves.

Rearrangement

Re-lay out the room from a prompt while keeping everything grounded and collision-free. Nothing is deleted.

Decoration

The agent fetches real assets and writes procedural geometry — pendant lamps, banners, a party setup — all placed clear of the door swing.

Intrinsics

A fully authored scene renders perfect intrinsics for free: pixel-exact segmentation, depth, normals and albedo, from the same cameras.

Gallery

Every reconstruction, walkable in the browser. Click a scene to step inside.

Related work

Articraft ↗

A coding agent writes programs against an LLM-friendly SDK to generate simulation-ready articulated assets from text.

LiteReality ↗

The original pipeline turning casual phone scans into graphics-ready articulated scenes — the foundation this extends.

Citation

@article{huang2026litereality-agent,
  title   = {{LiteReality-Agent}: An Agentic System for
             Interactable 3D Indoor Scene Reconstruction},
  author  = {Huang, Zhening and Li, Yueyan and Chiu, Johnathan and
             Lyu, Xiaoyang and Zhou, Matt and Yao, Yuxin and
             Lasenby, Joan and Wu, Shangzhe},
  year    = {2026}
}