MLOps 3D Scene Reconstruction
MLOps 3D Scene Reconstruction is a production-grade AI system that recovers the 3D structure of real-world environments from a collection of multi-view images. Given a set of photos captured from different angles, the system estimates each camera’s rotation matrix R and translation vector t with high accuracy, and renders an interactive 3D point cloud.
The system is built on top of state-of-the-art foundation models (MASt3R, DUSt3R), orchestrated through a full MLOps stack comprising DVC, MLflow, Airflow, Prometheus, Grafana, and Docker.
Model Pipeline Overview
The end-to-end pipeline transforms a ZIP archive of images into a navigable 3D point cloud:
┌─────────────┐ ┌──────────────┐ ┌────────────┐ ┌──────────────┐ ┌──────────┐
│ Image ZIP │ → │ Preprocessing│ → │ Matching │ → │ Triangulation│ → │ 3D Model │
│ (Upload) │ │ + Filtering │ │ (MASt3R) │ │ (COLMAP) │ │ (.ply) │
└─────────────┘ └──────────────┘ └────────────┘ └──────────────┘ └──────────┘
Each stage is tracked via MLflow, versioned with DVC, and monitored with Prometheus.
Downstream Applications
Augmented and Virtual Reality (AR/VR)
Robotics and Autonomous Driving
Cultural Heritage Digitization
Surveying and Topography
Documentation
Getting Started
User Interface
- UI Guide
- Overview of the Interface
- Step 1 — Logging In
- Step 2 — The Header
- Step 3 — The Upload Panel (Left Panel, Top)
- Step 4 — The Stage Tracker (Left Panel, Middle)
- Step 5 — The 3D Model Viewer (Right Panel)
- Step 6 — The Stats Table (Bottom Panel)
- Step 7 — Downloading Results
- Step 8 — Starting a New Reconstruction
- Drift Warning Banner
- Error States
- Frequently Asked Questions (UI)
System Reference
- System Architecture
- Pipeline Documentation
- Pipeline Overview
- Stage 1 — Data Validation
- Stage 2 — Exploratory Data Analysis and Baselines
- Stage 3 — Image Preprocessing
- Stage 4 — Data Preparation
- Stage 5 — Scene Reconstruction (Core Pipeline)
- Stage 6 — Evaluation
- Online Inference Pipeline
- Model Selection and Promotion
- Drift Monitoring and Retraining
- API Reference
MLOps & Operations
Project Context
Quick Links
Frontend UI: http://localhost:5173
API Gateway: http://localhost:8000
MLflow UI: http://localhost:5000
Airflow UI: http://localhost:8080
Grafana Dashboard: http://localhost:3001
Prometheus: http://localhost:9090