The Stack

Our Hybrid Builder connects physical cardboard blocks construction to Minecraft through multiple Microsoft cloud services working in concert:

Core Services

Azure Functions – Event orchestration layer handling motion detection, snapshot triggers, and workflow coordination.

Azure Blob Storage – Durable image storage with timestamped snapshots and SAS token security.

Azure OpenAI (GPT-4o Vision) – Computer vision intelligence analyzing image pairs to detect new blocks and extract coordinates.

Dataverse – Business data persistence for build events, orders, and audit trails.

Power Platform – Retrieves image pairs from Blob Storage, creates Dataverse records with images, calls OpenAI Vision API for block detection, and triggers MCP server for Minecraft block placement.

The Flow

micro:bit motion → Azure Function → Blob Storage → Power Automate 
→ GPT-4o Vision diff → MCP Server → Minecraft
    ↓
Dataverse (event log)

Integration Highlights

• Functions trigger snapshot capture via webhook to local camera server
• Blob Storage maintains before/after image pairs with secure access
• OpenAI Vision performs diff analysis between images
• Dataverse logs autonomous AI decisions for audit trail
• Power Automate orchestrates the vision analysis workflow via cloud connectors
• MCP Server receives build instructions via HTTP API

Each service communicates via REST APIs, with Functions acting as the central orchestrator. The result: physical blocks appear in Minecraft within 10-15 seconds.