Cybergarden

Project Snapshot

AR/AI

SwiftUI

Meta Glasses

SAM3

Turn what you see into shareable stickers—powered by AI segmentation through Meta smart glasses.

Meta Stickers connects to Meta Ray-Ban smart glasses and applies real-time AI segmentation to live video streams. Using the Segment Anything Model 3, it identifies and isolates objects instantly, creating augmented reality overlays that transform everyday scenes into creative assets. This project is fully open source on GitHub.

Focus area

Real-time visual AI

We integrated Meta's wearable SDK with fal.ai's SAM3 API for seamless object detection and mask generation directly from glasses video feeds.

Impact

Hands-free creativity

Users can capture, segment, and stylise objects from their point of view without touching their phone—perfect for creators on the move.

Meta Stickers app — AI-powered sticker creation from Meta Ray-Ban smart glasses.

Intelligent Video Processing

Live stream segmentation

From glasses to AI masks in milliseconds.

The app streams video from Meta Ray-Ban glasses at configurable resolutions and frame rates. Each frame is processed through SAM3's API, automatically detecting and isolating objects into clean, shareable stickers.

Live sticker feed showing segmented objects — Real-time sticker generation from your glasses' point of view.

Smart object detection

Tell the AI exactly what to find.

Select from common object types or add custom prompts. The AI recognises phones, laptops, bottles, people, and more—automatically segmenting them from the background.

Object detection prompt selection — Quick-select prompts or define custom objects to detect.

Creative Styling

Style presets

Transform stickers with one tap.

Apply visual styles to your segmented objects. Choose from Default, Outlined, Smooth Edge, Cartoon, Minimal, Glossy, or Vintage presets to match your creative vision.

Sticker style presets — Seven style presets transform raw segments into polished stickers.

Sticker library

Organise, share, and manage your creations.

Every sticker is saved with its detection prompt and timestamp. Add tags for organisation, share directly to other apps, or delete stickers you no longer need.

Sticker details and sharing options — Full sticker details with instant sharing capabilities.

System Architecture

Segmentation pipeline

From glasses to sticker in a single flow.

Loading diagram...

Technology stack

Purpose-built for wearable AI.

Swift and SwiftUI for native iOS performance and modern declarative UI.
Meta MWDAT SDK manages Bluetooth pairing and video streaming from Ray-Ban smart glasses.
fal.ai hosts the SAM3 model, providing fast inference without on-device ML overhead.
Xcode 16+ build tooling ensures compatibility with the latest iOS features.

What's Next

The roadmap includes advanced sticker generation styles, social sharing mechanisms, and refined selection tools that let users edit masks before export. Each update moves Meta Stickers closer to becoming the go-to creative companion for smart glasses wearers.

Interested in building AR experiences or integrating wearable devices with AI services? We specialise in bridging cutting-edge hardware with intelligent software.