Camera: background blur and custom backgrounds #993

Open
opened 2026-11-20 05:42:41 +00:00 by charles · 0 comments
Owner

The original's "Camera preview" has a Background row ("Background", "Change background", "Blur strength") and stores backgroundImageId, backgroundImages, backgroundBlurStrength (Camera spec §3 rows 10 and 20, §15). Not built by sub-project 5.

What it needs (spec §15): MediaPipe selfie segmentation (selfie_segmentation_256x256.onnx, Apache-2.0) on the ONNX runtime the Kokoro TTS work brings (sub-project 7), the model as a bundled or downloaded asset, a mask-refine and composite step between capture and the bus (CPU first, a wgpu pass later), animated backgrounds through fluxer-media-playback, the gallery (BackgroundImageGalleryModal.tsx; limits 1 / 15 custom backgrounds, 10 MiB, jpeg/png/gif/webp/mp4/webm) and a local media cache. The seam exists: the FrameFilter slot in apps/fluxer/src/camera_rt.rs (Camera 12).

Found while writing docs/parity/camera.md (Camera 20, #971), on camera at 21e9c4264.

The original's "Camera preview" has a Background row ("Background", "Change background", "Blur strength") and stores `backgroundImageId`, `backgroundImages`, `backgroundBlurStrength` (Camera spec §3 rows 10 and 20, §15). Not built by sub-project 5. What it needs (spec §15): MediaPipe selfie segmentation (`selfie_segmentation_256x256.onnx`, Apache-2.0) on the ONNX runtime the Kokoro TTS work brings (sub-project 7), the model as a bundled or downloaded asset, a mask-refine and composite step between capture and the bus (CPU first, a wgpu pass later), animated backgrounds through `fluxer-media-playback`, the gallery (`BackgroundImageGalleryModal.tsx`; limits 1 / 15 custom backgrounds, 10 MiB, jpeg/png/gif/webp/mp4/webm) and a local media cache. The seam exists: the `FrameFilter` slot in `apps/fluxer/src/camera_rt.rs` (Camera 12). Found while writing `docs/parity/camera.md` (Camera 20, #971), on `camera` at 21e9c4264.
charles added this to the Camera milestone 2026-11-20 05:42:41 +00:00
charles referenced this issue from a commit 2026-11-20 06:30:04 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
charles/fluxer-native#993
No description provided.