Screen share 17: fluxer-voice LiveKit video, screen audio, codec probe, interop test #164

Closed
opened 2026-11-12 02:06:58 +00:00 by charles · 0 comments
Owner

Files:

  • Modify: crates/fluxer-voice/src/rtc.rs, crates/fluxer-voice/tests/livekit_interop.rs, crates/fluxer-voice/README.md
  • Create: crates/fluxer-voice/assets/codec-probe/* if the decode probe needs sample bitstreams (generated by the test itself if possible)
  • Test: interop (FLUXER_LIVEKIT_TESTS=1) + unit tests in rtc.rs

Interfaces:

  • Produces: LiveKitRoom implements Task 16's methods per spec §7.3 and §8.1: screencast NativeVideoSource, TrackSource::Screenshare, stream: "screen_share", simulcast: false, video_codec, video_encoding, degradation_preference, scalability_mode, video_encoder from EncoderBackend; screen audio stereo 128 kbit/s RED on DTX off; dynacast: true; remote video via NativeVideoStream → fluxer_video::VideoFrame (I420); codec_capabilities() from the probe of spikes §1 (encoders per backend; decoders actually working, H264 only if it decodes); EncoderStats every 2 s from sender stats (codec, implementation name, hardware flag).

  • #125: report RoomEvent::ParticipantJoined once the participant can receive data (the SDK's active point), keeping the ParticipantJoined → TrackPublished order the session relies on.

  • Step 1: Write failing tests (interop, #[ignore] unless FLUXER_LIVEKIT_TESTS=1): screen_share_pattern_arrives_for_each_encodable_codec (frames decode to the pattern counter), screen_audio_tone_arrives_stereo, republish_with_other_codec_reaches_viewer, unsubscribe_stops_video_bytes, advert_reaches_newcomer_after_active (#125); unit publish_options_from_params, probe_never_claims_h264_without_decoder.

  • Step 2–5: FAIL → implement → PASS locally with the server script → commit feat(voice): LiveKit screen share and interop test.

Depends on: Screen share 16 (#163), Screen share 2 (#149)

Plan: https://git.forked.io/charles/fluxer-native/src/branch/main/docs/superpowers/plans/2026-11-11-screenshare.md
Spec: https://git.forked.io/charles/fluxer-native/src/branch/main/docs/superpowers/specs/2026-11-11-fluxer-native-screenshare-design.md

**Files:** - Modify: `crates/fluxer-voice/src/rtc.rs`, `crates/fluxer-voice/tests/livekit_interop.rs`, `crates/fluxer-voice/README.md` - Create: `crates/fluxer-voice/assets/codec-probe/*` if the decode probe needs sample bitstreams (generated by the test itself if possible) - Test: interop (`FLUXER_LIVEKIT_TESTS=1`) + unit tests in `rtc.rs` **Interfaces:** - Produces: `LiveKitRoom` implements Task 16's methods per spec §7.3 and §8.1: screencast `NativeVideoSource`, `TrackSource::Screenshare`, `stream: "screen_share"`, `simulcast: false`, `video_codec`, `video_encoding`, `degradation_preference`, `scalability_mode`, `video_encoder` from `EncoderBackend`; screen audio stereo 128 kbit/s RED on DTX off; `dynacast: true`; remote video via `NativeVideoStream` → `fluxer_video::VideoFrame` (I420); `codec_capabilities()` from the probe of *spikes §1* (encoders per backend; decoders actually working, H264 only if it decodes); `EncoderStats` every 2 s from sender stats (codec, implementation name, hardware flag). - **#125:** report `RoomEvent::ParticipantJoined` once the participant can receive data (the SDK's active point), keeping the `ParticipantJoined` → `TrackPublished` order the session relies on. - [ ] **Step 1: Write failing tests** (interop, `#[ignore]` unless `FLUXER_LIVEKIT_TESTS=1`): `screen_share_pattern_arrives_for_each_encodable_codec` (frames decode to the pattern counter), `screen_audio_tone_arrives_stereo`, `republish_with_other_codec_reaches_viewer`, `unsubscribe_stops_video_bytes`, `advert_reaches_newcomer_after_active` (#125); unit `publish_options_from_params`, `probe_never_claims_h264_without_decoder`. - [ ] **Step 2–5:** FAIL → implement → PASS locally with the server script → commit `feat(voice): LiveKit screen share and interop test`. Depends on: Screen share 16 (#163), Screen share 2 (#149) Plan: https://git.forked.io/charles/fluxer-native/src/branch/main/docs/superpowers/plans/2026-11-11-screenshare.md Spec: https://git.forked.io/charles/fluxer-native/src/branch/main/docs/superpowers/specs/2026-11-11-fluxer-native-screenshare-design.md
charles added this to the Screen share milestone 2026-11-12 02:06:58 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
charles/fluxer-native#164
No description provided.