CameraX: Capture in Any Scenario

▶ Watch (3:16)

CameraX 1.5 introduces DNG capture for uncompressed raw images and high frame rate support for slow-motion video. The feature group API checks device support for HLG10 HDR, 60fps, preview stabilization, and ultra HDR simultaneously. Low light boost brightens previews and recordings with a single API call. Instagram adopted it for night captures. Adaptive preview with CameraX viewfinder handles foldables and tablets. Picture-in-picture integration with the Jetpack library enables multitasking while recording. Motion photo capture arrives later this year.

Media3 Transformer and CodecDB

▶ Watch (8:20)

Media3 Transformer now supports multi-asset editing: concatenation, overlays, and simultaneous playback. The Effects API applies video and audio transformations per item. Composition player previews edits before export. Faster trimming uses edit list metadata to avoid re-encoding. New input format Android professional video gives professional-grade control. The Media3 muxer replaces the platform muxer for consistent behavior across devices. Adobe Premiere uses Transformer as its editing foundation on Android. CodecDB provides data-driven encoder recommendations per chipset. The example shows sharper lines and reduced blurriness in video encoding.

On-Device AI-Powered Effects

▶ Watch (12:42)

New on-device AI models include image and video enhance (tone mapping, denoising, deblurring, super resolution), magic eraser for object removal, and studio sound for separating speech, music, and noise. These are delivered through a Media3 AI effects library that abstracts software, platform, and hardware implementations. Instagram partnered to test image enhance. Studio sound demo showed clearer audio in a crying baby video. The library dynamically picks the best implementation per device.

ExoPlayer: Efficient and Reliable Playback

▶ Watch (16:12)

ExoPlayer adds scrubbing mode for smoother seeking with configurable tolerance. New Compose UI components include player surface, playback controls, progress indicator, and material 3 styled modules. Enhanced preload manager improves caching for faster startup. Cast player enables seamless local-to-cast transitions. Ecliptor HDR video format launches on Android with ExoPlayer support out of the box. PCM offload saves up to 25% battery for audio-only screen-off playback.

Notable Quotes

Camera X abstracts away the complexities of the underlying camera hardware, providing a consistent and powerful API surface. Kailiang Chen · ▶ Watch (3:31)

Instagram recently added support for low light boost to help users capture memories at night with as much authentic detail as possible. Kailiang Chen · ▶ Watch (5:22)

Ecliptor video is launching on Android. Kailiang Chen · ▶ Watch (19:08)

Enabling PCM offload can result in up to 25% battery savings based on our lab testing data. Kailiang Chen · ▶ Watch (20:08)

Key Takeaways

  • CameraX 1.5 delivers DNG capture, high frame rate, low light boost, and a feature group API for device compatibility.
  • Media3 Transformer supports multi-asset editing with Effects API and CodecDB for optimal encoder settings per chipset.
  • ExoPlayer adds scrubbing mode, HDR Ecliptor support, and PCM offload for up to 25% battery savings.