v1.2.0
MediaPipe v1.2.0
Added 8
- Support Web Worker platform detection and Flutter Web telemetry overrides
- Add support for F16 formats in ImageFrame
- Expose the remaining MlDriftDelegateOptions in InferenceCalculatorOptions
- Enable F16 cv::Mat support in OpenCV conversions
- Add MediaPipe Tasks Android Kotlin TextToSpeech SDK and JNI bridge
- Add LiteRT service support to InteractiveSegmenter on Android
- Open source the MediaPipe text proofreader and summarizer tasks on iOS
- Add Apple Privacy Manifest (PrivacyInfo.xcprivacy) to MediaPipe Tasks iOS Swift Package Manager package
Changed 5
- Run face blendshapes on CPU when using the GPU delegate
- Optimize Parakeet ASR streaming latency and decoder/runtime performance
- Replace status_macros.h includes with absl/status/status_macros.h in mediapipe/framework, mediapipe/calculators, and remaining mediapipe tasks, modules, and utilities
- Upgrade OpenCV to 4.10
- Return topK distinct documents from SemanticRetriever when results are chunked on Android
Fixed 4
- Fix GPU memory leaks when releasing AHWB-backed SSBOs and pooled textures
- Fix nullptr exception in ImageToTensorCalculator
- Fix MediaPipe Tasks telemetry fields and audio_classifier.h license
- Prevent possible lock-order-inversion deadlocks when locking input tensors in InferenceRunnerLiteRt
From MediaPipe
Bazel changes
- Bump MediaPipe version to 1.2.0
- Support Web Worker platform detection and Flutter Web telemetry overrides.
- Rollback due to breakage in gmscore.build.
- Fix GPU memory leaks when releasing AHWB-backed SSBOs and pooled textures.
- Fix nullptr exception in ImageToTensorCalculator
- Add support for F16 formats in ImageFrame
- Fix MediaPipe Tasks telemetry fields and audio_classifier.h license.
- Prevent possible lock-order-inversion deadlocks when locking input tensors in InferenceRunnerLiteRt
- Expose the remaining MlDriftDelegateOptions in InferenceCalculatorOptions
- Run face blendshapes on CPU when using the GPU delegate.
- Optimize Parakeet ASR streaming latency and decoder/runtime performance.
- Replace status_macros.h includes with absl/status/status_macros.h in mediapipe/framework
- Replace status_macros.h includes with absl/status/status_macros.h in mediapipe/calculators
- Replace status_macros.h includes with absl/status/status_macros.h in remaining mediapipe tasks, modules, and utilities
- Upgrade OpenCV to 4.10
- Enable F16 cv::Mat support in OpenCV conversions. OpenCV 4 was enabled in a previous CL.
- Update SPM files for 1.2.0
MediaPipe Tasks update
This section should highlight the changes that are done specifically for any platform and don't propagate to other platforms.
Android
- Add MediaPipe Tasks Android Kotlin TextToSpeech SDK and JNI bridge.
- Add LiteRT service support to InteractiveSegmenter on Android.
- Return topK distinct documents from SemanticRetriever when results are chunked.
iOS
- Open source the MediaPipe text proofreader and summarizer tasks.
- Add Apple Privacy Manifest (
PrivacyInfo.xcprivacy) to MediaPipe Tasks iOS Swift Package Manager package.
MediaPipe Dependencies
- Update WASM files for 1.2.0 release
- Update genai wasm