LiteRT v2.1.3

v2.1.3
Added 2
  • Added experimental support for multi-threaded CompiledModel creation
  • Added basic support for Broadcom VideoCore GPUs
Changed 7
  • Updated CMake build rules to support both CompiledModel and Interpreter APIs
  • Expanded MediaTek NPU support to all applicable Android versions by supporting bundling MediaTek libraries in application binary
  • Individual Options APIs (litert/cc/options) no longer use LiteRT C APIs (LiteRtXXX) and are updated to use string based serialization and use LrtXXX() functions which can be linked individually
  • Move the experimental API GetProfiler() out of litert::CompiledModel
  • Updated litert::Event::Type() to return C++ types instead of C types
  • LiteRT headers no longer define OpenCL type names cl_mem and cl_event in the global namespace when OpenCL is not supported, replaced with type aliases LiteRtClMem and LiteRtClEvent in litert/c/litert_opencl_types.h
  • LiteRT headers no longer define WebGPU type names struct WGPUBufferImpl and WGPUBuffer in the global namespace when WebGPU is supported, replaced with type alias LiteRtWGPUBuffer in litert/c/litert_webgpu_types.h
Fixed 2
  • Fixed GPU support for Python on Windows
  • Fixed a bug that given CPU Buffers are not always synced with GPU Accelerator from the second inference
Removed 1
  • Removed methods from litert::Event which uses C type LiteRtEnvironment

From LiteRT

Release 2.1.3

Major Features and Improvements

  • Updated CMake build rules to support both CompiledModel and Interpreter APIs.   cmake_example/CMakeLists.txt shows how you can use both libraries.

  • Expanded MediaTek NPU support to all applicable Android versions   (only Android 15 previously) by supporting bundling MediaTek libraries in   application binary.

  • Added experimental support for multi-threaded CompiledModel creation

  • Fixed GPU support for Python on Windows

  • Individual Options APIs (litert/cc/options) no longer use LiteRT C APIs (LiteRtXXX). They’re updated to use string based serialization and use LrtXXX() functions which can be linked individually.

  • Added basic support for Broadcom VideoCore GPUs.

Bug Fixes and Other Changes

  • Move the experimental API GetProfiler() out of litert::CompiledModel.

  • Fixed a bug that given CPU Buffers are not always synced with GPU Accelerator   from the second inference.

  • Removed methods from litert::Event which uses C type LiteRtEnvironment.   All C++ API should uses C++ litert::Environment instead.   Also removed method CreateFromSyncFenceFd() that doesn't accept   litert::Environment.

  • Updated litert::Event::Type() to return C++ types instead of C types.

  • The LiteRT headers no longer define the following OpenCL type names in the   global namespace when OpenCL is not supported: cl_mem, cl_event.   These have been replaced with the type aliases LiteRtClMem and   LiteRtClEvent, defined in a new header litert/c/litert_opencl_types.h.   All of these symbols that didn't include the LiteRt prefix in their name   were never intended to be part of the LiteRT API, and their presence   in the global namespace risked conflicts with header files from other   packages.

  • Likewise, and for the same reason, the LiteRT headers no longer define the   following WebGPU type names in the global namespace when WebGPU is   supported: struct WGPUBufferImpl, WGPUBuffer. These have been   replaced with the type alias LiteRtWGPUBuffer which is defined in a   new header file litert/c/litert_webgpu_types.h. Alternatively, apps   using these symbols can get them from WebGPU's webgpu.h header file.

  • Added experimental support for multi-threaded CompiledModel creation

View original

Upgraded? How did it go?

Discussion