LiteRT v2.1.0rc1

Release 2.1.0rc1

Major Features and Improvements

• NPU: Added support for Qualcomm Snapdragon Gen5
• NPU: Added support for MediaTek Dimensity 9500
• NPU: Added support for NPU JIT mode on Qualcomm and MediaTek

Bug Fixes and Other Changes

• Fixes Android min SDK version to 23.
• NPU: Fixes partition algorithm when the full model cannot be offloaded to NPU.

Breaking Changes

• Removed direct C headers usage. Users no longer need to include C headers.
• TensorBuffer::CreateManaged() requires Environment always.
• All TensorBuffer creation requires Environment except HostMemory types.
• LiteRT C++ constructors are hidden. All LiteRT C++ objects should be created by Create() methods.
• Move internal only C++ APIs(such as litert_logging.h) to litert/cc/internal
• Remove Tensor, Subgraph, Signature access from litert::Model. Instead users can access SimpleTensor, SimpleSignature from CompiledModel.
• The CompiledModel::Create() API no longer needs litert::Model. They can be created from filename, model buffers directly.
• Annotation, Metrics APIs are removed from CompiledModel.
• Removed individual OpaqueOptions creation. These OpaqueOptions objects are obtained by Options directly.
  • Options::GetCpuOptions()
  • Options::GetGpuOptions()
  • Options::GetRuntimeOptions()
  • …