LiteRT v2.1.0rc1

v2.1.0rc1Pre-release
Added 3
  • Added support for Qualcomm Snapdragon Gen5 NPU
  • Added support for MediaTek Dimensity 9500 NPU
  • Added NPU JIT mode support on Qualcomm and MediaTek
Changed 4
  • TensorBuffer::CreateManaged() now requires Environment always
  • All TensorBuffer creation requires Environment except HostMemory types
  • Moved internal only C++ APIs such as litert_logging.h to litert/cc/internal
  • CompiledModel::Create() API no longer requires litert::Model and can be created from filename or model buffers directly
Fixed 2
  • Fixed Android min SDK version to 23
  • Fixed NPU partition algorithm when the full model cannot be offloaded to NPU
Removed 5
  • Removed direct C headers usage
  • Hidden LiteRT C++ constructors; all LiteRT C++ objects must be created by Create() methods
  • Removed Tensor, Subgraph, Signature access from litert::Model; users can access SimpleTensor and SimpleSignature from CompiledModel instead
  • Removed Annotation and Metrics APIs from CompiledModel
  • Removed individual OpaqueOptions creation; OpaqueOptions objects are obtained directly via Options methods

From LiteRT

Release 2.1.0rc1

Major Features and Improvements
  • NPU: Added support for Qualcomm Snapdragon Gen5
  • NPU: Added support for MediaTek Dimensity 9500
  • NPU: Added support for NPU JIT mode on Qualcomm and MediaTek
Bug Fixes and Other Changes
  • Fixes Android min SDK version to 23.
  • NPU: Fixes partition algorithm when the full model cannot be offloaded to NPU.
Breaking Changes
  • Removed direct C headers usage. Users no longer need to include C headers.
  • TensorBuffer::CreateManaged() requires Environment always.
  • All TensorBuffer creation requires Environment except HostMemory types.
  • LiteRT C++ constructors are hidden. All LiteRT C++ objects should be created by Create() methods.
  • Move internal only C++ APIs(such as litert_logging.h) to litert/cc/internal
  • Remove Tensor, Subgraph, Signature access from litert::Model. Instead users can access SimpleTensor, SimpleSignature from CompiledModel.
  • The CompiledModel::Create() API no longer needs litert::Model. They can be created from filename, model buffers directly.
  • Annotation, Metrics APIs are removed from CompiledModel.
  • Removed individual OpaqueOptions creation. These OpaqueOptions objects are obtained by Options directly.
    • Options::GetCpuOptions()
    • Options::GetGpuOptions()
    • Options::GetRuntimeOptions()
    • …
View original

Upgraded? How did it go?

Discussion