开始使用

TFLite 模型导出用于部署(已弃用)

已弃用 — 现由 LiteRT 取代

自 Ultralytics 8.4.83 起,独立的 tflite 导出格式已弃用,并由统一的 Google LiteRT 格式取代。LiteRT(Lite Runtime)是 TensorFlow Lite 的新一代版本和新名称,并会导出相同的 .tflite 模型,现在可通过一种格式支持移动设备、嵌入式设备、边缘设备和浏览器部署。

format="tflite" 仍可使用,但会发出弃用警告,并改为导出 LiteRT 模型。今后请使用 format="litert";如需查看当前的导出说明和选项,请参阅 LiteRT 导出指南。

TensorFlow Lite edge deployment framework

在边缘设备或嵌入式设备上部署计算机视觉模型,需要使用专为高效设备端推理而设计的格式。

此前的 TensorFlow Lite 或 TFLite 导出格式可优化 Ultralytics YOLO26 模型,以便在边缘应用中执行目标检测和图像分类等任务。本指南保留了旧版 TFLite 部署相关内容;新导出请使用 LiteRT。

为什么使用 TFLite 导出?#

TensorFlow Lite(简称 TFLite)由 Google 于 2017 年 5 月作为 TensorFlow 框架的一部分推出,是一种开源深度学习框架,专为设备端推理而设计,也称为边缘计算。它为开发者提供了工具,可在移动设备、嵌入式设备和物联网设备以及传统计算机上运行训练好的模型。

TensorFlow Lite 支持多种平台,包括嵌入式 Linux、Android、iOS 和微控制器(MCU)。TFLite 导出模型可让应用在本地离线运行。

TFLite 模型的主要功能#

TFLite 模型具备多种关键功能,可帮助开发者在移动设备、嵌入式设备和边缘设备上运行模型,从而实现设备端机器学习:

  • 设备端优化:TFLite 针对设备端机器学习进行了优化,通过本地处理数据来降低延迟,避免传输个人数据以增强隐私保护,并缩小模型体积以节省空间。

  • 支持多种平台:TFLite 具有广泛的平台兼容性,支持 Android、iOS、嵌入式 Linux 和微控制器。

  • 支持多种语言:TFLite 兼容多种编程语言,包括 Java、Swift、Objective-C、C++ 和 Python。

  • 高性能:利用硬件加速和模型优化实现快速推理。

实测性能(历史数据)#

迁移前后记录(已冻结)

这些结果是在 Android 16/API 36 上,使用 Ultralytics Flutter 插件 0.6.8 和 LiteRT 2.1.5 测得的,测试设备为配备 12 GB LPDDR5X 内存的 Xiaomi 17。其 3 nm Snapdragon 8 Elite Gen 5(SM8850)搭载 8 核 Qualcomm Oryon CPU(2 个 Prime 核心,最高 4.6 GHz;6 个 Performance 核心,最高 3.62 GHz)、Adreno GPU 和 Hexagon NPU。这些表格比较了旧版 onnx2tf INT8 TFLite 资源与迁移期间评估的候选 litert-torch 导出模型。随后,发布资源已被标准化导出模型覆盖,因此这些数字并不代表当前 v0.7.0 资源文件的字节内容。当前测量结果请参阅 LiteRT 性能表。

两种格式均在同一轮连续 GPU 测试中以所示输入尺寸运行。每个单元格显示总耗时 (预处理 + 推理 + 后处理),下方列出了各阶段的耗时明细;原生日志确认,两种格式都通过 LiteRT OpenCL(LITERT_CL)将完整计算图交由 Adreno GPU 执行。

模型任务尺寸
(像素)
旧版
onnx2tf INT8 TFLite
(毫秒)
候选
w8a32 LiteRT
(毫秒)
YOLO26n检测64014.0
1.8 / 8.1 / 4.2
13.5
1.9 / 8.1 / 3.5
YOLO26n-seg分割64030.1
1.9 / 20.3 / 8.0
28.6
1.8 / 20.1 / 6.7
YOLO26n-sem语义64026.4
1.9 / 16.4 / 8.1
32.9
1.8 / 23.0 / 8.2
YOLO26n-cls分类2243.5
0.9 / 2.2 / 0.4
3.2
1.0 / 2.2 / 0.1
YOLO26n-pose姿态64017.4
2.4 / 9.9 / 5.1
14.0
1.9 / 9.3 / 2.8
YOLO26n-obbOBB64013.9
3.0 / 8.3 / 2.7
13.0
2.9 / 7.9 / 2.3

同一迁移过程还比较了 YOLO26n 检测模型的量化格式。推理时间是可比较且取决于格式的指标:

Android 格式GPU 推理(毫秒)GPU 编译
onnx2tf INT8(旧版 TFLite)8.6是
LiteRT w8a32(候选)8.4是
LiteRT INT8(quantize=8)11.0是
LiteRT FP328.8是
LiteRT w8a16(quantize="w8a16")CPU 回退否

在本次测试中,w8a16 回退到 CPU 执行,总耗时约 660 毫秒;GPU 格式的耗时约为 17 毫秒。这些结果促使我们发布 w8a32,但委托兼容性和性能取决于设备及运行时版本。请在目标设备上进行基准测试,并在运行时日志中确认加速器的执行位置。

TFLite 部署选项#

在介绍 LiteRT 替代格式的导出示例之前,先来看看 TFLite 模型的典型用法。

TFLite 为机器学习模型提供多种设备端部署选项,包括:

  • 使用 Android 和 iOS 部署:搭载 TFLite 的 Android 和 iOS 应用都可以分析边缘摄像头画面和传感器数据,以检测和识别物体。TFLite 还提供使用 Swift 和 Objective-C 编写的原生 iOS 库。下方的架构图展示了如何使用 TensorFlow Lite 将训练好的模型部署到 Android 和 iOS 平台。

TensorFlow Lite deployment architecture for mobile

  • 在嵌入式 Linux 上部署:如果在 Raspberry Pi 上运行推理无法满足你的用例对速度的要求,可以使用导出的 TFLite 模型来加速推理。此外,还可以通过使用 Coral Edge TPU 设备进一步提升性能。

  • 在微控制器上部署:TFLite 模型还可部署到微控制器及其他内存仅有几 KB 的设备上。核心运行时在 Arm Cortex M3 上仅占用 16 KB 空间,并可运行许多基础模型。它不需要操作系统支持、任何标准 C 或 C++ 库,也不需要动态内存分配。

用 LiteRT 替代 TFLite 导出#

新导出请将模型转换为 LiteRT 格式。生成的模型仍使用 .tflite 文件扩展名。

安装#

运行以下命令安装所需的软件包:

安装
# Install the required package for YOLO26
pip install ultralytics

有关安装流程的详细说明和最佳实践,请查看我们的 Ultralytics 安装指南。安装 YOLO26 所需的软件包时,如果遇到困难,请查阅我们的常见问题指南,获取解决方案和建议。

用法#

所有 Ultralytics YOLO26 模型均支持开箱即用的导出,便于你将模型集成到首选的部署工作流中。你可以查看支持的导出格式和配置选项的完整列表,为你的应用选择最佳配置。

替代用的 LiteRT 格式支持 导出、预测和验证模式。导出模型后,加载导出的 .tflite 模型即可运行推理或验证其精度。

导出
from ultralytics import YOLO

# 加载 YOLO26 模型
model = YOLO("yolo26n.pt")

# 将模型导出为 LiteRT 格式
model.export(format="litert", imgsz=640)  # 分类任务使用 imgsz=224
预测
from ultralytics import YOLO

# 加载导出的 TFLite 模型
model = YOLO("yolo26n.tflite")

# 运行推理
results = model("https://ultralytics.com/images/bus.jpg")
验证
from ultralytics import YOLO

# 加载导出的 TFLite 模型
model = YOLO("yolo26n.tflite")

# 在 COCO8 数据集上验证准确率
metrics = model.val(data="coco8.yaml")

导出参数#

请参阅 LiteRT 导出参数。有关导出流程的更多详情,请访问 Ultralytics 导出文档页面。

部署导出的 YOLO26 TFLite 模型#

将 Ultralytics YOLO26 模型导出为 LiteRT 格式后,就可以部署生成的 .tflite 模型。运行 TFLite 模型的首选且推荐的第一步,是使用 YOLO("model.tflite") 方法,具体如前面的用法代码片段所示。如需了解在其他各种环境中部署 TFLite 模型的详细说明,请参阅以下资源:

  • Android:Android 应用集成 TensorFlow Lite 的快速入门指南,提供简单易懂的步骤,帮助你设置并运行机器学习模型。

  • iOS:面向开发者的指南,介绍如何在 iOS 应用中集成和部署 TensorFlow Lite 模型,并提供分步说明和相关资源。

  • 端到端示例:此页面概述了各种 TensorFlow Lite 示例,展示了实用应用和教程,旨在帮助开发者在移动设备和边缘设备的机器学习项目中实现 TensorFlow Lite。

总结#

本指南保留了旧版 TFLite 部署工作流程。新导出请使用 LiteRT,为边缘计算环境创建 .tflite 模型。

如需了解更多使用详情,请访问 TFLite 官方文档。

常见问题#

  • 新导出请使用 LiteRT 格式。首先,使用以下命令安装所需软件包:

    pip install ultralytics

    然后,使用以下代码片段导出模型:

    from ultralytics import YOLO
    
    # 加载 YOLO26 模型
    model = YOLO("yolo26n.pt")
    
    # 将模型导出为 LiteRT 格式
    model.export(format="litert", imgsz=640)  # 分类任务使用 imgsz=224

    CLI 用户可以使用以下命令完成操作:

    yolo export model=yolo26n.pt format=litert imgsz=640 # use imgsz=224 for classification

    如需了解更多详情,请访问 Ultralytics 导出指南。

  • TensorFlow Lite(TFLite)是一种开源深度学习框架,专为设备端推理而设计,因此非常适合在移动设备、嵌入式设备和物联网设备上部署 YOLO26 模型。主要优势包括:

    • 设备端优化:通过在本地处理数据来降低延迟并增强隐私保护。
    • 平台兼容性:支持 Android、iOS、嵌入式 Linux 和 MCU。
    • 性能:利用硬件加速优化模型的速度和效率。

    如需了解更多信息,请参阅 TFLite 指南。

  • 可以,你可以在 Raspberry Pi 上运行 YOLO26 TFLite 模型来提升推理速度。首先,按照上文说明将模型导出为 LiteRT 格式。然后,在 Raspberry Pi 上通过 YOLO("yolo26n.tflite") 或 LiteRT 解释器运行 .tflite 模型。

    Coral Edge TPU 可以进一步加速推理。

  • TFLite 支持在资源有限的微控制器上部署:其核心运行时在 Arm Cortex M3 上仅需 16 KB 内存,并可运行许多基础模型。不过,YOLO26 模型通常对于典型微控制器的内存容量来说过大,因此单板计算机、移动设备或专用加速器更适合运行 YOLO26。

    如需开始使用,请访问 TFLite Micro 微控制器指南。

  • TensorFlow Lite 具有广泛的平台兼容性,因此你可以在多种设备上部署 YOLO26 模型,包括:

    • Android 和 iOS:通过 TFLite Android 和 iOS 库提供原生支持。
    • 嵌入式 Linux:适用于 Raspberry Pi 等单板计算机。
    • 微控制器:适用于资源受限的 MCU。

    如需详细了解部署选项,请参阅我们的部署指南。

  • 如果将 YOLO26 模型导出到 LiteRT 时遇到错误,常见的解决方法包括:

    • 检查软件包兼容性:确保使用兼容版本的 Ultralytics、litert-torch 和 ai-edge-litert。请参阅我们的安装指南。
    • 模型支持:请查阅 Ultralytics 导出文档页面,确认相应的 YOLO26 模型支持导出为 LiteRT 格式。
    • 量化问题:使用 INT8 量化时,请确保在 data 参数中正确指定数据集路径。

    如需了解更多故障排除技巧,请访问我们的常见问题指南。

评论115

提出问题、分享结果,或帮助其他人。

  1. saleha-fatimaGitHub(已编辑)

    hi there @glenn-jocher I am trying to convert the the yolov10 model to int8 with tflite format. but same error is occurring again and again. I've tried the solutions described in this thread but nothing seems to work. I am using this for conversion:

    ` from ultralytics import YOLO

    model = YOLO("current_best4.pt")

    model.export(format="tflite", int8=True, data='./datasets/data.yaml', imgsz=640) # creates 'yolov8n_float32.tflite'

    tflite_model = YOLO("yolov8n_int8.tflite")

    results = tflite_model("./frame_365.jpg")

    results.show() `

    and the error i am receiving is this:

    ValueError: Exception encountered when calling layer "tf.math.add_5" (type TFOpLambda).

    Dimensions must be equal, but are 32 and 16 for '{{node tf.math.add_5/Add}} = AddV2 [T=DT_FLOAT](Placeholder, Placeholder_1)' with input shapes: [1,80,160,32], [1,80,160,16].

    Call arguments received by layer "tf.math.add_5" (type TFOpLambda): • x=tf.Tensor(shape=(1, 80, 160, 32), dtype=float32) • y=tf.Tensor(shape=(1, 80, 160, 16), dtype=float32) • name='/model.2/m.0/Add'

    ERROR: input_onnx_file_path: weights/yolov10n.onnx ERROR: onnx_op_name: /model.2/m.0/Add ERROR: Read this and deal with it. https://github.com/PINTO0309/onnx2tf#parameter-replacement ERROR: Alternatively, if the input OP has a dynamic dimension, use the -b or -ois option to rewrite it to a static shape and try again. ERROR: If the input OP of ONNX before conversion is NHWC or an irregular channel arrangement other than NCHW, use the -kt or -kat option. ERROR: Also, for models that include NonMaxSuppression in the post-processing, try the -onwdt option. `

    i

    I have approx 5k images for calibration, so thats not the issue, all the packages are upto date as well. can you please suggest what solution should i opt for?

    1
    1. Glenn JocherUltralytics(已编辑)

      @saleha-fatima the error appears to be related to shape mismatches during ONNX to TFLite conversion. Please ensure that your model, dataset, and TensorFlow versions are fully compatible. Refer to the onnx2tf parameter replacement guide for addressing this issue. Additionally, try exporting with int8=False first to confirm the issue is specific to quantization. If the problem persists, please share more details about your environment or test with the latest Ultralytics version.

      Note: Since Ultralytics 8.4.83, format="tflite" is deprecated and exports through LiteRT (litert-torch) instead of onnx2tf and TensorFlow. Run pip install -U ultralytics and export with format="litert" (see the LiteRT guide).

    2. saleha-fatimaGitHub(已编辑)

      I've tried with int8=False, but the problem persists. this is the info related to my model, packages and dataset so i am using yolov10 model fro conversion purposes coco dataset python version=3.9.12 packages:

      torch==2.0.1 torchvision==0.15.2 onnx==1.17.0 onnxruntime==1.15.1 pycocotools==2.0.7 PyYAML==6.0.1 scipy==1.13.0 onnxslim==0.1.31 onnxruntime-gpu==1.18.0 gradio==4.31.5 opencv-python==4.9.0.80 psutil==5.9.8 py-cpuinfo==9.0.0 huggingface-hub==0.23.2 safetensors==0.4.3 ultralytics==8.3.69 onnx2tf==1.20.0 onnxruntime==1.15.1 tensorflow==2.18.0

      I have alse tried the suggestions mentioned in error msg but nothing seems to work!

    3. Glenn JocherUltralytics(已编辑)

      This was a compatibility issue between YOLOv10's architecture and the old ONNX->TFLite (onnx2tf) conversion path. Since Ultralytics 8.4.83, format="tflite" is deprecated and exports through LiteRT (litert-torch) instead of onnx2tf and TensorFlow, so those version pins no longer apply. Run pip install -U ultralytics and export with format="litert" (see the LiteRT guide).

    4. nicola-321GitHub

      hi there @glenn-jocher I am trying to convert the the yolov10 model to int8 with tflite format. but same error is occurring again and again. I've tried the solutions described in this thread but nothing seems to work. I am using this for conversion:

      ` from ultralytics import YOLO

      model = YOLO("current_best4.pt")

      model.export(format="tflite", int8=True, data='./datasets/data.yaml', imgsz=640) # creates 'yolov8n_float32.tflite'

      tflite_model = YOLO("yolov8n_int8.tflite")

      results = tflite_model("./frame_365.jpg")

      results.show() `

      and the error i am receiving is this:

      ERROR: The trace log is below. Traceback (most recent call last): File "/mnt/drive/rev9ai/anaconda3/envs/int8_test/lib/python3.9/site-packages/onnx2tf/utils/common_functions.py", line 310, in print_wrapper_func result = func(*args, **kwargs) File "/mnt/drive/rev9ai/anaconda3/envs/int8_test/lib/python3.9/site-packages/onnx2tf/utils/common_functions.py", line 383, in inverted_operation_enable_disable_wrapper_func result = func(*args, **kwargs) File "/mnt/drive/rev9ai/anaconda3/envs/int8_test/lib/python3.9/site-packages/onnx2tf/utils/common_functions.py", line 53, in get_replacement_parameter_wrapper_func func(*args, **kwargs) File "/mnt/drive/rev9ai/anaconda3/envs/int8_test/lib/python3.9/site-packages/onnx2tf/ops/Add.py", line 248, in make_node merge_two_consecutive_identical_ops_into_one( File "/mnt/drive/rev9ai/anaconda3/envs/int8_test/lib/python3.9/site-packages/onnx2tf/utils/common_functions.py", line 5384, in merge_two_consecutive_identical_ops_into_one tf.math.add( File "/mnt/drive/rev9ai/anaconda3/envs/int8_test/lib/python3.9/site-packages/tensorflow/python/ops/weak_tensor_ops.py", line 142, in wrapper return op(*args, **kwargs) File "/mnt/drive/rev9ai/anaconda3/envs/int8_test/lib/python3.9/site-packages/tensorflow/python/util/traceback_utils.py", line 153, in error_handler raise e.with_traceback(filtered_tb) from None File "/mnt/drive/rev9ai/anaconda3/envs/int8_test/lib/python3.9/site-packages/tf_keras/src/layers/core/tf_op_layer.py", line 119, in handle return TFOpLambda(op)(*args, **kwargs) File "/mnt/drive/rev9ai/anaconda3/envs/int8_test/lib/python3.9/site-packages/tf_keras/src/utils/traceback_utils.py", line 70, in error_handler raise e.with_traceback(filtered_tb) from None ValueError: Exception encountered when calling layer "tf.math.add_5" (type TFOpLambda). Dimensions must be equal, but are 32 and 16 for '{{node tf.math.add_5/Add}} = AddV2 [T=DT_FLOAT](Placeholder, Placeholder_1)' with input shapes: [1,80,160,32], [1,80,160,16]. Call arguments received by layer "tf.math.add_5" (type TFOpLambda): • x=tf.Tensor(shape=(1, 80, 160, 32), dtype=float32) • y=tf.Tensor(shape=(1, 80, 160, 16), dtype=float32) • name='/model.2/m.0/Add' ERROR: input_onnx_file_path: weights/yolov10n.onnx ERROR: onnx_op_name: /model.2/m.0/Add ERROR: Read this and deal with it. https://github.com/PINTO0309/onnx2tf#parameter-replacement ERROR: Alternatively, if the input OP has a dynamic dimension, use the -b or -ois option to rewrite it to a static shape and try again. ERROR: If the input OP of ONNX before conversion is NHWC or an irregular channel arrangement other than NCHW, use the -kt or -kat option. ERROR: Also, for models that include NonMaxSuppression in the post-processing, try the -onwdt option.

      i

      I have approx 5k images for calibration, so thats not the issue, all the packages are upto date as well. can you please suggest what solution should i opt for?

      I've got the same error when covert yolov8 to tflite. Have you fix it?

    5. Glenn JocherUltralytics(已编辑)

      For YOLOv10 TFLite conversion issues in the old onnx2tf path: Since Ultralytics 8.4.83, format="tflite" is deprecated and exports through LiteRT (litert-torch) instead of onnx2tf and TensorFlow, so those version pins no longer apply. Run pip install -U ultralytics and export with format="litert" (see the LiteRT guide). If errors persist, share the full export log.

    6. nicola-321GitHub

      Thanks for your advice. I've tried to Update dependencies and Export with dynamic axes , but unfortunately, a new issue is as below:

      AssertionError: ERROR ❌️ argument 'dynamic' is not supported for format='tflite'

      If I only update dependencies and delete the dynamic axes , the issue is as before:

      ValueError: Exception encountered when calling layer "tf.math.add_5" (type TFOpLambda).

      Dimensions must be equal, but are 32 and 16 for '{{node tf.math.add_5/Add}} = AddV2 [T=DT_FLOAT](Placeholder, Placeholder_1)' with input shapes: [1,80,160,32], [1,80,160,16].

      Call arguments received by layer "tf.math.add_5" (type TFOpLambda): • x=tf.Tensor(shape=(1, 80, 160, 32), dtype=float32) • y=tf.Tensor(shape=(1, 80, 160, 16), dtype=float32) • name='/model.2/m.0/Add'

    7. saleha-fatimaGitHub(已编辑)

      I've got the same error when covert yolov8 to tflite. Have you fix it?

      hi there, yes i fixed this issue. but it then resulted into new error saying "end2end model format conversion is not supported". btw i resolved that issue by using the following versions of dependencies: torch 2.6.0 tensorflow 2.15.1 onnx2tf 1.20.0

      try this but if you are looking for direct export of the model to int8 with tflite. then according to my research export command does not work. atleast it didnt work for yolov10 model. for that i converted the .pt model to IR form (onnx) then further conversion. but if your concern is just to convert model to tflite with fp16/32 quantization. i would suggest to use command line prompt for conversion. for some reasons it works

      !yolo export model=runs/detect/train2/weights/best.pt format=tflite half=False simplify opset=13 workspace=16

    8. Glenn JocherUltralytics(已编辑)

      @saleha-fatima thanks for sharing your solution! Since Ultralytics 8.4.83, format="tflite" is deprecated and exports through LiteRT (litert-torch) instead of onnx2tf and TensorFlow. Run pip install -U ultralytics and export with format="litert" (see the LiteRT guide). The dynamic argument is not supported for LiteRT export.

    9. nicola-321GitHub(已编辑)

      I've got the same error when covert yolov8 to tflite. Have you fix it?

      hi there, yes i fixed this issue. but it then resulted into new error saying "end2end model format conversion is not supported". btw i resolved that issue by using the following versions of dependencies: torch 2.6.0 tensorflow 2.15.1 onnx2tf 1.20.0

      try this but if you are looking for direct export of the model to int8 with tflite. then according to my research export command does not work. atleast it didnt work for yolov10 model. for that i converted the .pt model to IR form (onnx) then further conversion. but if your concern is just to convert model to tflite with fp16/32 quantization. i would suggest to use command line prompt for conversion. for some reasons it works

      !yolo export model=runs/detect/train2/weights/best.pt format=tflite half=False simplify opset=13 workspace=16

      Thank you for your reply,. I've tried to update the dependencies or use the CLI but error persists. so I tried to convert the model step by step . It can be converted to onnx but when converting to tf. An new error occurs as below. It seems like the dependency conflict :

      https://github.com/tensorflow/addons warnings.warn( Traceback (most recent call last): File "/workspace/user_code/model/convertModel/onnx-tensorflow/example/onnx_to_tf.py", line 3, in from onnx_tf.backend import prepare File "/workspace/user_code/model/convertModel/onnx-tensorflow/onnx_tf/init.py", line 1, in from . import backend File "/workspace/user_code/model/convertModel/onnx-tensorflow/onnx_tf/backend.py", line 28, in from onnx_tf.common.handler_helper import get_all_backend_handlers File "/workspace/user_code/model/convertModel/onnx-tensorflow/onnx_tf/common/handler_helper.py", line 3, in from onnx_tf.handlers.backend import * # noqa File "/workspace/user_code/model/convertModel/onnx-tensorflow/onnx_tf/handlers/backend/hardmax.py", line 3, in import tensorflow_addons as tfa File "/workspace/user_code/model/convertModel/myenv3.10/lib/python3.10/site-packages/tensorflow_addons/init.py", line 23, in from tensorflow_addons import activations File "/workspace/user_code/model/convertModel/myenv3.10/lib/python3.10/site-packages/tensorflow_addons/activations/init.py", line 17, in from tensorflow_addons.activations.gelu import gelu File "/workspace/user_code/model/convertModel/myenv3.10/lib/python3.10/site-packages/tensorflow_addons/activations/gelu.py", line 19, in from tensorflow_addons.utils.types import TensorLike File "/workspace/user_code/model/convertModel/myenv3.10/lib/python3.10/site-packages/tensorflow_addons/utils/types.py", line 29, in from keras.src.engine import keras_tensor ModuleNotFoundError: No module named 'keras.src.engine'

      and if I use !pip install 'keras<3.0.0' mediapipe-model-maker to fix the error from https://github.com/google-ai-edge/mediapipe/issues/5229 then it will leading to the issue as below:

      ImportError: This version of TensorFlow Probability requires TensorFlow version >= 2.18; Detected an installation of version 2.15.1. Please upgrade TensorFlow to proceed.

      It seems like that keras<3.0.0 and TensorFlow version >= 2.18 is conflict

    10. saleha-fatimaGitHub

      Hi, so i tested it on my end again and it worked. I would recommend you to create a new env and then just go for installing updated "ultralytics" package using pip install ultralytics now without installing anything else just run this CLI export command:

      yolo export model=runs/detect/train2/weights/best.pt format=tflite half=False simplify opset=13 workspace=16

      It will install all the supported requirements itself. I have tested it, i am sure it will work for u as well. Do update me on this!

    11. Glenn JocherUltralytics(已编辑)

      Thanks for sharing your findings. For TFLite conversion issues, create a fresh environment and let Ultralytics install what it needs when you export. Since Ultralytics 8.4.83, format="tflite" is deprecated and exports through LiteRT (litert-torch) instead of onnx2tf and TensorFlow, so those version pins no longer apply. Run pip install -U ultralytics and export with format="litert" (see the LiteRT guide). If issues persist, please share your environment details from yolo checks.

    12. nicola-321GitHub

      Hi, so i tested it on my end again and it worked. I would recommend you to create a new env and then just go for installing updated "ultralytics" package using pip install ultralytics now without installing anything else just run this CLI export command:

      yolo export model=runs/detect/train2/weights/best.pt format=tflite half=False simplify opset=13 workspace=16

      It will install all the supported requirements itself. I have tested it, i am sure it will work for u as well. Do update me on this!

      Hi, thanks for your sharing!Congratulate that you fix it ! but seems that it does's work in my env. I have create a new env . only "pip install ultralytics" , loading the yolov11. and my python packages is as below: `Package Version


      absl-py 2.1.0 astunparse 1.6.3 cachetools 5.5.2 certifi 2025.1.31 cffi 1.17.1 charset-normalizer 3.4.1 coloredlogs 15.0.1 contourpy 1.1.1 cycler 0.12.1 filelock 3.16.1 flatbuffers 25.2.10 fonttools 4.56.0 fsspec 2025.2.0 gast 0.4.0 google-auth 2.38.0 google-auth-oauthlib 1.0.0 google-pasta 0.2.0 grpcio 1.70.0 h5py 3.11.0 humanfriendly 10.0 idna 3.10 importlib_metadata 8.5.0 importlib_resources 6.4.5 Jinja2 3.1.5 keras 2.13.1 kiwisolver 1.4.7 libclang 18.1.1 Markdown 3.7 MarkupSafe 2.1.5 matplotlib 3.7.5 mpmath 1.3.0 networkx 3.1 numpy 1.24.3 nvidia-cublas-cu12 12.1.3.1 nvidia-cuda-cupti-cu12 12.1.105 nvidia-cuda-nvrtc-cu12 12.1.105 nvidia-cuda-runtime-cu12 12.1.105 nvidia-cudnn-cu12 9.1.0.70 nvidia-cufft-cu12 11.0.2.54 nvidia-curand-cu12 10.3.2.106 nvidia-cusolver-cu12 11.4.5.107 nvidia-cusparse-cu12 12.1.0.106 nvidia-nccl-cu12 2.20.5 nvidia-nvjitlink-cu12 12.8.61 nvidia-nvtx-cu12 12.1.105 oauthlib 3.2.2 onnx 1.17.0 onnx_graphsurgeon 0.5.5 onnx2tf 1.20.0 onnxruntime 1.16.3 onnxslim 0.1.48 opencv-python 4.11.0.86 opt_einsum 3.4.0 packaging 24.2 pandas 2.0.3 pillow 10.4.0 pip 25.0.1 protobuf 5.29.3 psutil 7.0.0 py-cpuinfo 9.0.0 pyasn1 0.6.1 pyasn1_modules 0.4.1 pybind11 2.13.6 pycparser 2.22 pyparsing 3.1.4 python-dateutil 2.9.0.post0 pytz 2025.1 PyYAML 6.0.2 requests 2.32.3 requests-oauthlib 2.0.0 rsa 4.9 scipy 1.10.1 seaborn 0.13.2 setuptools 49.2.1 six 1.17.0 sng4onnx 1.0.4 sounddevice 0.5.1 sympy 1.13.3 tensorboard 2.13.0 tensorboard-data-server 0.7.2 tensorflow-cpu 2.13.1 tensorflow-estimator 2.13.0 tensorflow-io-gcs-filesystem 0.34.0 termcolor 2.4.0 tf-keras 2.15.0 tflite-support 0.4.0 torch 2.4.1 torchvision 0.19.1 tqdm 4.67.1 triton 3.0.0 typing_extensions 4.5.0 tzdata 2025.1 ultralytics 8.3.78 ultralytics-thop 2.0.14 urllib3 2.2.3 Werkzeug 3.0.6 wheel 0.45.1 wrapt 1.17.2 zipp 3.20.2`

    13. nicola-321GitHub(已编辑)

      The problem is still `ValueError: Exception encountered when calling layer "tf.math.add_5" (type TFOpLambda).

      Dimensions must be equal, but are 32 and 16 for '{{node tf.math.add_5/Add}} = AddV2 [T=DT_FLOAT](Placeholder, Placeholder_1)' with input shapes: [1,16,160,32], [1,16,160,16].

      Call arguments received by layer "tf.math.add_5" (type TFOpLambda): • x=tf.Tensor(shape=(1, 16, 160, 32), dtype=float32) • y=tf.Tensor(shape=(1, 16, 160, 16), dtype=float32) • name='/model.2/m.0/Add'

      ERROR: input_onnx_file_path: yolo11n.onnx ERROR: onnx_op_name: /model.2/m.0/Add ERROR: Read this and deal with it. https://github.com/PINTO0309/onnx2tf#parameter-replacement ERROR: Alternatively, if the input OP has a dynamic dimension, use the -b or -ois option to rewrite it to a static shape and try again. ERROR: If the input OP of ONNX before conversion is NHWC or an irregular channel arrangement other than NCHW, use the -kt or -kat option. ERROR: Also, for models that include NonMaxSuppression in the post-processing, try the -onwdt option.`

    14. Glenn JocherUltralytics(已编辑)

      Thanks for sharing your environment details. Since Ultralytics 8.4.83, format="tflite" is deprecated and exports through LiteRT (litert-torch) instead of onnx2tf and TensorFlow, so those version pins no longer apply. Run pip install -U ultralytics and export with format="litert" (see the LiteRT guide). Then export via CLI: yolo export model=yolo11n.pt format=litert imgsz=640.

  2. Z-Mike0033GitHub

    您好,我现在正在使用基于官网的yolo11m.pt预训练模型,在自己数据集上训练后的human_detector_model_float32.tflite,并在支持 TFLite GPU 代理的设备上进行推理。 1、从.pt到tflite的转换代码是官网提供的版本如下: model.export( format="tflite", imgsz=640, half=True, simplify=True ) 2、使用tflite在支持 TFLite GPU 代理的设备上进行推理,日志如下: I human_detector_mode_float32.tflite I Created GPU engine. INFO: Created TensorFlow Lite delegate for GPU. ERROR: Failed to build program executable - Build program failure error: Total size of kernel arguments exceeds limit! Total arguments size: 4120, limit: 2048 in kernel: 'main_function' error: backend compiler failed build.

    error: Total size of kernel arguments exceeds limit! Total arguments size: 4120, limit: 2048 in kernel: 'main_function' error: backend compiler failed build.

    ERROR: Falling back to OpenGL ERROR: TfLiteGpuDelegate Init: OpenGL-based API disabled ERROR: TfLiteGpuDelegate Prepare: delegate is not initialized ERROR: Node number 255 (TfLiteGpuDelegateV2) failed to prepare. ERROR: Restored original execution plan after delegate application failure. E tflite gpu not support!../models/extra/human_detector/human_detector_model_float32.tflite INFO: Created TensorFlow Lite XNNPACK delegate for CPU. I Load model finished I Image reader initialized. Total images: 15 I Starting image processing loop.. 3、由日志可知,模型成功加载,并创建了 GPU 代理;但在准备阶段,GPU 代理失败了,并回退到 CPU(XNNPACK)推理。主要原因是“Total size of kernel arguments exceeds limit!:**内核参数总大小超过了硬件限制。**日志显示参数大小为 4120,而限制为 2048”。 4、想问下这个是为什么?需要怎么解决这个GPU跑不了回退xnnpack的问题?

  3. UltralyticsAssistantGitHubUltralytics

    👋 Hello, thank you for your interest in Ultralytics 🚀! For users exploring model conversion and deployment, we recommend checking out the Docs where you’ll find a variety of helpful Python and CLI usage examples, as well as detailed integration guides.

    If this is a 🐛 Bug Report regarding TFLite conversion, please provide a minimum reproducible example to help us investigate.

    If you have a custom training ❓ Question or experience any issues during conversion, please include as much information as possible, such as code snippets, error messages, and details about your environment. Also, check our Tips for Best Training Results to ensure optimal performance.

    Connect with the Ultralytics community in the way that suits you best: for real-time chat, join us on Discord 🎧, dive deeper on Discourse, or join discussions on our Subreddit.

    Upgrade

    Please upgrade to the latest ultralytics package and all requirements in a Python>=3.8 environment with PyTorch>=1.8 to ensure your issue is not already resolved:

    pip install -U ultralytics

    Environments

    YOLO can be run in any of these up-to-date verified environments (with all dependencies such as CUDA/CUDNN, Python and PyTorch preinstalled):

    Status

    Ultralytics CI

    If this badge is green, all Ultralytics CI tests are currently passing. CI tests verify correct operation of all YOLO Modes and Tasks on macOS, Windows, and Ubuntu every 24 hours and on every commit.

    🔔 This is an automated response. An Ultralytics engineer will also assist you here soon!

    1. Alexts166GitHub

      I'm working through the IDE, and I've updated the dependencies. I'm launching it from ultralytics import YOLO

      Load the YOLO11 model

      model = YOLO("yolo11m-obb.pt")

      Export the model to TFLite format

      model.export(format="tflite")

      ERROR TensorFlow SavedModel: export failure 34.3s: No module named 'ai_edge_litert' Traceback (most recent call last): File "D:\nEWpapka\convert.py", line 7, in model.export(format="tflite") # creates 'yolo11n_float32.tflite' File "D:\nEWpapka.venv\lib\site-packages\ultralytics\engine\model.py", line 734, in export return Exporter(overrides=args, callbacks=self.callbacks)(model=self.model) File "D:\nEWpapka.venv\lib\site-packages\ultralytics\engine\exporter.py", line 494, in call f[5], keras_model = self.export_saved_model() File "D:\nEWpapka.venv\lib\site-packages\ultralytics\engine\exporter.py", line 198, in outer_func raise e File "D:\nEWpapka.venv\lib\site-packages\ultralytics\engine\exporter.py", line 193, in outer_func f, model = inner_func(*args, **kwargs) File "D:\nEWpapka.venv\lib\site-packages\ultralytics\engine\exporter.py", line 1003, in export_saved_model import onnx2tf # scoped for after ONNX export for reduced conflict during import File "D:\nEWpapka.venv\lib\site-packages\onnx2tf_init.py", line 1, in from onnx2tf.onnx2tf import convert, main File "D:\nEWpapka.venv\lib\site-packages\onnx2tf\onnx2tf.py", line 44, in from onnx2tf.utils.common_functions import ( File "D:\nEWpapka.venv\lib\site-packages\onnx2tf\utils\common_functions.py", line 20, in from ai_edge_litert.interpreter import Interpreter ModuleNotFoundError: No module named 'ai_edge_litert'

      in bash pip install ai_edge_litert ERROR: Could not find a version that satisfies the requirement ai_edge_litert (from versions: none) ERROR: No matching distribution found for ai_edge_litert

    2. Glenn JocherUltralytics

      You're correct that ai_edge_litert has limited platform support and isn't available for Windows. For TFLite export on Windows, I recommend using one of these alternatives:

      1. Google Colab (recommended): Export your model in a Colab notebook which runs on Linux
      2. Docker: Use the Ultralytics Docker image on Windows to export in a Linux container
      3. WSL2: Export using Windows Subsystem for Linux

      The simplest approach is Colab - just upload your .pt file and run the export code there, then download the resulting .tflite file back to your Windows machine.

  4. Alexts166GitHub

    Hi! Please give me a hint. Exporting the model .pt in the model . tflite according to the code in the documentation. It remains to cope with the ai_edge_litert package. Do I understand correctly that there is no such package for WINDOWS? based on the information on https://pypi.org/project/ai-edge-litert/#files Or is there a way out?

  5. longzaixiang222GitHub

    您好老师,同一个模型,转换成tflite,同一张图片,每2秒识别一次,和单次识别为什么结果会不样?

    1. Glenn JocherUltralytics

      @longzaixiang222 这种差异通常由以下原因造成:1) 录屏图像可能存在压缩损失或格式转换;2) 录屏帧和保存的图片可能在色彩空间、分辨率或编码上有细微差别;3) 图像预处理路径不同。建议检查两种图像的像素值、尺寸和格式是否完全一致,确保使用相同的预处理步骤。您可以尝试保存录屏帧并与本地图片进行像素级对比来定位差异源。

  6. diamondeyessGitHub

    我的导出设置是:ormat = "tflite", device = "0", int8 = True, data =.....data.yaml, 为什么输出:fully_quantize: 0, inference_type: 6, input_inference_type: FLOAT32, output_inference_type: FLOAT32 ,没有完全量化吗?

    1. Glenn JocherUltralytics

      @diamondeyess 这是正常的TFLite INT8量化行为!输入输出保持FLOAT32是为了保持精度和兼容性,而模型内部计算已经量化为INT8以提升性能和减小模型大小。这种"混合量化"可以在保持推理精度的同时获得INT8的性能优势。如需完全INT8量化(包括输入输出),需要特定的TFLite配置,但通常不推荐,因为可能影响精度。

    2. diamondeyessGitHub

      好的,谢谢!后面输出还有一段:fully_quantize: 0, inference_type: 6, input_inference_type: INT8, output_inference_type: INT8 就是您说的完全量化吗?

    3. Glenn JocherUltralytics

      @diamondeyess 是的,第二个输出(input_inference_type: INT8, output_inference_type: INT8)就是完全量化!这意味着模型的输入和输出也被量化为INT8。完全量化可以进一步减小模型大小和提升推理速度,但需要注意输入数据的预处理要匹配INT8格式。在使用时,您可能需要将输入数据从FLOAT32转换为INT8范围,并在推理后将输出从INT8转换回FLOAT32以便后处理。

  7. SKUNAandGOJOGitHub

    I'm trying to convert "tflite" to Google Colab, but it's showing like this

    Ultralytics 8.3.133 🚀 Python-3.11.12 torch-2.6.0+cu124 CPU (Intel Xeon 2.00GHz) YOLO11n summary (fused): 100 layers, 2,584,687 parameters, 0 gradients, 6.3 GFLOPs

    PyTorch: starting from 'fruit.pt' with input shape (1, 3, 640, 640) BCHW and output shape(s) (1, 17, 8400) (5.2 MB) requirements: Ultralytics requirements ['sng4onnx>=1.0.1', 'onnx_graphsurgeon>=0.3.26', 'ai-edge-litert>=1.2.0', 'onnx2tf>=1.26.3', 'protobuf>=5'] not found, attempting AutoUpdate... Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com Collecting sng4onnx>=1.0.1 Downloading sng4onnx-1.0.4-py3-none-any.whl.metadata (4.6 kB) Collecting onnx_graphsurgeon>=0.3.26 Downloading onnx_graphsurgeon-0.5.8-py2.py3-none-any.whl.metadata (8.2 kB) Collecting ai-edge-litert>=1.2.0 Downloading ai_edge_litert-1.2.0-cp311-cp311-manylinux_2_17_x86_64.whl.metadata (1.6 kB) Collecting onnx2tf>=1.26.3 Downloading onnx2tf-1.27.4-py3-none-any.whl.metadata (147 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 147.7/147.7 kB 8.2 MB/s eta 0:00:00 Collecting protobuf>=5 Downloading protobuf-6.30.2-cp39-abi3-manylinux2014_x86_64.whl.metadata (593 bytes) Requirement already satisfied: numpy in /usr/local/lib/python3.11/dist-packages (from onnx_graphsurgeon>=0.3.26) (2.0.2) Requirement already satisfied: onnx>=1.14.0 in /usr/local/lib/python3.11/dist-packages (from onnx_graphsurgeon>=0.3.26) (1.17.0) Requirement already satisfied: flatbuffers in /usr/local/lib/python3.11/dist-packages (from ai-edge-litert>=1.2.0) (25.2.10) Downloading sng4onnx-1.0.4-py3-none-any.whl (5.9 kB) Downloading onnx_graphsurgeon-0.5.8-py2.py3-none-any.whl (57 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.9/57.9 kB 280.1 MB/s eta 0:00:00 Downloading ai_edge_litert-1.2.0-cp311-cp311-manylinux_2_17_x86_64.whl (3.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.5/3.5 MB 103.4 MB/s eta 0:00:00 Downloading onnx2tf-1.27.4-py3-none-any.whl (446 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 446.1/446.1 kB 379.6 MB/s eta 0:00:00 Downloading protobuf-6.30.2-cp39-abi3-manylinux2014_x86_64.whl (316 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 316.2/316.2 kB 356.0 MB/s eta 0:00:00 Installing collected packages: sng4onnx, protobuf, onnx2tf, ai-edge-litert, onnx_graphsurgeon Attempting uninstall: protobuf Found existing installation: protobuf 3.20.3 Uninstalling protobuf-3.20.3: Successfully uninstalled protobuf-3.20.3 Successfully installed ai-edge-litert-1.2.0 onnx2tf-1.27.4 onnx_graphsurgeon-0.5.8 protobuf-6.30.2 sng4onnx-1.0.4

    requirements: AutoUpdate success ✅ 13.1s, installed 5 packages: ['sng4onnx>=1.0.1', 'onnx_graphsurgeon>=0.3.26', 'ai-edge-litert>=1.2.0', 'onnx2tf>=1.26.3', 'protobuf>=5'] WARNING ⚠️ requirements: Restart runtime or rerun command for updates to take effect

    TensorFlow SavedModel: starting export with tensorflow 2.18.0... Downloading https://github.com/ultralytics/assets/releases/download/v8.3.0/calibration_image_sample_data_20x128x128x3_float32.npy.zip to 'calibration_image_sample_data_20x128x128x3_float32.npy.zip'... 100%|██████████| 1.11M/1.11M [00:00<00:00, 25.9MB/s] Unzipping calibration_image_sample_data_20x128x128x3_float32.npy.zip to /content/calibration_image_sample_data_20x128x128x3_float32.npy...: 100%|██████████| 1/1 [00:00<00:00, 32.58file/s] ONNX: starting export with onnx 1.18.0 opset 19...

    ONNX: slimming with onnxslim 0.1.52... ONNX: export success ✅ 1.7s, saved as 'fruit.onnx' (10.2 MB) TensorFlow SavedModel: starting TFLite export with onnx2tf 1.27.4... ERROR:root:Internal Python error in the inspect module. Below is the traceback from this internal error.

    ERROR: The trace log is below. Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/onnx2tf/utils/common_functions.py", line 313, in print_wrapper_func result = func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/onnx2tf/utils/common_functions.py", line 386, in inverted_operation_enable_disable_wrapper_func result = func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/onnx2tf/utils/common_functions.py", line 56, in get_replacement_parameter_wrapper_func func(*args, **kwargs) File "/usr/local/lib/python3.11/dist-packages/onnx2tf/ops/Add.py", line 281, in make_node merge_two_consecutive_identical_ops_into_one( File "/usr/local/lib/python3.11/dist-packages/onnx2tf/utils/common_functions.py", line 5475, in merge_two_consecutive_identical_ops_into_one tf.math.add( File "/usr/local/lib/python3.11/dist-packages/tensorflow/python/ops/weak_tensor_ops.py", line 142, in wrapper return op(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/tensorflow/python/util/traceback_utils.py", line 153, in error_handler raise e.with_traceback(filtered_tb) from None File "/usr/local/lib/python3.11/dist-packages/tf_keras/src/layers/core/tf_op_layer.py", line 119, in handle return TFOpLambda(op)(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/tf_keras/src/utils/traceback_utils.py", line 72, in error_handler del filtered_tb ValueError: Exception encountered when calling layer "tf.math.add_17" (type TFOpLambda).

    Dimensions must be equal, but are 32 and 16 for '{{node tf.math.add_17/Add}} = AddV2 [T=DT_FLOAT](Placeholder, Placeholder_1)' with input shapes: [1,16,160,32], [1,16,160,16].

    Call arguments received by layer "tf.math.add_17" (type TFOpLambda): • x=tf.Tensor(shape=(1, 16, 160, 32), dtype=float32) • y=tf.Tensor(shape=(1, 16, 160, 16), dtype=float32) • name='wa/model.2/m.0/Add'

    ERROR: input_onnx_file_path: fruit.onnx ERROR: onnx_op_name: wa/model.2/m.0/Add ERROR: Read this and deal with it. https://github.com/PINTO0309/onnx2tf#parameter-replacement ERROR: Alternatively, if the input OP has a dynamic dimension, use the -b or -ois option to rewrite it to a static shape and try again. ERROR: If the input OP of ONNX before conversion is NHWC or an irregular channel arrangement other than NCHW, use the -kt or -kat option. ERROR: Also, for models that include NonMaxSuppression in the post-processing, try the -onwdt option. Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/onnx2tf/utils/common_functions.py", line 313, in print_wrapper_func result = func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/onnx2tf/utils/common_functions.py", line 386, in inverted_operation_enable_disable_wrapper_func result = func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/onnx2tf/utils/common_functions.py", line 56, in get_replacement_parameter_wrapper_func func(*args, **kwargs) File "/usr/local/lib/python3.11/dist-packages/onnx2tf/ops/Add.py", line 281, in make_node merge_two_consecutive_identical_ops_into_one( File "/usr/local/lib/python3.11/dist-packages/onnx2tf/utils/common_functions.py", line 5475, in merge_two_consecutive_identical_ops_into_one tf.math.add( File "/usr/local/lib/python3.11/dist-packages/tensorflow/python/ops/weak_tensor_ops.py", line 142, in wrapper return op(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/tensorflow/python/util/traceback_utils.py", line 153, in error_handler raise e.with_traceback(filtered_tb) from None File "/usr/local/lib/python3.11/dist-packages/tf_keras/src/layers/core/tf_op_layer.py", line 119, in handle return TFOpLambda(op)(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/tf_keras/src/utils/traceback_utils.py", line 72, in error_handler del filtered_tb ValueError: Exception encountered when calling layer "tf.math.add_17" (type TFOpLambda).

    Dimensions must be equal, but are 32 and 16 for '{{node tf.math.add_17/Add}} = AddV2 [T=DT_FLOAT](Placeholder, Placeholder_1)' with input shapes: [1,16,160,32], [1,16,160,16].

    Call arguments received by layer "tf.math.add_17" (type TFOpLambda): • x=tf.Tensor(shape=(1, 16, 160, 32), dtype=float32) • y=tf.Tensor(shape=(1, 16, 160, 16), dtype=float32) • name='wa/model.2/m.0/Add'

    During handling of the above exception, another exception occurred:

    Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/IPython/core/interactiveshell.py", line 3553, in run_code exec(code_obj, self.user_global_ns, self.user_ns) File "", line 7, in <cell line: 0> model.export(format="tflite") File "/usr/local/lib/python3.11/dist-packages/ultralytics/engine/model.py", line 730, in export return Exporter(overrides=args, _callbacks=self.callbacks)(model=self.model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/ultralytics/engine/exporter.py", line 468, in call f[5], keras_model = self.export_saved_model() ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/ultralytics/engine/exporter.py", line 192, in outer_func f, model = inner_func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/ultralytics/engine/exporter.py", line 975, in export_saved_model keras_model = onnx2tf.convert( ^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/onnx2tf/onnx2tf.py", line 1149, in convert op.make_node( File "/usr/local/lib/python3.11/dist-packages/onnx2tf/utils/common_functions.py", line 379, in print_wrapper_func sys.exit(1) SystemExit: 1

    During handling of the above exception, another exception occurred:

    Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/IPython/core/ultratb.py", line 1101, in get_records return _fixed_getinnerframes(etb, number_of_lines_of_context, tb_offset) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/IPython/core/ultratb.py", line 248, in wrapped return f(*args, **kwargs) ^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/IPython/core/ultratb.py", line 281, in _fixed_getinnerframes records = fix_frame_records_filenames(inspect.getinnerframes(etb, context)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/inspect.py", line 1739, in getinnerframes traceback_info = getframeinfo(tb, context) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/inspect.py", line 1671, in getframeinfo lineno = frame.f_lineno ^^^^^^^^^^^^^^ AttributeError: 'tuple' object has no attribute 'f_lineno'

    ValueError Traceback (most recent call last) /usr/local/lib/python3.11/dist-packages/onnx2tf/utils/common_functions.py in print_wrapper_func(*args, **kwargs) 312 try: --> 313 result = func(*args, **kwargs) 314

    22 frames ValueError: Exception encountered when calling layer "tf.math.add_17" (type TFOpLambda).

    Dimensions must be equal, but are 32 and 16 for '{{node tf.math.add_17/Add}} = AddV2 [T=DT_FLOAT](Placeholder, Placeholder_1)' with input shapes: [1,16,160,32], [1,16,160,16].

    Call arguments received by layer "tf.math.add_17" (type TFOpLambda): • x=tf.Tensor(shape=(1, 16, 160, 32), dtype=float32) • y=tf.Tensor(shape=(1, 16, 160, 16), dtype=float32) • name='wa/model.2/m.0/Add'

    During handling of the above exception, another exception occurred:

    SystemExit Traceback (most recent call last) [... skipping hidden 1 frame]

    SystemExit: 1

    During handling of the above exception, another exception occurred:

    TypeError Traceback (most recent call last) [... skipping hidden 1 frame]

    /usr/local/lib/python3.11/dist-packages/IPython/core/ultratb.py in find_recursion(etype, value, records) 380 # first frame (from in to out) that looks different. 381 if not is_recursion_error(etype, value, records): --> 382 return len(records), 0 383 384 # Select filename, lineno, func_name to track frames with

    TypeError: object of type 'NoneType' has no len()

  8. SidyeiGitHub

    I directly exported my yolov8s trained model (best.pt) to tensorflow lite using this block of code:

    from ultralytics import YOLO

    model = YOLO("/content/runs/detect/yolov8s_sign_language/weights/best.pt") model.export( format="tflite", # Export to TFLite imgsz=[320, 320], # Match training input size dynamic=False, # Fixed batch size (required for TFLite) int8=False, # Disable quantization (preserves FP32 precision) simplify=True, # Optimize model (removes redundant ops) opset=12 # ONNX opset (if intermediate conversion is needed) )

    The problem lies after conversion where there was a significant decrease of precision and it detects randomly compared to my best.pt file that performs well. Is this normal? how can I ensure that there are no lose ends during conversion?

  9. McGillllGitHub

    PyTorch: starting from 'my_model.pt' with input shape (1, 3, 640, 640) BCHW and output shape(s) (1, 6, 8400) (17.6 MB) TensorFlow SavedModel: export failure 0.0s: Unable to convert function return value to a Python type! The signature was () -> handle

    TypeError Traceback (most recent call last) Cell In[11], line 2 1 model = YOLO("my_model.pt")
    ----> 2 model.export(format="tflite")

    1. Glenn JocherUltralytics(已编辑)

      Hi @McGillll,

      The error you're encountering during TFLite export is happening at the TensorFlow SavedModel stage, which is a prerequisite step for TFLite conversion. This function return value conversion error typically stems from version incompatibilities between PyTorch, TensorFlow, and the conversion tools.

      Since Ultralytics 8.4.83, format="tflite" is deprecated and exports through LiteRT (litert-torch) instead of onnx2tf and TensorFlow, so those version pins no longer apply. Run pip install -U ultralytics and export with format="litert" (see the LiteRT guide). Then try the CLI instead of the Python API:

      yolo export model=my_model.pt format=litert imgsz=640

      Let me know if these suggestions help or if you need further assistance!

  10. longzaixiang222GitHub

    from ultralytics import YOLO model = YOLO("best5.pt") model.export(format="tflite") 模型导出后识别效果不好 使用YOLO("best5_float32.tflite") 这种加载方式,效果就很好

    但我使用: interpreter = tf.lite.Interpreter(model_path="best5_float32.tflite") interpreter.allocate_tensors() input_details = interpreter.get_input_details() output_details = interpreter.get_output_details() 识别效果不佳,部分类型识别不出来,原图尺寸640*640

    请问下是您们内部对图片做了什么处理吗?

    1. Glenn JocherUltralytics(已编辑)

      @longzaixiang222 thank you for your question! The difference occurs because when using YOLO("best5_float32.tflite"), we automatically handle preprocessing including image scaling, normalization (pixel values /255), and channel reordering (BGR→RGB). When using the TFLite Interpreter directly, you'll need to manually apply these preprocessing steps.

      For implementation details, please refer to our TFLite export documentation which explains the required input normalization and channel order. Ensure your input tensor matches the model's input shape (for current LiteRT exports (1,3,640,640) NCHW, for older onnx2tf exports (1,640,640,3) NHWC) with float32 dtype and normalized values; the YOLO class also letterboxes the image rather than stretching it.

    2. Glenn JocherUltralytics(已编辑)

      Great observation! When using the TFLite Interpreter directly, you'll need to manually replicate the preprocessing steps our YOLO class handles automatically. Ensure you're resizing images to the export size, normalizing pixel values to 0-1 (divide by 255), and converting BGR→RGB before inference. The input tensor should match the model's input shape (for current LiteRT exports (1,3,640,640) NCHW, for older onnx2tf exports (1,640,640,3) NHWC) with float32 dtype. Resize by letterboxing (padding to keep aspect ratio) as YOLO does. For implementation details, refer to our TFLite preprocessing requirements.