Começar

Como executar Ultralytics YOLO26 em um Raspberry Pi com um Coral Edge TPU

Raspberry Pi with Edge TPU accelerator

O Raspberry Pi é uma plataforma eficiente em termos de energia e acessível para executar visão computacional na borda, mas a inferência no próprio dispositivo é lenta, mesmo com formatos otimizados como ONNX ou OpenVINO. Ao emparelhar o Pi com um coprocessador Coral Edge TPU, a inferência é transferida para hardware dedicado e acelerada significativamente. Este guia mostra como instalar o ambiente de execução, exportar um modelo Ultralytics YOLO26 para o formato Edge TPU e executar inferência acelerada.



Assista: Como executar inferência no Raspberry Pi usando Google Coral Edge TPU

Por que usar um Coral Edge TPU?#

O Coral Edge TPU é um dispositivo compacto que adiciona um coprocessador Edge TPU ao teu sistema, permitindo inferência de ML de alto desempenho e baixo consumo de energia para modelos TensorFlow Lite. É adequado para implementações embarcadas e móveis em que uma CPU, por si só, não consegue acompanhar o ritmo:

  • Inferência mais rápida — o Edge TPU acelera modelos quantizados muito além do que a CPU do Raspberry Pi consegue alcançar sozinha.
  • Baixo consumo de energia — oferece alto desempenho por watt, ideal para implementações alimentadas por bateria ou energia solar.
  • Pronto para usar — o Acelerador USB conecta-se via USB 3.0, sem exigir integração de hardware adicional.
Runtime atualizado para a versão atual do TensorFlow Lite

O guia oficial do Coral está desatualizado: as compilações do runtime original do Coral já não funcionam com as versões atuais do runtime TensorFlow Lite, e o projeto não recebeu atualizações entre 2021 e 2025. Este guia usa um runtime Edge TPU mantido ativamente e a versão mais recente de tflite-runtime para que o acelerador funcione numa instalação atual do Raspberry Pi OS.

Pré-requisitos#

Este guia pressupõe que já tens uma instalação funcional do Raspberry Pi OS com ultralytics e as dependências instaladas. Se não for esse o caso, segue primeiro o guia de início rápido.

Com os pré-requisitos prontos, o fluxo de trabalho tem três etapas: instalar o runtime Edge TPU no Pi, exportar o modelo numa máquina Linux x86_64 e executar a inferência novamente no Pi.

Instalar o runtime Edge TPU#

O runtime está disponível em várias compilações; escolhe a que corresponde ao teu sistema operativo. A compilação de alta frequência executa o Edge TPU a uma velocidade de clock superior para oferecer melhor desempenho, mas pode causar limitação térmica — usa algum tipo de refrigeração se a escolheres.

Raspberry Pi OSModo de alta frequênciaVersão para transferência
Bullseye 32 bitsNãolibedgetpu1-std_ ... .bullseye_armhf.deb
Bullseye 64 bitsNãolibedgetpu1-std_ ... .bullseye_arm64.deb
Bullseye 32 bitsSimlibedgetpu1-max_ ... .bullseye_armhf.deb
Bullseye 64 bitsSimlibedgetpu1-max_ ... .bullseye_arm64.deb
Bookworm 32 bitsNãolibedgetpu1-std_ ... .bookworm_armhf.deb
Bookworm 64 bitsNãolibedgetpu1-std_ ... .bookworm_arm64.deb
Bookworm 32 bitsSimlibedgetpu1-max_ ... .bookworm_armhf.deb
Bookworm 64 bitsSimlibedgetpu1-max_ ... .bookworm_arm64.deb

Descarrega a versão mais recente na página de versões do libedgetpu e instala o pacote .deb:

sudo dpkg -i path/to/package.deb

Depois de instalar o runtime, liga o Coral Edge TPU a uma porta USB 3.0 do Raspberry Pi para que a nova regra udev entre em vigor.

Remove primeiro qualquer runtime existente

Se já tiveres o runtime Coral Edge TPU instalado, desinstala-o antes de instalar uma nova compilação.

# If you installed the standard version
sudo apt remove libedgetpu1-std

# If you installed the high-frequency version
sudo apt remove libedgetpu1-max

Exportar o modelo para o formato Edge TPU#

Para usar o Edge TPU, converte o teu modelo para o formato Edge TPU. Executa a exportação no Linux x86_64 — Google Colab, uma máquina Linux x86_64, o contentor Docker oficial do Ultralytics num anfitrião x86_64 ou a Ultralytics Platform — pois o compilador Edge TPU só está disponível no Linux x86_64.

Exportar o modelo
from ultralytics import YOLO

# Carregar um modelo
model = YOLO("path/to/model.pt")  # Carrega um modelo oficial ou um modelo personalizado

# Exporta o modelo
model.export(format="edgetpu")

O modelo exportado é guardado na pasta <model_name>_saved_model/ como <model_name>_full_integer_quant_edgetpu.tflite.

Mantém o sufixo `_edgetpu.tflite`

O nome do ficheiro tem de terminar com _edgetpu.tflite. Se lhe deres outro nome, a Ultralytics vai carregá-lo como um modelo LiteRT (.tflite) comum, em vez de detetar o Edge TPU, e o acelerador não será usado.

Executar inferência no Edge TPU#

Antes de executar o modelo, instala as bibliotecas corretas no Raspberry Pi. Se o TensorFlow já estiver instalado, desinstala-o primeiro:

pip uninstall tensorflow tensorflow-aarch64

Em seguida, instala ou atualiza tflite-runtime:

pip install -U tflite-runtime

Agora podes executar a inferência:

A executar o modelo
from ultralytics import YOLO

# Carregar um modelo
model = YOLO("path/to/yolo26n_full_integer_quant_edgetpu.tflite")  # Carrega um modelo oficial ou um modelo personalizado

# Executa a predição
model.predict("path/to/source.png")

Encontra todos os detalhes sobre o modo de predição na página Predict.

Inferência com vários Edge TPUs

Se tiveres vários Edge TPUs, podes selecionar um específico com o argumento device.

from ultralytics import YOLO

# Carregar um modelo
model = YOLO("path/to/yolo26n_full_integer_quant_edgetpu.tflite")  # Carrega um modelo oficial ou um modelo personalizado

# Executa a predição
model.predict("path/to/source.png")  # A inferência usa o primeiro TPU por predefinição

model.predict("path/to/source.png", device="tpu:0")  # Seleciona o primeiro TPU

model.predict("path/to/source.png", device="tpu:1")  # Seleciona o segundo TPU

Benchmarks#

Os valores abaixo foram medidos com Raspberry Pi OS Bookworm de 64 bits e um Coral Edge TPU USB. Mostram apenas o tempo de inferência (excluindo o pré-processamento e o pós-processamento) e servem como referência relativa para a aceleração proporcionada pelo Edge TPU nos diferentes modelos de Pi e modos.

Sobre estes valores

Estes benchmarks foram registados com modelos YOLOv8. Os tempos absolutos de inferência variam conforme a versão do modelo e o tamanho da imagem, mas os ganhos relativos de velocidade entre modelos de Pi e modos de clock mantêm-se.

Tamanho da imagemModeloTempo de inferência padrão (ms)Tempo de inferência em alta frequência (ms)
320YOLOv8n32.226.7
320YOLOv8s47.139.8
512YOLOv8n73.560.7
512YOLOv8s149.6125.3

Em média:

  • O Raspberry Pi 5 é 22% mais rápido do que o Raspberry Pi 4B no modo padrão.
  • O Raspberry Pi 5 é 30,2% mais rápido do que o Raspberry Pi 4B no modo de alta frequência.
  • O modo de alta frequência é 28,4% mais rápido do que o modo padrão.

Conclusão#

Um Coral Edge TPU transforma um Raspberry Pi num dispositivo de inferência capaz e de baixo consumo de energia para Ultralytics YOLO26. Exporta o modelo numa máquina Linux x86_64, mantém o sufixo _edgetpu.tflite e executa-o com tflite-runtime no Pi para obter inferência acelerada na borda. Para mais opções de implementação, consulta o guia Raspberry Pi.

Perguntas frequentes#

  • O Coral Edge TPU é um dispositivo compacto que adiciona um coprocessador Edge TPU ao teu sistema. Esse coprocessador permite inferência de ML de alto desempenho e baixo consumo de energia, especialmente otimizada para modelos TensorFlow Lite. Num Raspberry Pi, acelera a inferência muito além do que a CPU consegue alcançar sozinha, aumentando significativamente o desempenho dos modelos Ultralytics YOLO26.

  • Descarrega o pacote .deb adequado à tua versão do Raspberry Pi OS na página de versões do libedgetpu e instala-o:

    sudo dpkg -i path/to/package.deb

    Certifica-te de que desinstalas todas as versões anteriores do runtime Coral Edge TPU seguindo as etapas da seção Instalar o runtime Edge TPU.

  • Sim. Executa a exportação no Google Colab, numa máquina Linux x86_64 ou no contêiner Docker da Ultralytics; também podes usar a Plataforma Ultralytics. Vê como exportar com Python e CLI:

    Exportar o modelo
    from ultralytics import YOLO
    
    # Carregar um modelo
    model = YOLO("path/to/model.pt")  # Carrega um modelo oficial ou um modelo personalizado
    
    # Exporta o modelo
    model.export(format="edgetpu")

    Para mais informações, consulta a documentação do modo de exportação.

  • Se tiveres o TensorFlow instalado e precisares de mudar para tflite-runtime, desinstala primeiro o TensorFlow:

    pip uninstall tensorflow tensorflow-aarch64

    Em seguida, instala ou atualiza tflite-runtime:

    pip install -U tflite-runtime

    Para instruções detalhadas, consulta a seção Executar inferência no Edge TPU.

  • Depois de exportares o modelo YOLO26 para um formato compatível com o Edge TPU, executa a inferência com os trechos de código a seguir. O ficheiro do modelo tem de manter o sufixo _edgetpu.tflite para que a Ultralytics o carregue no Edge TPU:

    A executar o modelo
    from ultralytics import YOLO
    
    # Carregar um modelo
    model = YOLO("path/to/yolo26n_full_integer_quant_edgetpu.tflite")  # Carrega um modelo oficial ou um modelo personalizado
    
    # Executa a predição
    model.predict("path/to/source.png")

    Encontra todos os detalhes sobre o modo de predição na página Predict.

Comentários205

Faz uma pergunta, partilha os teus resultados ou ajuda alguém.

  1. DAVIDNYARKO123GitHub

    I encountered similar challenges and ultimately developed a "solution". I contribute to a PyPI package designed to support the Ultralytics community, specifically for Raspberry Pi users employing the EDGE TPU USB Accelerator. This package simplifies the setup process by ensuring the correct versions of necessary runtimes are installed with just a single pip and setup command. It also provides several default YOLO models for immediate download and experimentation.

    I hope this information is useful to you.

    GitHub:

    https://github.com/DAVIDNYARKO123/edge-tpu-silva

    PyPi:

    https://pypi.org/project/edge-tpu-silva/

    YouTube:

    https://www.youtube.com/watch?v=sOxQTRRh9tw

    I just posted the video above after seeing this post.
    5
    1. Paula DerrengerUltralytics

      Hey there! 🌟 Thanks for sharing your work on the edge-tpu-silva package - it sounds like a fantastic resource for the community, especially for those working with Raspberry Pi and the Coral Edge TPU. Your effort to simplify the setup process and provide readily available YOLO models is much appreciated. 🙏

      For anyone interested in leveraging the power of Coral's Edge TPU on a Raspberry Pi, this package could be a great starting point. I'll definitely check out your YouTube video for a deeper dive into how it all works. 📺💡

      Please keep up the great work, and feel free to reach out if you think there are ways we could collaborate or further support your efforts. The link to our guide on using Ultralytics YOLOv8 with a Coral Edge TPU on a Raspberry Pi might also complement your solution: Coral Edge TPU on Raspberry Pi with Ultralytics YOLOv8.

      Best of luck with your project, and looking forward to seeing more from you! 🚀

      2
    2. DAVIDNYARKO123GitHub

      Hey there! 🌟 Thanks for sharing your work on the edge-tpu-silva package - it sounds like a fantastic resource for the community, especially for those working with Raspberry Pi and the Coral Edge TPU. Your effort to simplify the setup process and provide readily available YOLO models is much appreciated. 🙏

      For anyone interested in leveraging the power of Coral's Edge TPU on a Raspberry Pi, this package could be a great starting point. I'll definitely check out your YouTube video for a deeper dive into how it all works. 📺💡

      Please keep up the great work, and feel free to reach out if you think there are ways we could collaborate or further support your efforts. The link to our guide on using Ultralytics YOLOv8 with a Coral Edge TPU on a Raspberry Pi might also complement your solution: Coral Edge TPU on Raspberry Pi with Ultralytics YOLOv8.

      Best of luck with your project, and looking forward to seeing more from you! 🚀

      Hello @pderrenger Thank you for the encouraging words! ✨I’m glad you found the edge-tpu-silva package interesting and I’m eager to explore the guide you provided. It was a great complement and inspiration to this work.

      I’m open to collaborating and would love to discuss how we can support this project. Looking forward to connecting soon! 🚀

    3. StefansAIGitHub

      Hi David,

      I tried your approach. I always start from a new SD card image of the 64bit Bookworm in the RPi5 and then run the suggested commands. In your case it is:

      python3 -m venv .venv
      source .venv/bin/activate
      pip install edge-tpu-silva
      silvatpu-linux-setup

      Then I downloaded the first of your exported models and run this line:

      silvatpu -p det -m Downloads/240_yolov8n_full_integer_quant_edgetpu.tflite -i /dev/video0 -z 240 -t 0.5 -v True

      Then I get this error:

      (.venv) pi@pi5:~ $ silvatpu -p det -m Downloads/240_yolov8n_full_integer_quant_edgetpu.tflite -i /dev/video0 -z 240 -t 0.5 -v True
      Traceback (most recent call last):
        File "/home/pi/.venv/lib/python3.11/site-packages/ultralytics/nn/autobackend.py", line 321, in __init__
          from tflite_runtime.interpreter import Interpreter, load_delegate
      ModuleNotFoundError: No module named 'tflite_runtime'
      
      During handling of the above exception, another exception occurred:
      
      Traceback (most recent call last):
        File "/home/pi/.venv/bin/silvatpu", line 8, in <module>
          sys.exit(silvatpu())
                   ^^^^^^^^^^
        File "/home/pi/.venv/lib/python3.11/site-packages/edge_tpu_silva/__main__.py", line 97, in silvatpu
          for _, _ in outs:
        File "/home/pi/.venv/lib/python3.11/site-packages/edge_tpu_silva/silva/silva_detect.py", line 38, in process_detection
          outs = model.predict(
                 ^^^^^^^^^^^^^^
        File "/home/pi/.venv/lib/python3.11/site-packages/ultralytics/engine/model.py", line 445, in predict
          self.predictor.setup_model(model=self.model, verbose=is_cli)
        File "/home/pi/.venv/lib/python3.11/site-packages/ultralytics/engine/predictor.py", line 297, in setup_model
          self.model = AutoBackend(
                       ^^^^^^^^^^^^
        File "/home/pi/.venv/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
          return func(*args, **kwargs)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/home/pi/.venv/lib/python3.11/site-packages/ultralytics/nn/autobackend.py", line 323, in __init__
          import tensorflow as tf
      ModuleNotFoundError: No module named 'tensorflow'

      I then tried to install tensorflow-aarch64==2.13.1, but ran into problems with dependencies of h5py. Any thoughts?

    4. DAVIDNYARKO123GitHub

      Hi @StefansAI I will be glad to assist. Please what was the terminal output after running the setup command:

      silvatpu-linux-setup

      Did you see a message indicating successful installation, including the runtime version, at the end of the setup process?

      Please list your Python version.

      Be sure to use the recommended Python versions. As well as your apt-get is updated and upraded

      sudo apt-get update
      sudo apt-get upgrade
    5. Decoo13GitHub

      Hey David, thanks again for the information!

      everything went smoothly for me I followed the README instructiions and everything worked well on my end. I would like to note that I did place everything in the home directory to make things simpler in terms of placing the correct path for each of the files.

    6. Paula DerrengerUltralytics

      Hey David,

      That's fantastic to hear! 🚀 Glad the setup went smoothly for you. Placing everything in the home directory can indeed simplify managing paths, especially for newcomers. It's a practical tip that could benefit many users, so thanks for highlighting it!

      For anyone else following this thread, remember to check the Raspberry Pi model and OS compatibility, especially for tasks involving hardware accelerators like the Coral Edge TPU. Our documentation provides a detailed guide for setups like these, ensuring you get the best performance out of your Edge TPU and Raspberry Pi combo.

      Keep exploring and sharing your insights, David! If you've got more questions or run into hiccups, feel free to drop them here. 🌟

  2. suprimexGitHub

    Any export above version 9 failed with message from edgetpu_compiler:

    ERROR: Didn't find op for builtin opcode 'CONV_2D' version '6'. An older version of this builtin might be supported. Are you using an old TFLite binary with a newer model?

    ERROR: Registration failed.

    Invalid model: yolov10n_saved_model/yolov10n_full_integer_quant.tflite Model could not be parsed

    1
  3. zoldatenGitHub

    to get it working (USB Asselerator) on raspberry pi 4b (Bullseye or Bookworm):

    1. do not use https://github.com/feranick/libedgetpu, do not follow instruction from ultralytics on HOW TO INSTALL coral usb asselerator from this page - it leads to Segmentation fault (i checked it out on my pi).

    follow official https://coral.ai/docs/accelerator/get-started/#requirements to install on Linux.

    After that:

    Download pycoral-2.0.0-cp39-cp39-linux_aarch64.whl and tflite_runtime-2.5.0.post1-cp39-cp39-linux_aarch64.whl from https://github.com/google-coral/pycoral/releases/tag/v2.0.0 pip install ./pycoral-2.0.0-cp39-cp39-linux_aarch64.whl pip install ./tflite_runtime-2.5.0.post1-cp39-cp39-linux_aarch64.whl

    1. i have updated example from @DAVIDNYARKO123 to use yolov8 with image not video file:
    from edge_tpu_silva import process_detection
    import cv2,time
    import numpy as np
    from ultralytics import YOLO
    
    # Example Usage with Required Parameters
    #model_path = '240_yolov8n_full_integer_quant_edgetpu.tflite'
    #input_path = 'path/to/your/input/video.mp4'
    input_path = 'obama.jpg'
    imgsz = 240
    
    model = YOLO(model='240_yolov8n_full_integer_quant_edgetpu.tflite', task="detect", verbose=False)
    
    input_path=cv2.imread(input_path)
    print(input_path.shape)
    input_path = input_path[:,:,:3]
    #image = cv2.resize(np_array, (240, 240))
    
    #input_path = np.expand_dims(input_path, axis=0)
    
    # Run the object detection process
    start_time = time.time()
    outs = model.predict(
        source=input_path,
        conf=0.5,
        imgsz=imgsz,
        verbose=False,
        stream=False,
        show=True,    )
    #outs = process_detection(model_path, input_path, imgsz, show=True)
    
    
    #frame_count = 0
    start_time = time.time()
    for out in outs:
        
        objs_lst = []
        for box in out.boxes:
            obj_cls, conf, bb = (
                box.cls.numpy()[0],
                box.conf.numpy()[0],
                box.xyxy.numpy()[0],
            )
            label = out.names[int(obj_cls)]
            ol = {
                "id": obj_cls,
                "label": label,
                "conf": conf,
                "bbox": bb,
            }
            objs_lst.append(ol)
    
            
            print(label)
            #print("  id:    ", obj_cls)
            #print("  score: ", conf)
            #print("  bbox:  ", bb)
    
        #frame_count += 1
        #elapsed_time = time.time() - start_time
        #fps = frame_count / elapsed_time
    
        #print (objs_lst, fps)
        print (objs_lst)
        print("--- %s seconds ---" % (time.time() - start_time))
    
        # Break the loop if 'esc' key is pressed for video or camera
        if cv2.waitKey(1) == 27:
            break
    #for _, _ in outs:
      #pass

    you can also see example with picamera2 on Bullseye - https://youtu.be/37PwrRVP9j4

    1. there is a problem with Coral USB on Raspbian Bookworm as it uses python3.11 as system default. It could be solved with pyenv or venv but there will be a problem with picamera2 as it uses libcamera. So only i got reached there - gstreamer using instead picamera2.

    Have a nice day.

    1
    1. zoldatenGitHub

      i also tried to convert by hands yolov8m to edgetpu on another linux PC:

      yolo export model=yolov8m.pt imgsz=640

      and got this:

      Operation log: yolov8m_saved_model/yolov8m_full_integer_quant_edgetpu.log
      
      Model successfully compiled but not all operations are supported by the Edge TPU. A percentage of the                                                       model will instead run on the CPU, which is slower. If possible, consider updating your model to use o                                                      nly operations supported by the Edge TPU. For details, visit g.co/coral/model-reqs.
      Number of operations that will run on Edge TPU: 297
      Number of operations that will run on CPU: 26
      
      Operator                       Count      Status
      
      PAD                            7          Mapped to Edge TPU
      TRANSPOSE                      1          Mapped to Edge TPU
      TRANSPOSE                      4          Operation is otherwise supported, but not mapped due to some                                                       unspecified limitation
      STRIDED_SLICE                  2          More than one subgraph is not supported
      STRIDED_SLICE                  16         Mapped to Edge TPU
      STRIDED_SLICE                  2          Operation is otherwise supported, but not mapped due to some                                                       unspecified limitation
      RESHAPE                        2          More than one subgraph is not supported
      RESHAPE                        1          Mapped to Edge TPU
      RESHAPE                        3          Operation is otherwise supported, but not mapped due to some                                                       unspecified limitation
      MUL                            77         Mapped to Edge TPU
      MUL                            2          More than one subgraph is not supported
      SUB                            2          More than one subgraph is not supported
      CONCATENATION                  16         Mapped to Edge TPU
      CONCATENATION                  1          More than one subgraph is not supported
      CONCATENATION                  2          Operation is otherwise supported, but not mapped due to some                                                       unspecified limitation
      SOFTMAX                        1          More than one subgraph is not supported
      RESIZE_NEAREST_NEIGHBOR        2          Mapped to Edge TPU
      CONV_2D                        1          More than one subgraph is not supported
      CONV_2D                        83         Mapped to Edge TPU
      QUANTIZE                       1          Operation is otherwise supported, but not mapped due to some                                                       unspecified limitation
      QUANTIZE                       2          Mapped to Edge TPU
      MAX_POOL_2D                    3          Mapped to Edge TPU
      ADD                            2          More than one subgraph is not supported
      ADD                            12         Mapped to Edge TPU
      LOGISTIC                       1          Operation is otherwise supported, but not mapped due to some                                                       unspecified limitation
      LOGISTIC                       77         Mapped to Edge TPU
      Compilation child process completed within timeout period.
      Compilation succeeded!

      after test on raspberry in the same code (as above):

      Loading yolov8m_full_integer_quant_edgetpu.tflite for TensorFlow Lite Edge TPU inference...
      F driver/usb/usb_driver.cc:857] transfer on tag 1 failed. Abort. Deadline exceeded: USB transfer error 2 [LibUsbDataOutCallback]
      
      Process ended with exit code -6.

      and leads to hang on Coral USB ...

    2. zoldatenGitHub

      ok. fixed issue with conversion. should be: yolo export model=yolov8m.pt imgsz=224 not yolo export model=yolov8m.pt imgsz=640

      image size matter. hmm.

    3. Glenn JocherUltralytics

      @zoldaten great catch on the image size adjustment for the model export! Indeed, the input size can significantly impact the compatibility and performance of the model on the Edge TPU. Using an image size of 224 for yolov8m.pt seems to be more effective for your setup.

      Thanks for sharing this update; it's a valuable tip for others working in similar configurations. If you encounter any more insights or need further assistance, feel free to reach out. Happy coding! 🚀

    4. SkillnoobGitHubUltralytics

      Hey @zoldaten Im the one who wrote this guide and you getting a segmentation fault with this guide is unusual, since it is made to prevent the segmentation fault many people got because of the libedgetpu version that is out of date by 3 years. The version by feranic was specifically made to fix this issue and the changes are also now merged into the official libedgetpu repository. I am using feranic's version and it works fine for me on both my RPI 5 and 4B. The coral tpu doesn't work well with a imgsz of 640 and maps most of the OP's to the cpu. Additionally I had issues running models larger than s because they would exceed the 8MB cache limit of the tpu. Here's some benchmark results I posted: https://github.com/ultralytics/ultralytics/issues/8035 I always had to use a imgsz of 512 or lower for it to not run at CPU speeds.

  4. reza8iucsGitHub(editado)

    Got the Coral working on a Raspberry Pi 5 / Debian 13 (Bookworm/Trixie) / Python 3.13 after the "parrot test" failed for weeks — here's the fix this guide is missing:

    The No.1 reason Failed to load delegate from libedgetpu.so.1 happens (even when the device is detected and permissions are fine) is that libedgetpu and tflite-runtime must be built from the same TensorFlow version. This guide has you install them from two separate places (libedgetpu from Feranick's .deb, tflite-runtime from pip -U), and "latest + latest" almost never matches — so the delegate refuses to load. Pin both to the same TF version.

    Working combo for me (June 2026):

    • libedgetpu1-std tag 16.0TF2.17.1 (Feranick build, pick your Debian codename + arm64)
    • tflite_runtime 2.17.1 (Feranick build)
    • numpy < 2 (tflite-runtime 2.17.1 is compiled against NumPy 1.x and crashes on NumPy 2)

    Two more gotchas on a modern Pi:

    1. Python 3.13 has no tflite-runtime/pycoral wheel (official tops out at 3.9; Feranick at 3.12). I ran the Coral stack on a separate Python 3.12 via uv (uv python install 3.12) and it worked perfectly.
    2. Debian 12/13 block system-wide pip (PEP 668) — use a venv.

    Quick steps:

    1. runtime (match the TF version!)

    sudo apt install ./libedgetpu1-std_16.0tf2.17.1-1._arm64.deb # from github.com/feranick/libedgetpu

    2. python 3.12 venv

    uv python install 3.12 && uv venv ~/coral/venv --python 3.12

    3. matching tflite-runtime + numpy<2 (wheel from github.com/feranick/TFlite-builds)

    uv pip install --python ~/coral/venv/bin/python
    tflite_runtime-2.17.1-cp312-cp312-linux_aarch64.whl "numpy<2" pillow

    Then the parrot test prints macaw and you're done. The rule to remember: same TF version on both halves, a Python the wheel exists for, and numpy<2.

    Hope this helps

  5. kiven-mailboxGitHub

    Hi, I am converting my Yolo11n model to edgetpu.tflite but the case is that when I run the yolo11n model in my pi it is very accurate but very slow it only got 2.50 fps so then I converted it to edgetpu.tflite it run smoothly with 10 fps with the coral usb accelerator but the detection loss its accuracy so then i tried retraining my model's dataset and set to 320 instead of 640 and then I converted it to edgetpu.tflite with imgsz=320 as they said to maintain the accuracy but the accuracy still not the same it detects object wrong object and not what it trained for.

    1. SkillnoobGitHubUltralytics

      Can you try adding the data argument when exporting and have it point to your dataset yaml so it can calibrate?

      ...
      
      model.export(format='edgetpu', imgsz=320, data='data.yaml')
      1
    2. kiven-mailboxGitHub

      Oh okay, I’ll try adding the data argument and point it to my dataset YAML file. Hopefully that helps with the calibration. Thanks for the heads-up!

    3. kiven-mailboxGitHub(editado)

      Hi the result is the same.

      from ultralytics import YOLO
      
      # Load the YOLO11 model
      model = YOLO("yolo11n.pt")
      
      # Export the model to TFLite Edge TPU format
      model.export(format="edgetpu", imgsz=320, data='data.yaml')  # creates 'yolo11n_full_integer_quant_edgetpu.tflite'

      Result

      Creating new Ultralytics Settings v0.0.6 file ✅ 
      View Ultralytics Settings with 'yolo settings' or at '/root/.config/Ultralytics/settings.json'
      Update Settings with 'yolo settings key=value', i.e. 'yolo settings runs_dir=path/to/dir'. For help see https://docs.ultralytics.com/quickstart/#ultralytics-settings.
      Ultralytics 8.3.152 🚀 Python-3.11.13 torch-2.6.0+cu124 CPU (Intel Xeon 2.20GHz)
      💡 ProTip: Export to OpenVINO format for best performance on Intel CPUs. Learn more at https://docs.ultralytics.com/integrations/openvino/
      YOLO11n summary (fused): 100 layers, 2,583,517 parameters, 0 gradients, 6.3 GFLOPs
      
      PyTorch: starting from 'yolo11n.pt' with input shape (1, 3, 320, 320) BCHW and output shape(s) (1, 11, 2100) (5.2 MB)
      requirements: Ultralytics requirements ['sng4onnx>=1.0.1', 'onnx_graphsurgeon>=0.3.26', 'ai-edge-litert>=1.2.0', 'onnx>=1.12.0,<1.18.0', 'onnx2tf>=1.26.3', 'onnxslim>=0.1.56', 'onnxruntime'] not found, attempting AutoUpdate...
      
      requirements: AutoUpdate success ✅ 8.7s
      WARNING ⚠️ requirements: Restart runtime or rerun command for updates to take effect
      
      
      TensorFlow SavedModel: starting export with tensorflow 2.18.0...
      Downloading https://github.com/ultralytics/assets/releases/download/v8.3.0/calibration_image_sample_data_20x128x128x3_float32.npy.zip to 'calibration_image_sample_data_20x128x128x3_float32.npy.zip'...
      100%|██████████| 1.11M/1.11M [00:00<00:00, 163MB/s]
      Unzipping calibration_image_sample_data_20x128x128x3_float32.npy.zip to /content/calibration_image_sample_data_20x128x128x3_float32.npy...: 100%|██████████| 1/1 [00:00<00:00, 34.85file/s]
      
      ONNX: starting export with onnx 1.17.0 opset 19...
      ONNX: slimming with onnxslim 0.1.56...
      ONNX: export success ✅ 4.9s, saved as 'yolo11n.onnx' (10.0 MB)
      TensorFlow SavedModel: collecting INT8 calibration images from 'data=data.yaml'
      Downloading https://ultralytics.com/assets/Arial.ttf to '/root/.config/Ultralytics/Arial.ttf'...
      100%|██████████| 755k/755k [00:00<00:00, 108MB/s]Fast image access ✅ (ping: 0.0±0.0 ms, read: 2612.2±485.1 MB/s, size: 560.8 KB)
      
      Scanning /content/content/data/validation/labels... 129 images, 0 backgrounds, 0 corrupt: 100%|██████████| 129/129 [00:00<00:00, 1043.00it/s]New cache created: /content/content/data/validation/labels.cache
      WARNING ⚠️ TensorFlow SavedModel: >300 images recommended for INT8 calibration, found 129 images.
      
      TensorFlow SavedModel: starting TFLite export with onnx2tf 1.27.10...
      Saved artifact at 'yolo11n_saved_model'. The following endpoints are available:
      
      * Endpoint 'serving_default'
        inputs_0 (POSITIONAL_ONLY): TensorSpec(shape=(1, 320, 320, 3), dtype=tf.float32, name='images')
      Output Type:
        TensorSpec(shape=(1, 11, 2100), dtype=tf.float32, name=None)
      Captures:
        135841429101968: TensorSpec(shape=(4, 2), dtype=tf.int32, name=None)
        135841429100240: TensorSpec(shape=(3, 3, 3, 16), dtype=tf.float32, name=None)
        135841429102352: TensorSpec(shape=(16,), dtype=tf.float32, name=None)
        135841429103888: TensorSpec(shape=(4, 2), dtype=tf.int32, name=None)
        135841429106576: TensorSpec(shape=(3, 3, 16, 32), dtype=tf.float32, name=None)
        135841429107152: TensorSpec(shape=(32,), dtype=tf.float32, name=None)
        135841429106192: TensorSpec(shape=(1, 1, 32, 32), dtype=tf.float32, name=None)
        135841429107536: TensorSpec(shape=(32,), dtype=tf.float32, name=None)
        135841429108112: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841429107920: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841429110416: TensorSpec(shape=(3, 3, 16, 8), dtype=tf.float32, name=None)
        135841429109840: TensorSpec(shape=(8,), dtype=tf.float32, name=None)
        135841429107728: TensorSpec(shape=(3, 3, 8, 16), dtype=tf.float32, name=None)
        135841429107344: TensorSpec(shape=(16,), dtype=tf.float32, name=None)
        135841429108304: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841429108496: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841429109648: TensorSpec(shape=(1, 1, 48, 64), dtype=tf.float32, name=None)
        135841429109072: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841408582288: TensorSpec(shape=(4, 2), dtype=tf.int32, name=None)
        135841408582096: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841408581904: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841408582480: TensorSpec(shape=(1, 1, 64, 64), dtype=tf.float32, name=None)
        135841408582864: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841408583632: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841408583248: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841408584208: TensorSpec(shape=(3, 3, 32, 16), dtype=tf.float32, name=None)
        135841408585552: TensorSpec(shape=(16,), dtype=tf.float32, name=None)
        135841408583056: TensorSpec(shape=(3, 3, 16, 32), dtype=tf.float32, name=None)
        135841408583440: TensorSpec(shape=(32,), dtype=tf.float32, name=None)
        135841408582672: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841408583824: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841408585744: TensorSpec(shape=(1, 1, 96, 128), dtype=tf.float32, name=None)
        135841408585936: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841408584976: TensorSpec(shape=(4, 2), dtype=tf.int32, name=None)
        135841408584400: TensorSpec(shape=(3, 3, 128, 128), dtype=tf.float32, name=None)
        135841408584784: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841408586128: TensorSpec(shape=(1, 1, 128, 128), dtype=tf.float32, name=None)
        135841408586512: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841408587088: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841408586896: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841408587856: TensorSpec(shape=(1, 1, 64, 32), dtype=tf.float32, name=None)
        135841408589200: TensorSpec(shape=(32,), dtype=tf.float32, name=None)
        135841408589584: TensorSpec(shape=(3, 3, 32, 32), dtype=tf.float32, name=None)
        135841408589392: TensorSpec(shape=(32,), dtype=tf.float32, name=None)
        135841408586320: TensorSpec(shape=(3, 3, 32, 32), dtype=tf.float32, name=None)
        135841408588624: TensorSpec(shape=(32,), dtype=tf.float32, name=None)
        135841408589968: TensorSpec(shape=(3, 3, 32, 32), dtype=tf.float32, name=None)
        135841408590160: TensorSpec(shape=(32,), dtype=tf.float32, name=None)
        135841408588432: TensorSpec(shape=(3, 3, 32, 32), dtype=tf.float32, name=None)
        135841408586704: TensorSpec(shape=(1, 1, 64, 32), dtype=tf.float32, name=None)
        135841408590352: TensorSpec(shape=(32,), dtype=tf.float32, name=None)
        135841408588048: TensorSpec(shape=(32,), dtype=tf.float32, name=None)
        135841408590928: TensorSpec(shape=(1, 1, 64, 64), dtype=tf.float32, name=None)
        135841408590736: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841408587280: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841408587472: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841408591120: TensorSpec(shape=(1, 1, 192, 128), dtype=tf.float32, name=None)
        135841408589776: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841408591696: TensorSpec(shape=(4, 2), dtype=tf.int32, name=None)
        135841408591312: TensorSpec(shape=(3, 3, 128, 256), dtype=tf.float32, name=None)
        135841408591888: TensorSpec(shape=(256,), dtype=tf.float32, name=None)
        135841408590544: TensorSpec(shape=(1, 1, 256, 256), dtype=tf.float32, name=None)
        135841408592464: TensorSpec(shape=(256,), dtype=tf.float32, name=None)
        135841408592656: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841408592272: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841408593424: TensorSpec(shape=(1, 1, 128, 64), dtype=tf.float32, name=None)
        135841408594768: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841408595152: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841408594960: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841408592080: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841408594192: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841408595536: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841408595728: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841408594000: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841408591504: TensorSpec(shape=(1, 1, 128, 64), dtype=tf.float32, name=None)
        135841408595920: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841408593616: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841408596496: TensorSpec(shape=(1, 1, 128, 128), dtype=tf.float32, name=None)
        135841408596304: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841408592848: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841408593040: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841408596688: TensorSpec(shape=(1, 1, 384, 256), dtype=tf.float32, name=None)
        135841408595344: TensorSpec(shape=(256,), dtype=tf.float32, name=None)
        135841408596880: TensorSpec(shape=(1, 1, 256, 128), dtype=tf.float32, name=None)
        135841408597072: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841408597456: TensorSpec(shape=(1, 1, 512, 256), dtype=tf.float32, name=None)
        135841408597264: TensorSpec(shape=(256,), dtype=tf.float32, name=None)
        135841408597648: TensorSpec(shape=(1, 1, 256, 256), dtype=tf.float32, name=None)
        135841408596112: TensorSpec(shape=(256,), dtype=tf.float32, name=None)
        135841408597840: TensorSpec(shape=(1, 1, 128, 256), dtype=tf.float32, name=None)
        135841396982032: TensorSpec(shape=(256,), dtype=tf.float32, name=None)
        135841396983760: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396983568: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396982224: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396984144: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396984336: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396983376: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396983952: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396983184: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396982608: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396984720: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396984528: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396982800: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396984912: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396985104: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396985296: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396985488: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396985680: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396985872: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396986064: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396986256: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396986448: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396986640: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396986832: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396987024: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396987216: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396987408: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396987600: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396987792: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396987984: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396988176: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396988368: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396988560: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396988752: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396988944: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396989136: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396989328: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396989520: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396989712: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396989904: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396990096: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396990288: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396990480: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396990672: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396990864: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396991056: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396991248: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396991440: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396991632: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396991824: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396992016: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396992208: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396992400: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396992592: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396992784: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396992976: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396993168: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396993360: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396993552: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396993744: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396993936: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396994128: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396994320: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396994512: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396994704: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396994896: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396995088: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396995280: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396995472: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396995664: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396995856: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396996048: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396996240: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396996432: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396996624: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396996816: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396997008: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396997200: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396997392: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396997584: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396997776: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396997968: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388822608: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388822800: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388822992: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388823184: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388823376: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388823568: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388823760: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388823952: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388824144: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388824336: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388824528: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388824720: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388824912: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388825104: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388825296: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388825488: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388825680: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388825872: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388826064: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388826256: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388826448: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388826640: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388826832: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388827024: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388827216: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388827408: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388827600: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388827792: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388827984: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388828176: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388828368: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388828560: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388828752: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388828944: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388829136: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388829328: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388829520: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388829712: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388829904: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388830096: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388830288: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388830480: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388830672: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388830864: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388831056: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388831248: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841388831440: TensorSpec(shape=(3, 3, 1, 1), dtype=tf.float32, name=None)
        135841396982416: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841396982992: TensorSpec(shape=(1, 1, 128, 128), dtype=tf.float32, name=None)
        135841388832400: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841388834128: TensorSpec(shape=(1, 1, 128, 256), dtype=tf.float32, name=None)
        135841388832208: TensorSpec(shape=(256,), dtype=tf.float32, name=None)
        135841388833168: TensorSpec(shape=(1, 1, 256, 128), dtype=tf.float32, name=None)
        135841388832592: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841388832976: TensorSpec(shape=(1, 1, 256, 256), dtype=tf.float32, name=None)
        135841388831632: TensorSpec(shape=(256,), dtype=tf.float32, name=None)
        135841388832016: TensorSpec(shape=(1, 1, 384, 128), dtype=tf.float32, name=None)
        135841388834320: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841388833552: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841388833936: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841388834896: TensorSpec(shape=(3, 3, 64, 32), dtype=tf.float32, name=None)
        135841388836240: TensorSpec(shape=(32,), dtype=tf.float32, name=None)
        135841388833744: TensorSpec(shape=(3, 3, 32, 64), dtype=tf.float32, name=None)
        135841388833360: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841388832784: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841388834512: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841388836432: TensorSpec(shape=(1, 1, 192, 128), dtype=tf.float32, name=None)
        135841388836624: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841388835088: TensorSpec(shape=(1, 1, 256, 64), dtype=tf.float32, name=None)
        135841388835664: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841388837200: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841388837008: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841388838736: TensorSpec(shape=(3, 3, 32, 16), dtype=tf.float32, name=None)
        135841388836816: TensorSpec(shape=(16,), dtype=tf.float32, name=None)
        135841388838160: TensorSpec(shape=(3, 3, 16, 32), dtype=tf.float32, name=None)
        135841388838544: TensorSpec(shape=(32,), dtype=tf.float32, name=None)
        135841388837392: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841388837584: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841388837968: TensorSpec(shape=(1, 1, 96, 64), dtype=tf.float32, name=None)
        135841388835472: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349337744: TensorSpec(shape=(4, 2), dtype=tf.int32, name=None)
        135841349337552: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841349337936: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349339664: TensorSpec(shape=(1, 1, 192, 128), dtype=tf.float32, name=None)
        135841349339856: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841349340432: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841349341200: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841349343504: TensorSpec(shape=(3, 3, 64, 32), dtype=tf.float32, name=None)
        135841349341008: TensorSpec(shape=(32,), dtype=tf.float32, name=None)
        135841349343888: TensorSpec(shape=(3, 3, 32, 64), dtype=tf.float32, name=None)
        135841349343696: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349341584: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841349341776: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841349344080: TensorSpec(shape=(1, 1, 192, 128), dtype=tf.float32, name=None)
        135841349345616: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841349344272: TensorSpec(shape=(4, 2), dtype=tf.int32, name=None)
        135841349345040: TensorSpec(shape=(3, 3, 128, 128), dtype=tf.float32, name=None)
        135841349344656: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841349346768: TensorSpec(shape=(1, 1, 384, 256), dtype=tf.float32, name=None)
        135841349346960: TensorSpec(shape=(256,), dtype=tf.float32, name=None)
        135841349347536: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841349348304: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841349350608: TensorSpec(shape=(1, 1, 128, 64), dtype=tf.float32, name=None)
        135841349348112: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349351184: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841349350800: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349352336: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841349352528: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349353104: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841349351568: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349352720: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841349349456: TensorSpec(shape=(1, 1, 128, 64), dtype=tf.float32, name=None)
        135841349345424: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349349264: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349353296: TensorSpec(shape=(1, 1, 128, 128), dtype=tf.float32, name=None)
        135841349352912: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841349348688: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841349348880: TensorSpec(shape=(4,), dtype=tf.int64, name=None)
        135841349351376: TensorSpec(shape=(1, 1, 384, 256), dtype=tf.float32, name=None)
        135841349351760: TensorSpec(shape=(256,), dtype=tf.float32, name=None)
        135841335984400: TensorSpec(shape=(3, 3, 256, 1), dtype=tf.float32, name=None)
        135841349346000: TensorSpec(shape=(3, 3, 128, 1), dtype=tf.float32, name=None)
        135841349338896: TensorSpec(shape=(3, 3, 64, 1), dtype=tf.float32, name=None)
        135841349344848: TensorSpec(shape=(256,), dtype=tf.float32, name=None)
        135841349344464: TensorSpec(shape=(128,), dtype=tf.float32, name=None)
        135841349338512: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841335984784: TensorSpec(shape=(1, 1, 256, 64), dtype=tf.float32, name=None)
        135841349346576: TensorSpec(shape=(1, 1, 128, 64), dtype=tf.float32, name=None)
        135841349339280: TensorSpec(shape=(1, 1, 64, 64), dtype=tf.float32, name=None)
        135841335984976: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349346192: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349338704: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841335985936: TensorSpec(shape=(3, 3, 64, 1), dtype=tf.float32, name=None)
        135841349351952: TensorSpec(shape=(3, 3, 256, 64), dtype=tf.float32, name=None)
        135841349347920: TensorSpec(shape=(3, 3, 64, 1), dtype=tf.float32, name=None)
        135841349342928: TensorSpec(shape=(3, 3, 128, 64), dtype=tf.float32, name=None)
        135841349340816: TensorSpec(shape=(3, 3, 64, 1), dtype=tf.float32, name=None)
        135841349338128: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841335985168: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349352144: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349347152: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349345808: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349340048: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349338320: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841335986320: TensorSpec(shape=(1, 1, 64, 64), dtype=tf.float32, name=None)
        135841335984208: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841349348496: TensorSpec(shape=(1, 1, 64, 64), dtype=tf.float32, name=None)
        135841349346384: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841349342352: TensorSpec(shape=(1, 1, 64, 64), dtype=tf.float32, name=None)
        135841349339472: TensorSpec(shape=(3, 3, 64, 64), dtype=tf.float32, name=None)
        135841335985360: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841335984592: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349349840: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349345232: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349342160: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349339088: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841335986512: TensorSpec(shape=(1, 1, 64, 7), dtype=tf.float32, name=None)
        135841335985552: TensorSpec(shape=(1, 1, 64, 64), dtype=tf.float32, name=None)
        135841349350992: TensorSpec(shape=(1, 1, 64, 7), dtype=tf.float32, name=None)
        135841349347728: TensorSpec(shape=(1, 1, 64, 64), dtype=tf.float32, name=None)
        135841349341392: TensorSpec(shape=(1, 1, 64, 7), dtype=tf.float32, name=None)
        135841349340624: TensorSpec(shape=(1, 1, 64, 64), dtype=tf.float32, name=None)
        135841335985744: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841335986704: TensorSpec(shape=(7,), dtype=tf.float32, name=None)
        135841349347344: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349350032: TensorSpec(shape=(7,), dtype=tf.float32, name=None)
        135841349340240: TensorSpec(shape=(64,), dtype=tf.float32, name=None)
        135841349342736: TensorSpec(shape=(7,), dtype=tf.float32, name=None)
        135841335989392: TensorSpec(shape=(3,), dtype=tf.int64, name=None)
        135841335987280: TensorSpec(shape=(3,), dtype=tf.int64, name=None)
        135841335989584: TensorSpec(shape=(1, 1, 16, 1), dtype=tf.float32, name=None)
        135841335986896: TensorSpec(shape=(1, 4, 2100), dtype=tf.float32, name=None)
        135841335991888: TensorSpec(shape=(3,), dtype=tf.int64, name=None)
        135841335992464: TensorSpec(shape=(3,), dtype=tf.int64, name=None)
        135841335988432: TensorSpec(shape=(3,), dtype=tf.int64, name=None)
        135841335990544: TensorSpec(shape=(3,), dtype=tf.int64, name=None)
        135841335992080: TensorSpec(shape=(1, 2, 2100), dtype=tf.float32, name=None)
        135841335991696: TensorSpec(shape=(1, 2, 2100), dtype=tf.float32, name=None)
        135841335986128: TensorSpec(shape=(3,), dtype=tf.int64, name=None)
        135841335989200: TensorSpec(shape=(3,), dtype=tf.int64, name=None)
      
      
      TensorFlow SavedModel: export success ✅ 457.4s, saved as 'yolo11n_saved_model' (37.8 MB)
      
      Edge TPU: export requires Edge TPU compiler. Attempting install from https://coral.ai/docs/edgetpu/compiler/
      
      Edge TPU: starting export with Edge TPU compiler 16.0.384591198...
      Edge TPU: running 'edgetpu_compiler --out_dir "yolo11n_saved_model" --show_operations --search_delegate --delegate_search_step 30 --timeout_sec 180 "yolo11n_saved_model/yolo11n_full_integer_quant.tflite"'
      Edge TPU: export success ✅ 20.0s, saved as 'yolo11n_saved_model/yolo11n_full_integer_quant_edgetpu.tflite' (4.9 MB)
      
      Export complete (478.2s)
      Results saved to /content
      Predict:         yolo predict task=detect model=yolo11n_saved_model/yolo11n_full_integer_quant_edgetpu.tflite imgsz=320 int8 
      Validate:        yolo val task=detect model=yolo11n_saved_model/yolo11n_full_integer_quant_edgetpu.tflite imgsz=320 data=/content/data.yaml int8 
      Visualize:       https://netron.app/
      yolo11n_saved_model/yolo11n_full_integer_quant_edgetpu.tflite

      This is the actual video below

      Convert to edgetpu Video Link: https://drive.google.com/file/d/19iO5LlW2rXDCxuLeRsAEBI_fu1xhJyyo/view?usp=sharing

      Testing on my RPI 4B 8GB With Coral USB Accelerator: https://drive.google.com/file/d/17KC1qK9PL9UBr7WJIpOAiGa6B2L2uXIH/view?usp=sharing

    4. SkillnoobGitHubUltralytics

      A large amount of accuracy loss is sadly expected with the coral TPU. You could otherwise maybe try exporting to NCNN with a imgsz of 320, that format is usually the 2nd fastest after the TPU.

  6. mingbkaGitHub

    I did the installations like described, run model = YOLO("yolo_weights_tflite/yolo_weights_full_integer_quant_edgetpu.tflite", task='detect') and this happened: Traceback (most recent call last): File "/home/Friday/SourceCode/yolo/detect.py", line 31, in results = model(img, stream=True, verbose=False) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/Friday/SourceCode/yolo/venv/lib/python3.11/site-packages/ultralytics/engine/model.py", line 182, in call return self.predict(source, stream, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/Friday/SourceCode/yolo/venv/lib/python3.11/site-packages/ultralytics/engine/model.py", line 545, in predict self.predictor.setup_model(model=self.model, verbose=is_cli) File "/home/Friday/SourceCode/yolo/venv/lib/python3.11/site-packages/ultralytics/engine/predictor.py", line 376, in setup_model self.model = AutoBackend( ^^^^^^^^^^^^ File "/home/Friday/SourceCode/yolo/venv/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/Friday/SourceCode/yolo/venv/lib/python3.11/site-packages/ultralytics/nn/autobackend.py", line 419, in init interpreter = Interpreter( ^^^^^^^^^^^^ File "/home/Friday/SourceCode/yolo/venv/lib/python3.11/site-packages/tflite_runtime/interpreter.py", line 464, in init self._interpreter = _interpreter_wrapper.CreateWrapperFromFile( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ValueError: Model provided has model identifier ' Can you please helpp!!

  7. JohanJay20GitHub

    from ultralytics import YOLO

    Load a model

    model = YOLO("path/to/model.pt") # Load an official model or custom model

    Export the model

    model.export(format="edgetpu")

    why when i convert my model i only get metadata.json

    1. SkillnoobGitHubUltralytics

      The model should be located in a folder with the suffix "_saved_model". Can you share the log from the export?

    2. suprimexGitHub(editado)

      It happens because any export starting YOLO10 gives an error from edgetpu_compiler:

      Edge TPU Compiler version 16.0.384591198 ERROR: Didn't find op for builtin opcode 'CONV_2D' version '6'. An older version of this builtin might be supported. Are you using an old TFLite binary with a newer model? ERROR: Registration failed.

      Only YOLO version 9 exported successfully for me.

    3. Glenn JocherUltralytics

      @suprimex thank you for sharing this important finding. It appears you've identified a compatibility issue between newer YOLO models (YOLO10 and up) and the Edge TPU compiler. The error message about "builtin opcode 'CONV_2D' version '6'" suggests that newer models are using TensorFlow Lite operations that the current Edge TPU compiler doesn't support.

      This is likely because the Edge TPU compiler hasn't been updated to support the newer TFLite operation set used in YOLO10+ models, which is unfortunate considering Google hasn't been actively maintaining the Coral project recently.

      As a workaround, you can:

      1. Continue using YOLOv9 as you've found success with it
      2. Try downgrading your TensorFlow version when exporting (something like 2.10 or 2.11)
      3. Consider using alternatives like OpenVINO or ONNX Runtime on the Raspberry Pi if Edge TPU compatibility is proving too challenging

      For anyone else encountering this issue, please share your experiences - documenting these compatibility issues helps the community develop better solutions. Thanks for bringing this to our attention!

  8. benl4212GitHub

    I have custom trained a yolo11n-seg model that I would like to fully optimize for a Coral USB. First, I noticed Coral's supported operations- Coral Supported Ops do not include SiLU, so I manually changed the activation function from SiLU to ReLU for all instances in conv.py and block.py. I also searched the other scripts in /nn/modules & /models/yolo/segment/ & cfg/models/11/yolo11-seg for SiLU activations. I retrained the previous SiLU model with the ReLU framework until "patience" stopped the training and lost no noticeable P/R/mAP50.

    I have tried exporting to these formats with no success: edgetpu, tflite, and saved model. The only format that works is onnx.

    So I made a custom export pipeline that gets me from ONNX -> TFLite INT8. Here is the end part of the output after my custom pipeline, suggesting my TFLite INT8 Quantization was successful: DEBUG: Yielding data with shape: (1, 3, 320, 320), dtype: float32 fully_quantize: 0, inference_type: 6, input_inference_type: INT8, output_inference_type: INT8 2025-04-20 19:15:05.628706: I tensorflow/compiler/mlir/lite/flatbuffer_export.cc:1989] Estimated count of arithmetic ops: 2.413 G ops, equivalently 1.206 G MACs

    Estimated count of arithmetic ops: 2.413 G ops, equivalently 1.206 G MACs Conversion finished. Saving INT8 TFLite model to: C:/Users/benl4/project7/1_class_seg5_relu/weights/yolo11n-seg_int8.tflite TFLite INT8 model saved successfully.

    Next, I need to use the Edge TPU Compiler- Edge TPU Compiler but it has failed several times during compilation due to large tensor sizes. I originally exported to ONNX with opset=12 and imgsz=640. After 1st compilation failure I tried exporting to ONXX with opset=12 and imgsz=320.

    Again for the Edge TPU Compiler, I used the flags -s -a -d and got this output that eventually stopped running at 378 ops. Edge TPU Compiler version 16.0.384591198 Searching for valid delegate with step 1 Try to compile segment with 393 ops Started a compilation timeout timer of 180 seconds. ERROR: Restored original execution plan after delegate application failure. Compilation failed: Compilation failed due to large activation tensors in model. Compilation child process completed within timeout period. Compilation failed! Try to compile segment with 392 ops Intermediate tensors: onnx_tf_prefix_/model.23/Concat,onnx_tf_prefix_/model.23/Sigmoid1,onnx_tf_prefix_/model.23/Mul_2,PartitionedCall:1 Started a compilation timeout timer of 180 seconds. ERROR: Restored original execution plan after delegate application failure. Compilation failed: Compilation failed due to large activation tensors in model. Compilation child process completed within timeout period. Compilation failed! Try to compile segment with 391 ops Intermediate tensors: onnx_tf_prefix_/model.23/Concat,onnx_tf_prefix_/model.23/Sigmoid1,onnx_tf_prefix_/model.23/proto/cv3/act/Relu;Add_65;convolution_56;convolution_58;Const_87,onnx_tf_prefix_/model.23/Mul_2 Started a compilation timeout timer of 180 seconds. ERROR: Restored original execution plan after delegate application failure. Compilation failed: Compilation failed due to large activation tensors in model. Compilation child process completed within timeout period. Compilation failed! Try to compile segment with 390 ops Intermediate tensors: onnx_tf_prefix_/model.23/Sigmoid1,onnx_tf_prefix_/model.23/Mul_2,onnx_tf_prefix_/model.23/Reshape_1,onnx_tf_prefix_/model.23/Reshape1,onnx_tf_prefix_/model.23/Reshape_2,onnx_tf_prefix_/model.23/proto/cv3/act/Relu;Add_65;convolution_56;convolution_58;Const_87 Started a compilation timeout timer of 180 seconds. ERROR: Restored original execution plan after delegate application failure. Compilation failed: Compilation failed due to large activation tensors in model. Compilation child process completed within timeout period. Compilation failed!

    1. benl4212GitHub

      Update: Exported to ONNX with imgsz=224 and got the compiler to work without the large tensor warning. However, only 1/393 ops were mapped. I believe the culprits could be Softmax, Div, Pack, SPLIT_V, STRIDED_SLICE, TRANSPOSE. Here is the new Edge TPU Compiler Output: Edge TPU Compiler version 16.0.384591198 Searching for valid delegate with step 1 Try to compile segment with 394 ops Started a compilation timeout timer of 180 seconds.

      Model compiled successfully in 70 ms.

      Input model: /content/yolo11n-seg_int8.tflite Input size: 3.02MiB Output model: yolo11n-seg_int8_edgetpu.tflite Output size: 3.11MiB On-chip memory used for caching model parameters: 56.00KiB On-chip memory remaining for caching model parameters: 6.54MiB Off-chip memory used for streaming uncached model parameters: 0.00B Number of Edge TPU subgraphs: 1 Total number of operations: 394 Operation log: yolo11n-seg_int8_edgetpu.log

      Model successfully compiled but not all operations are supported by the Edge TPU. A percentage of the model will instead run on the CPU, which is slower. If possible, consider updating your model to use only operations supported by the Edge TPU. For details, visit g.co/coral/model-reqs. Number of operations that will run on Edge TPU: 1 Number of operations that will run on CPU: 393

      Operator Count Status

      FULLY_CONNECTED 4 More than one subgraph is not supported CONCATENATION 24 More than one subgraph is not supported PACK 2 More than one subgraph is not supported RESHAPE 23 More than one subgraph is not supported TRANSPOSE 135 More than one subgraph is not supported TRANSPOSE 15 Operation is otherwise supported, but not mapped due to some unspecified limitation SPLIT 4 For example, a fully-connected or softmax layer with 2D output SOFTMAX 2 More than one subgraph is not supported MUL 3 More than one subgraph is not supported SPLIT_V 11 More than one subgraph is not supported STRIDED_SLICE 2 More than one subgraph is not supported DEPTHWISE_CONV_2D 7 More than one subgraph is not supported LOGISTIC 1 More than one subgraph is not supported PAD 40 More than one subgraph is not supported PAD 1 Mapped to Edge TPU SUB 2 More than one subgraph is not supported ADD 16 More than one subgraph is not supported MAX_POOL_2D 3 More than one subgraph is not supported QUANTIZE 3 More than one subgraph is not supported CONV_2D 93 More than one subgraph is not supported TRANSPOSE_CONV 1 More than one subgraph is not supported RESIZE_NEAREST_NEIGHBOR 2 More than one subgraph is not supported Compilation child process completed within timeout period. Compilation succeeded!

    2. Glenn JocherUltralytics

      @benl4212 thank you for sharing your thorough investigation. You've hit upon one of the core challenges when using YOLO11 models (especially segmentation variants) with the Edge TPU.

      The "More than one subgraph is not supported" error that appears throughout your compiler output indicates that the Edge TPU compiler can't map most operations because they're split across multiple subgraphs. This is a fundamental limitation when working with complex models like YOLO11-seg.

      Some suggestions that might help:

      1. Try YOLOv8-seg instead of YOLO11-seg: As seen in earlier comments, YOLOv8 models tend to have better compatibility with the Edge TPU (275 ops on CPU for YOLO11 vs only 22 for YOLOv8).

      2. Further reduce model complexity: Consider using a nano or smaller variant and reduce image size (224 or smaller). You might also try removing the segmentation head and just using detection if that's an option for your use case.

      3. Model pruning: Try applying network pruning techniques to reduce the model's parameter count before conversion.

      4. Alternative activation functions: While you've already replaced SiLU with ReLU, you might need to simplify other operations like Softmax, which often cause issues with Edge TPU compilation.

      The Edge TPU has strict limitations on the operations it supports and how they're structured. For segmentation tasks specifically, you might consider exploring alternatives like running inference directly on the Raspberry Pi with optimized formats like ONNX or OpenVINO instead of Edge TPU if performance is insufficient.

      Let me know if you'd like more specific guidance on any of these approaches!

    3. benl4212GitHub(editado)

      Thank you @glenn-jocher but I managed to complete the Ultralytics export pipeline to edgetpu in google colab, and as I would expect it is much more efficient than my own, as now 208 ops are supported. From here, I'm not sure if I should say its good enough for my application-

      I'm attempting to create a binary yolo11n-seg model for litter detection. The segmentation model performed much better on my litter dataset (2200 positive examples & 500 negative) than detection so I think I'm going to have to stick with segmentation in that regard. Also not sure if relevant but my calibration dataset consists of 524 images ~ 400 positive & 130 negative examples- per LiteRT guidelines of 5 images per class (while the model only detects 1 class, the dataset consists of around 80 different litter types). I have these 524 images copied into both the training and validation folders corresponding to the data.yaml file that I used to export to edgetpu format; maybe yourself or @Skillnoob can verify if I am correct in doing this for my calibration set.

      If I wanted to further simplify the segmentation model, I could use the output from the Ultralytics export to change the necessary activation functions and fully optimize all operations for the Coral USB, correct?

      (I used imgsz=224 for the following) Here is the Ultralytics pipeline export output after compilation:

      Edge TPU: starting export with Edge TPU compiler 16.0.384591198... Edge TPU: running 'edgetpu_compiler --out_dir "/content/best_saved_model" --show_operations --search_delegate --delegate_search_step 30 --timeout_sec 180 "/content/best_saved_model/best_full_integer_quant.tflite"' Edge TPU Compiler version 16.0.384591198 Searching for valid delegate with step 30 Try to compile segment with 365 ops Started a compilation timeout timer of 180 seconds.

      Model compiled successfully in 3170 ms.

      Input model: /content/best_saved_model/best_full_integer_quant.tflite Input size: 3.29MiB Output model: /content/best_saved_model/best_full_integer_quant_edgetpu.tflite Output size: 3.43MiB On-chip memory used for caching model parameters: 1.38MiB On-chip memory remaining for caching model parameters: 6.33MiB Off-chip memory used for streaming uncached model parameters: 8.00KiB Number of Edge TPU subgraphs: 1 Total number of operations: 365 Operation log: /content/best_saved_model/best_full_integer_quant_edgetpu.log

      Model successfully compiled but not all operations are supported by the Edge TPU. A percentage of the model will instead run on the CPU, which is slower. If possible, consider updating your model to use only operations supported by the Edge TPU. For details, visit g.co/coral/model-reqs. Number of operations that will run on Edge TPU: 208 Number of operations that will run on CPU: 157

      Operator Count Status

      SPLIT 4 For example, a fully-connected or softmax layer with 2D output SPLIT 1 Mapped to Edge TPU ADD 10 More than one subgraph is not supported ADD 7 Mapped to Edge TPU SOFTMAX 2 More than one subgraph is not supported STRIDED_SLICE 12 More than one subgraph is not supported STRIDED_SLICE 13 Mapped to Edge TPU QUANTIZE 3 More than one subgraph is not supported SUB 2 More than one subgraph is not supported CONCATENATION 8 Mapped to Edge TPU CONCATENATION 16 More than one subgraph is not supported MAX_POOL_2D 3 Mapped to Edge TPU RESHAPE 16 More than one subgraph is not supported RESHAPE 5 Mapped to Edge TPU CONV_2D 163 Mapped to Edge TPU CONV_2D 58 More than one subgraph is not supported TRANSPOSE_CONV 1 More than one subgraph is not supported MUL 3 More than one subgraph is not supported RESIZE_NEAREST_NEIGHBOR 2 More than one subgraph is not supported DEPTHWISE_CONV_2D 6 More than one subgraph is not supported FULLY_CONNECTED 4 More than one subgraph is not supported LOGISTIC 1 More than one subgraph is not supported PACK 2 More than one subgraph is not supported TRANSPOSE 3 Mapped to Edge TPU TRANSPOSE 13 More than one subgraph is not supported PAD 2 More than one subgraph is not supported PAD 5 Mapped to Edge TPU Compilation child process completed within timeout period. Compilation succeeded! Edge TPU: export success ✅ 23.4s, saved as '/content/best_saved_model/best_full_integer_quant_edgetpu.tflite' (3.4 MB)

      Export complete (527.1s) Results saved to /content Predict: yolo predict task=segment model=/content/best_saved_model/best_full_integer_quant_edgetpu.tflite imgsz=224 int8 Validate: yolo val task=segment model=/content/best_saved_model/best_full_integer_quant_edgetpu.tflite imgsz=224 data=C:\Users\benl4\TrashBot\binary_segmentation\Custom_Litter_Segmentation\data.yaml int8 Visualize: https://netron.app 💡 Learn more at https://docs.ultralytics.com/modes/export

      (EDIT) I will conduct my own testing with the base yolo11n-seg (COCO) model, but I guess my question is- did changing SiLU to ReLU improve compatibility to Edge TPU? As far as I can tell yolo11n-seg does not have a working pipeline to be fully optimized for Edge TPU format?

    4. Glenn JocherUltralytics

      Yes, changing SiLU to ReLU typically improves Edge TPU compatibility because ReLU is explicitly supported in the Edge TPU's operation set, while SiLU/Swish is not. Your approach of manually changing the activation functions was a good optimization strategy.

      The segmentation improvement you're seeing with your model (going from 1/393 to 208/365 ops on the TPU) is substantial and may be "good enough" depending on your inference speed requirements. Segmentation models are particularly challenging for the Edge TPU because they contain more complex operations and larger activation tensors than detection-only models.

      Regarding your calibration dataset approach for int8 quantization, using 524 images with good class representation is more than sufficient. The recommendation of "5 images per class" is a minimum, and having more calibration data (especially covering the variety of litter types) should produce better quantization results.

      For further optimization:

      1. Test actual inference speed with your current model to see if it meets your needs
      2. Consider reducing image size further (192x192 or even 160x160) if possible for your application
      3. If speed remains inadequate, you might need to simplify your model architecture or consider YOLOv8-seg as an alternative

      The fact that the Edge TPU is handling 208 of 365 operations is actually quite good for a segmentation model. For comparison, most detection-only models achieve better TPU utilization percentages, but segmentation is inherently more complex.

      Would you mind sharing your inference speed results once you've tested on the Raspberry Pi with the Edge TPU? That information would be valuable for the community.

      1
    5. benl4212GitHub(editado)

      Thank you again for your timely response @glenn-jocher, I have spent the last bit of time experimenting with these exports (with varying opset and imgsz) as the aforementioned custom ReLU model seemed completely corrupted when I tried to run inference (100-200 random segmentations).

      *EDIT I have no explanation for this weird behavior other than the shape of my tensors [1 56 56 32] [1 37 1029]. When I ran a script to find these tensor shapes the Inference Time= 81 ms. This is for the ReLU activated yolo11n-seg Edge TPU compiled model, with input image size=224

      I have tried using yolo predict with this compiled model and I get errors such as "Segmentation Fault."

      I had to find a workaround for my deployment anyway because the Picamera2 library is only compatible with Python 3.11 and pycoral with Python 3.9 so I used posix_ipc for connecting the incompatible processes. I have one script that uses the picamera and outputs the frames, and the other script preprocesses/runs inference/postprocesses/outputs live window. With this pipeline I get around 10 FPS with the same segmentation model!

      I apologize if I am incorrect in any of my assumptions but this is my first AI / software project. I appreciate the extent of beginner friendly documentation from Ultralytics. I could not have done the amount of work I have done in 3 months without it.

  9. i-sawGitHub

    Hi! I have a standard yolo11n model quantized in google collaborate, along with Corel on raspberry pi 4B 8 gb, it makes an inference in about 450 ms. I think something is not working correctly. I will be glad for tips and hints.

    1. Glenn JocherUltralytics

      @i-saw for optimal Coral Edge TPU performance on Raspberry Pi, ensure you've followed the Coral Edge TPU setup guide including high-frequency runtime installation and proper model export with format='edgetpu'. Verify your quantized model ends with _edgetpu.tflite and is using the TPU via device='tpu' in predict calls. Benchmark expectations for YOLO11n are ~25-70ms depending on image size and Pi model.

    1. SkillnoobGitHubUltralytics

      The benchmarks were done before yolo11 got released and were only recently added to the guide.

      1