Skip to content

Ultralytics Explorer

Ultralytics Explorer Screenshot 1

Open In Colab Ultralytics Explorer is a tool for exploring CV datasets using semantic search, SQL queries, vector similarity search and even using natural language. It is also a Python API for accessing the same functionality.



Watch: Ultralytics Explorer API | Semantic Search, SQL Queries & Ask AI Features

Installation of optional dependencies

Explorer depends on external libraries for some of its functionality. These are automatically installed on usage. To manually install these dependencies, use the following command:

pip install ultralytics[explorer]

Tip

Explorer works on embedding/semantic search & SQL querying and is powered by LanceDB serverless vector database. Unlike traditional in-memory DBs, it is persisted on disk without sacrificing performance, so you can scale locally to large datasets like COCO without running out of memory.

Explorer API

This is a Python API for Exploring your datasets. It also powers the GUI Explorer. You can use this to create your own exploratory notebooks or scripts to get insights into your datasets.

Learn more about the Explorer API here.

GUI Explorer Usage

The GUI demo runs in your browser allowing you to create embeddings for your dataset and search for similar images, run SQL queries and perform semantic search. It can be run using the following command:

yolo explorer

Note

Ask AI feature works using OpenAI, so you'll be prompted to set the api key for OpenAI when you first run the GUI. You can set it like this - yolo settings openai_api_key="..."

Ultralytics Explorer OpenAI Integration



Created 2024-01-07, Updated 2024-02-03
Authors: glenn-jocher (6), RizwanMunawar (1), AyushExel (3)

Comments