ImageBind

We have support for imagebind model embeddings. You can download our version of the packaged model via - pip install imagebind-packaged==0.1.2.

This function is registered as imagebind and supports Audio, Video and Text modalities(extending to Thermal,Depth,IMU data):

Parameter	Type	Default Value	Description
name	str	"imagebind_huge"	Name of the model.
device	str	"cpu"	The device to run the model on. Can be "cpu" or "gpu".
normalize	bool	False	set to True to normalize your inputs before model ingestion.

Below is an example demonstrating how the API works:

Now, we can search using any modality:

image search

audio search

Text search

You can add any input query and fetch the result as follows:

If you have any questions about the embeddings API, supported models, or see a relevant model missing, please raise an issue on GitHub.