Playing with OpenAI CLIP on multiple datasets

In my last article, we examined how OpenAI CLIP can classify an image amongst multiple options of provided text (prompts) using a…

In my last article, we examined how OpenAI CLIP can classify an image amongst multiple options of provided text (prompts) using a pre-trained model; thus providing the ability of zero shot image classification. We have also examined how Roboflow.ai helps you automate your data ingestion pipeline by providing you with a large variety of data preprocessing and augmentation techniques and the ability to export the dataset in multiple formats.

Thanks, to this nice notebook provide by Roboflow.ai, one can now take a shot at understanding the potential of OpenAI CLIP inference on multiple datasets, including the Anki Vector Robot dataset. While this article will solely consider the Anki Vector dataset, you can try the same approach with other public datasets available with Roboflow. Here are the steps:

1. Make a clone of the Colab notebook provided by Roboflow.ai in your Google Drive. A simple “Save a copy in Drive” under the File menu would work.

2. Go to the Anki Vector Robot dataset. Click on “Op…