4.14 X-Lab: Clarify API

As another example of how R can interact with APIs, we’ll look at the Clarifai API. Clarifai is an NYC-based company that offers image recognition solutions using artificial intelligence. One of their products is an API that will apply a variety of machine learning models to detect the objects in a picture or video. You can see an example here.

Although there is an excellent R package to interact with the Clarifai API, created by Gaurav Sood, unfortunately at the moment it doesn’t work with the current authentication system, so we’ll write our code from scratch. See here - also an example how github works.

We’ll be replicating the example here, i.e. use the API to predict the content of an image.

The first step is to load the package we will use to make the requests, httr and add the base URL for this API endpoint, as well as the API key (we will use mine for now, but you can create yours here).

Now we will add the body of our request – the URL of the image we want to classify (this one), embedded within an object in JSON format and with a specific structure. (See the website above for more details.)

We can either type the object in JSON as text (recommended in this case, given its complexity), or create it from within R as a list:

And now we’re ready to run the query! Note that unlike the previous examples, since here we’re sending some additional data, we need to do a POST request instead of a GET:

Did it work? So far so good. Now let’s try to parse the response into a list

Q: Before I had an error messages saying: “Key User doesn’t have GDPR consent”. What is the GDPR? What could GDPR consent be?

We can extract the parts of the list that we need to see the main labels predicted for this picture: