API Ratings: Performance

For our API ratings, we look at over 100 APIs and pull all the metrics together to give you a general feeling for the service quality for an organization’s APIs in a particular API ratings category with our patented CASC score.

Something of interest

Social Networks is a pretty competitive API ratings category and a good example of where all APIs should be! If all the Social Networks APIs can do it, other APIs can do it too.

api ratings socialnetworks 1

All of the APIs are very firmly in the Green Zone, and 8 out of the 10 of them have a CASC score over 9.00. LinkedIn might be propping up the API ratings category, but is still one of only two APIs to manage a 100% pass rate. It is let down by being somewhat slow, but mostly having a lot of outliers at 4.97%.

There is no direct correlation between being slow and having a lot of outliers. A slower API can be just as reliable as faster. Etsy has an excellent CASC score of 9.36 despite being the slowest API in the category by over 300 ms with a median latency of 804 ms.

Etsy has a 100% pass rate and 0.74% outliers, the third-best in the  overall API ratings category.

api ratings social networks 2

Now, an interesting thing is how fast Etsy is depends a lot on where you are calling from, and Etsy is fastest from AWS Oceania.

That strongly suggests that Etsy has a host on AWS Oceania and probably in AWS East Asia, South America and South Asia (AWS South America is the second fastest location).

In Europe though, AWS is the third-slowest cloud, only 2 ms behind the overall slowest. So there is plenty to chew on for Etsy here.

Yes, they have a very solid API, but it could be truly Best in Breed if they could sprinkle some of that AWS Oceania and South America over the other locations.

API Ratings: Overall Quality

Week Ending 30 November 2020

Category

Organization

CASC score

 

Corporate
Infrastructure

 

GitHub

9.58

COVID-19

thevirustracker.com

9.36

Search

 

Google

9.31

Social Networks

 

Twitter

9.69

UK Government

 

GoV.UK

9.61

US Government

 

Department of Justice

9.90

Department of Justice in the US Government category takes the overall API ratings title this week with an excellent CASC score of 9.90.

A CASC score of over 9.00 is very good and one of 9.50 or more exceptional. Three of the six categories are headed by organization with a CASC score of 9.50 or more this week. Sustaining a CASC score of >9.25 over a period of several weeks is a good showing and congratulations to those organizations that achieved it.

This week, all six categories are topped by an API with a CASC score of 9.27 or more.

API Ratings: Top Performers by Latency

Week Ending 30 November 2020

Category

Organization

Median Latency

 

Corporate
Infrastructure

 

Microsoft Office

221 ms

COVID-19

WHO

139 ms

Search

 

Google

391 ms

Social Networks

 

Google

56 ms

UK Government

 

Police.UK

83 ms

US Government

 

Department of Justice

47 ms

Department of Justice in the US Government takes the overall title again with a median latency of 47 ms compared to 53 ms last week.

An important caveat: medians can be misleading! An API might have a fast median latency but produce many slow outliers. So just being fast isn’t everything. You have to be reliable too if you want to have good APIs and get a high CASC score!

API Ratings: Worst Quality

Week Ending 30 November 2020

Category

Organization

CASC score

 

Corporate
Infrastructure

 

Adobe Stock Images

7.19

COVID-19

WHO

6.91

Search

 

Nobody under 8.00!

 

Social Networks

 

Nobody under 8.00!

 

UK Government

 

NHS

6.42

US Government

 

NASA

 

7.56

NHS in the UK Government category takes the overall Wooden Spoon again this week with a CASC score of 6.42, down from 6.67.

We launched API.expert (http://api.expert) earlier in the year as a simple way to provide everybody with insights into the API economy and the leading APIs in different categories in particular. We are expanding our coverage of Open Finance APIs from around the world, so one of the major changes we made recently to these round ups has been to pull out the financial APIs.

See you again in a week as we look at API ratings for the end of November. Also, don’t forget to look out for our monthly report for October and the weekly and monthly financial API reports.

Do more with API monitoring!

If you are new to APImetrics, sign up for a free trial so see how they could work for you with our free API set.

If you have any questions, please don’t hesitate to reach out.