Back Industry News

Taking the pulse of machine learning adoption Posted on Aug 08 - 2018

Share This :

Despite the hype, ML really is in its infancy according to a just-published survey from O'Reilly. The good news is that those who are furthest along with ML are getting quite cognizant of moral and regulatory hazards, like bias and privacy. The survey results drop hints of drastic changes in store as adoption grows more broad-based.

A few months back, we gave our take on a survey from the O'Reilly folks regarding interest in deep learning. The survey reported that interest was more than latent, but there's little question that the bulk of the action today is in the (relatively) better understood confines of machine learning (ML). So on this go round, O'Reilly jumped into the shallower side of the pond to survey the people who subscribe to its publications and go to its big data-related Strata and AI conferences regarding ML.

Before diving in, let's put some perspective on this cohort: it's likely a group that on average is ahead of the curve by virtue of its attendance at these big data events or consumption of O'Reilly learning services that are skewing increasingly toward the AI domain. Nonetheless, it provides a useful counterpoint to their earlier work exploring interest in deep learning.

The least surprising part of the survey is how respondents categorized their organizations' experience with ML: roughly half are in beginners in exploration phase who are just starting to investigate ML. The remainder -- early adopters with roughly 2 years of ML experience and "sophisticated" organizations with at least 5 years or more accounted for 36% and 15%, respectively.

Our take is that if you blew out the survey to a totally blind sample taken from the general population, those numbers would drop considerably. Nonetheless, we'd surmise that these organizations, by virtue of their budgeting for IT/data or analytics-related learning (in the form of literature, courseware, and conferences) are among those who will be spending the lion's share on IT -- and AI and ML in particular.

In the interest of full disclosure, these results are of more than passing interest to us because of the primary research that we're conducting for the day job -- Ovum research jointly sponsored with Dataiku on the people and process side of AI, where we'll be presenting the results at the Strata conference next month.

And one of the findings that piqued our interest was the prevalence of job titles. At 57% of responses, data scientist was by far the most common job title, followed by business analysts and data analyst at 51%, and trailed by data engineer at 39%. The results clearly show the skew of the sample; if you surveyed enterprises in general, we'd doubt that over half of them have data scientists. Moreover, the demand for data engineers is currently more than quadruple that for data scientists, based on job listings from Indeed.com.

But there was an interesting outlier that related to an finding in our own research: the presence of a new job title or role of machine learning engineer, which was reported by 23% of respondents. In our admittedly small and unscientific sample of chief data scientists and chief data officers, we never heard that term. Reflecting the newness of this role, listings for ML engineer are currently half that of data scientists. View More

x

Get the Global Big Data Conference
Newsletter.

Weekly insight from industry insiders.
Plus exclusive content and offers.