Dispelling the Myths Around Automated Machine Learning
Machine learning continues to make great strides in optimizing data collection and analysis tools for use across a wide range of industries, but now a new strand is emerging: automated machine learning, or AutoML for short.
This promises to be less reliant on data scientists, who are in short supply because of their highly specialized skill set, and can be expensive to hire. However, there are a number of misconceptions about AutoML, the chief one being that it can do away with such data scientists altogether.
Machine learning is an extraordinarily powerful general purpose technology that has a staggering number of applications. It is therefore no wonder people are excited about an evolution of the technology known as auto machine learning.
To understand what AutoML can do, it is important to understand how standard machine learning works.
Machine learning involves several steps: first you need to collect the relevant data, and then clean it in order to learn what you want to learn from it. You then define the feature representation of your data, and put it into a model which is trained to optimize the accuracy in order to achieve your predefined goal. It is a complicated task that requires a lot of human involvement. And not just any human – to get the most from machine learning, you need a team of highly trained data scientists to create, apply and optimize the model, and to be involved at every stage.
The ultimate aim of AutoML is to automate every step in this process, increasing efficiency while reducing cost. If it worked perfectly, it could be used in many different applications in all sorts of industries, revolutionizing multiple sectors of society. This is why it is currently gaining so much attention.
Changing the Role of Data Scientists
However, like many emerging technologies, the reality is rather more complicated.
“How useful AutoML is really depends on the industry, the data type and the model classes involved,” says Min Sun, Chief AI Scientist at Appier. In terms of data collection and cleaning, digital marketing is one area that can benefit from AutoML, because data labels are naturally generated from customers interacting with companies’ marketing campaigns. Mature tools exist to clean those labels, to make sure they are not noisy or biased.
Other industries are less well-placed to benefit in data collection and cleaning, but suitable in automatic feature engineering. For example, self-driving cars need humans to help identify what is a pedestrian and what is a stop sign. Similarly, medical imaging tools require experienced doctors to help spot tumors. However, using neural networks to automatically construct features from raw images has already reduced many data scientists’ efforts.
However, Sun urges scientists not to naively apply AutoML. Regardless of what goal you are trying to achieve, AutoML will not replace human knowledge altogether. Rather, it will change the focus where that knowledge is applied.
“In marketing, you only automate the steps of the process that will be much more effective than if they were carried out by a human manually,” Sun says. “Typically these processes are repetitive or complicated with sufficient data support. In this way, humans can be freed from repetitive tasks and applied their knowledge in areas with less accumulated data.”
So, you cannot get rid of data scientists altogether. This approach that sees humans and machines working hand-in-hand has been termed Semi-AutoML by some. It gives a more realistic appraisal of what the process actually entails.
Weighing Up the Benefits and Costs
As long as companies are informed on what AutoML can do and how it works, they have a lot to gain by using it.
It can be more efficient, because it removes the need to have human experts in the loop, and machines can do this work much quicker than humans. Used in the right way, it can outperform humans too, as it minimizes the risk of human error.
As the processes are automated, it can also scale much more effectively than if the processes were done manually.
However, there are other factors to consider that are often overlooked. Namely, the cost.
The Holy Grail of AutoML is a neural architecture search – this will program an AI to search for the best neural network architecture to solve your given problem. Researchers have demonstrated it is possible to fully automate a neural architecture search (and outperform humans attempting the same task), but it takes an enormous amount of computational power – it could involve a dozen CPUs being trained for several days, for example, which is very expensive. So, any firm looking to leverage AutoML needs to use it smartly by weighing up the potential gain versus the financial cost and time spent.
While AutoML minimizes the risk of human error, it does not eliminate it altogether. AutoML will only optimize the metric you define, so if you define a metric in the wrong way, the model created will not solve your problem. This issue is not unique to AutoML – humans can make the same mistake with standard machine learning, but having humans in the loop can help to correct it, as they will spot that the model behavior is not correct. While removing humans from the process can have big gains in terms of efficiency, if done naively it can also cause more errors to creep in.
Putting It Into Practice
It is a tricky balance to strike. Companies need to weigh up the downsides of intense human involvement with the potential benefits, and decide what is best for their business model. Having a human in the loop at every stage of the process will mean your model will not scale, for example. But at the same time, automating the entire process while building each model will be too time-consuming. “We know that marketers cannot wait days before sending out a campaign, they need to strike in a timely fashion,” Sun says.
Often the best solution now is to leverage a data science platform that uses AutoML in certain areas (what is often called Semi-AutoML as described earlier). By automating certain steps, you can concentrate your computational power where gains in efficiency and reach are not compromised by a reduction in accuracy. This helps marketers tap into the power of AutoML but only where it is really beneficial to the business’ goals. Otherwise you are just using technology for technology’s sake.
AutoML has many benefits for enterprises, and especially for marketers, but only if used correctly. Only by taking a realistic look at how it works, what it involves and what it can do for your organization can you really leverage it to its full potential.
* Want to know whether you can leverage data and AutoML to better understand your customers, enable predictive analytics, and drive ROI? Discover AIXON, Appier’s data science platform. Got a question? We are here to help! Get in touch with our team today for an exclusive consultation.
WE ARE HERE TO HELP
YOU MIGHT ALSO LIKE
The Asia Pacific (APAC) region is experiencing an insurance boom, as well as significant digital disruption in this sector, according to a recent report by Bain & Company. As competition grows and new players enter the market, insurance companies are implementing artificial intelligence (AI) powered tools to stay ahead. Asia Pacific currently has the fastest growing insurance market in the world. This boom is linked to two main factors: an expanding middle class and the removal of barriers to entry in markets such as China and India. At the same time, digital disruption has created a situation where customers expect to access insurance services digitally, can easily compare policies online, and will receive more personalized services and products. To get ahead, insurers are using advanced analytics, machine learning and other AI-driven tools to compete with agile new players and elevate the customer experience. According to a study by PwC, more than 80 percent of insurance CEOs said AI was already a part of their business model or would be within the next three years. Here are four major areas where insurers can implement AI to improve customer engagement, combat fraud and streamline business processes. 1. Fraud Detection & Credit
The global market of artificial intelligence (AI) continues to grow. According to IDC, at least 90 percent of new enterprise apps will embed AI by 2025. One of the reasons behind this trend is a growing awareness of the benefits of AI, together with the increasing accessibility of advanced AI capabilities, enabled by AI as a service (AIaaS). What Is AI as a Service? AI as a service is like any other out-of-the-box offering. It is artificial intelligence software being offered by a third-party provider to a client as a service, including a wide range of different AI-powered capabilities. These capabilities hosted by the third party sit in the cloud and are available to the end-users over the internet, making AI more accessible. Demand for AIaaS is growing as businesses increasingly see the value it is creating for competitors. Industry figures suggest that the global market of AI as a service will hit US$10.88 billion by 2023, up from US$1.13 billion in 2017. However, it could potentially be much higher as it becomes more available. What Are the Different Types of AIaaS? There are various types of AIaaS solutions. Which type you choose comes down to your business
As the high sales period of the holiday season approaches, many retailers are hoping to claw back some of the losses they have experienced as a result of COVID-19. However, shifts in customer shopping habits and expectations mean attracting sales requires new insights and presents fresh challenges. What will the 2020 holiday shopping season bring? And how can brands and marketers better prepare to ensure they beat the competition? What to Expect in the 2020 Holiday Shopping Season The good news is that shoppers are not going to significantly reduce their spending this year – despite the tough economic times. However, they will be looking for savings. This year’s delayed online sales event, Amazon Prime Day (October 13-14), generated US$10.4 billion in revenue according to early analysis by Digital Commerce 360, showing 45.2 percent year over year growth. Though other sources suggest more modest growth overall. Regardless of spending, what people are buying has shifted. According to KPMG, cold categories include travel, hotels and formal apparel, while hot categories include major appliances, home renovation supplies, and sports and fitness. As social distancing and health concerns remain a high priority, the trend to e-commerce will also continue – with Forbes