Machine Learning as a Service: Challenges and Opportunities
Author | Dr. Shou-de Lin, Chief Machine Learning Scientist, Appier
Businesses today are dealing with huge amounts of data and the volume is growing faster than ever. At the same time, the competitive landscape is changing rapidly and it’s critical for commercial organizations to make decisions fast. Business success comes from making quick, accurate decisions using the best possible information, such as with machine learning as a service.
Machine learning (ML) is a vital technology for companies seeking a competitive advantage, as it can process large volumes of data fast that can help businesses more effectively make recommendations to customers, hone manufacturing processes, or anticipate changes to a market, for example.
Machine Learning as a Service (MLaaS) is defined in a business context as companies designing and implementing ML models that will provide a continuous and consistent service to customers. This is critical in areas where customer needs and behaviors change rapidly. For example, this year people have changed how they shop, work, and socialize as a direct result of the COVID-19 pandemic and businesses have had to shift how they service their customers to meet their needs.
This means that the technology they are using to gather and process data also needs to be flexible and adaptable to new data inputs, allowing businesses to move fast and make the best decisions.
One current challenge of taking ML models to machine learning as a service has to do with how we currently build ML models and how we teach future ML talent to do it. Most research and development of ML models focuses on building individual models that use a set of training data (with pre-assigned features and labels) to deliver the best performance in predicting the labels of another set of data (normally we call it testing data). However, if we’re looking at real-world businesses trying to meet the ever-evolving needs of real-life customers, the boundary between training and testing data becomes less clear. The testing or prediction data for today can be exploited as the training data to create a better model in the future.
Consequently, the data used for training a model will no doubt be imperfect for several reasons. Besides the fact that real-world data sources can be incomplete or unstructured (such as open answer customer questionnaires), they can come from a biased collection process. For instance, the data to be used for training a recommendation model are normally collected from the feedbacks of another recommender system currently serving online. Thus the data collected are biased by the online serving model.
Additionally, sometimes the true outcome we really care about is usually the hardest to evaluate. Let’s take digital marketing for eCommerce as an example. The most straightforward customer journey would be ‘click item, view item, add item to cart, purchase item’. However, the process is rarely this simple- people might look at an item several times on different devices, and they may remove it from the cart before putting it back in or abandon the purchase altogether. Usually, the actions in the deeper funnel (i.e. purchase) are much harder to obtain than the ones on the upper funnel. If an MLaSS model relies only on the simplest metrics (i.e. clicks and view), its suggestion (e.g. when to send out marketing messages) will not align with the ultimate business goal.
Finally, for a B2B AI company that provides machine learning as a service, they normally need to serve for thousands or even more customers from different domains. It means consistently there will be at least multi-thousand models serving online. Furthermore, for those models to consistently perform to meet ongoing and constantly shifting business goals, they need to be retrained or updated every day to keep up with evolving real-world scenarios. To achieve those goals, one needs to design not only an automated training pipeline but also to guarantee that models will have close to zero probability to converge to a bad local optimal.
Ensuring the overall stability and robustness of MLaaS models is critical. It is no doubt challenging and requires significant ongoing investment, research, and experimentation, but the rewards for businesses can be huge, allowing them to quickly adapt and pivot to changing business environments and allowing them to stay ahead of the game.
I look forward to addressing this topic further at ODSC APAC on December 9, 2020, during my talk, “Machine Learning as a Service: Challenges and Opportunities”.
* This article was originally published on Open Data Science.
WE ARE HERE TO HELP
YOU MIGHT ALSO LIKE
Any enterprise with a website should invest in CRO marketing. It is an invaluable way to monitor how visitors interact with your website, and to make sure you are taking necessary steps to encourage them to engage with your brand. What Is CRO Marketing? CRO stands for Conversion Rate Optimization. CRO marketing is a method of increasing the percentage of your website’s visitors who take a desired action (or, to use marketing speak, who ‘convert’). Conversions are a marketer’s holy grail, but the term can mean different things depending on your company’s goals. If increasing sales is your priority, then conversions could mean purchases. However, a conversion can also mean: 1. Signing up to receive content like marketing emails 2. Registering personal information like an email address 3. Spending a certain amount of time on your site 4. Downloading content like white papers and reports 5. Upgrading a service to a higher tier These KPIs (key performance indicators) all benefit your company, be it directly by generating revenue or by increasing engagement. How Do You Calculate Conversion Rate? You can use your chosen KPI to work out your conversion rate. Here is a simple formula: Total number of
Deepfakes – the art of inserting someone’s likeness into a video, thereby creating an artificial rendition of a person – has been around for a while. Although some of the initial applications were dubious, being used to insert celebrities’ likenesses into pornography or to seemingly place someone into a compromising position, we are now moving into mass use of the technology for more positive use cases. Recently, we have seen it applied in movies so actors can play younger versions of themselves, like Robert De Niro in The Irishman or even to alter facial features when Henry Cavill had a moustache removed during reshoots for Justice league: Dawn of Justice. In Rogue One: A Star Wars Story, a digitally created version of deceased actor Peter Cushing reprised his character from the original 1977 movies as well as a faked version of Carrie Fisher’s Princess Leia. “Deepfake is actually a new name for researchers. Computer graphic and machine learning people have been trying to use computers to synthesize humans in a virtual world for some time,” says Min Sun, Appier’s Chief AI Scientist. The Development of Deepfake Since the technology started to develop about five years ago, Sun says we
Reaching consumers was way easier in the 70s and 80s — the age of mass marketing. Today, the consumer journey is far more fragmented as they divide their time between different screens, which complicates the path to a buying decision. The savvy consumer now spends a significant amount of time on two or more screens every day. Globally and in Asia, device ownership continues to grow; more than half of Asian multi-device users (51%) now have two devices per person, while more than a quarter (26%) now operate on more than four devices. This means that marketers have to do things differently, even though the aim is still about reaching consumers at the point where they can influence the buying decision — also known as the consumer touchpoint. In the past, that touchpoint could have been through a TV ad at home, or in the newspaper. While this was simpler for the marketer, it also offered limited marketing options. The growth in devices adds complexity but it does open up new opportunities for marketers to influence consumer purchase decisions through different touchpoints in the consumer journey. Why Cross-Screen Tracking is Hard In order to effectively reach today’s consumers, optimising