Share on facebook
Share on linkedin
Share on twitter
Share on facebook
Share on linkedin
Share on twitter

7 Critical Challenges of Recommendation Engines

Personalized recommendations have never been more important for businesses looking to attract and retain customers. According to Accenture, nine out of 10 consumers are more likely to shop with brands that provide relevant offers and recommendations.

Recommendations also have a huge impact on a business’ bottom line as they can result in a 16 percent increase in conversions. Therefore, it is no wonder that recommendation engines are on the rise. Industry Arc reports that the global market for recommendation engines will grow from US$1.14 billion in 2018 to US$12.03 billion by 2025.


Highly Recommended: The Benefits of Using Recommendation Engines

With continuing advances in artificial intelligence (AI), recommendations are no longer aimed at general audiences, or even those of a certain segment. Using deep learning-based recommendation engines, marketers today can target consumers with hyper-personalized recommendations at the individual level, based on metrics like persona, location, interests, real-time online behavior and so on. This will not only allow marketers to drive online traffic through retargeting ads or email marketing, but also reduce customer irritation and churn rates.

Personalized product recommendations also help engage customers by serving them with products or services that are highly relevant to them. This will encourage higher average order values and increase conversions. In the long term, using personalized recommendations will show your customers that you understand and value them, increasing customer satisfaction and loyalty.


Challenges to Overcome Before Deployment

While the stratospheric growth shows that businesses all over the world are exploring what recommendation engines can do for them, effectively using this technology comes with its fair share of challenges.

1. Significant investments required

Recommendation engines are a big investment, not only financially, but in terms of time, too: it takes a long time and deep expertise to build an effective recommendation engine in-house. Besides the requisite data scientists and other assorted specialist staff, you will need to factor in costs for the discovery and analysis phase (including a feasibility study to make sure this is the right path for your business), the prototype implementation phase, the minimum viable product (MVP) development, followed by the final release and deployment.

Even when the recommendation engine is active, the journey is not over: the engine will need constant monitoring and refinement to ensure it is operating as optimally as possible, resulting in continual costs.

2. Too many choices

Alternatively, you could employ an off-the-shelf solution from a third-party company, but with so many options available on the market, how do you know which is the right one for your business? Evaluating different solutions can be enormously time consuming, as you need to evaluate their case studies, the technology, how the solution will be integrated into your current company setup, and so on.

For example, is collaborative filtering the best recommendation strategy for your website? Or maybe content-based filtering would be more suitable? If you are employing a third-party solution, make sure the vendor spells out the pros and cons of each technology, and – crucially – make them explain why they think their chosen approach is best for your business specifically.

3. The complex onboarding process

Bringing a recommendation engine into your business can be a complex affair. Sometimes, it might not be worth the effort, especially if it does not fit into your business vertical.

However, this can also be due to a number of other reasons, such as lack of understanding of recommendation models, poor UX design of your website, and insufficient knowledge of your business domain. Employing and assigning the right staff who not only understand the technology but also know the intricate workings of your business will allow you to unlock the full potential of recommendation engines.

4. Lack of data analytics capability

Like all AI-based technologies, recommendation engines rely on data – if you do not have high-quality data, or cannot crunch and analyze it properly, you will not be able to make the most of the recommendation engine.

To ensure the best-quality data, you should ask yourself four questions: How recent is it? How noisy is it? How diverse is it? How quickly can you feed new data to your deep learning model?

Deep learning-based recommendation engines can demand high computational complexity. If the data that is fed to the model is less accurate or valuable, the result will be less useful. So, before investing in recommendation engines, make sure your business is up to the complex data analytics demands required.

5. The ‘cold start’ problem

Relying on user data has its downsides, one of which is the issue of ‘cold start’. This is when a new user enters the system or new items are added to the catalogue, and therefore, it will be difficult for the algorithm to predict the taste or preferences of the new user, or the rating of the new items, leading to less accurate recommendations.

However, a deep learning model is able to optimize the correlations between the customer and the product by analyzing the context of product and user details like product descriptions, images, and user behaviors. It can then make meaningful recommendations for each individual product or customer under different scenarios. This results in a unique set of recommendations that takes into consideration all these variables.

Because these deep learning models do not heavily rely on user behavior data, they are the solution to the cold start problem.

For more on this, read our white paper: The Complete Guide to Finding the Right Recommendation Strategy

6. Inability to capture changes in user behavior

Consumers do not stand still – they are constantly behaving and evolving both as people and customers. Staying on top of these changes is a constant battle. A strong recommendation engine will be able to identify changes (or signs of an impending changes) in customers’ preferences and behavior, and constantly auto-train themselves in real time in order to serve relevant recommendations.

7. Privacy concerns

The more the algorithm knows about the customer, the more accurate its recommendations will be. However, many customers are hesitant to hand over personal information, especially given several high-profile cases of customer data leaks in recent years. However, without this customer data, the recommendation engine cannot function effectively. Therefore, building trust between the business and customers is key.


Many businesses are thriving thanks to recommendation engines. While they do bring enormous opportunities, it is vital to be aware of the many challenges inherent to the technology in order to utilize it to the fullest. We would not recommend anything less.


* To learn more about deep learning-based recommendations, and how to choose the right recommendation strategy for your business, download our white paper ‘The Complete Guide to Finding the Right Recommendation Strategy’ now. Have a question? Get in touch with our team today for an exclusive consultation.


Let us know the marketing challenges that you’re facing, and how you want to improve your marketing strategy.


The Ins and Outs of Owned Marketing

What is the key to marketing success? Understanding your customers, and building and maintaining relationships with them by meeting their needs and wants. One type of marketing that can help you do this efficiently is owned marketing – but what is it and what are its specific benefits and best practices?    What Is Owned Marketing? Owned marketing is a set of customer-focused strategies and tactics that are implemented through your own brand channels, also known as your owned media. These owned channels include your website, app, blog, social media pages, email, SMS, forums and any other media that you own and have complete control over. Owned marketing follows a pull marketing strategy. This means it is used to get your messages out to the market and to increase demand for products or services. In other words, it helps pull people towards your brand. It can also help you establish your brand and voice.   How Is It Different From Paid Marketing and Earned Marketing? Owned marketing is a term often used in conjunction with the concepts of paid marketing and earned marketing, but what is the difference? Paid Marketing           Paid marketing includes any marketing

What Is Retargeting?

Your online business has attracted the interest of potential customers, but they are just not ready to spend money with you yet. According to a recent study, 92 percent of consumers who visit a brand’s website for the first time do so for reasons other than buying. If they do leave without spending any money, it can be very hard indeed to reach them again. This is where you can use retargeting (also known as behavioral retargeting) to bring potential customers back a second time around, driving uptake and increasing revenue for your business.   What Is Retargeting? Retargeting is a way of serving potential customers with adverts once they have expressed an interest in your products or services. Based on their behavior on your site, you would know what products or services they have expressed an interest in, which allows for a much higher degree of personalization within this retargeting marketing. Retargeting is different to remarketing though. Retargeting involves targeting ads to your website’s visitors once they are on the wider web, while remarketing refers to re-engaging customers mainly through email marketing. Dynamic retargeting, meanwhile, lets you show individual visitors ads that contain specific products and services that they

How AI Is Making Quality Not Quantity the Answer to Ad Effectiveness

How many times should a prospect see an ad for it to be effective? It’s a decades-old marketing dilemma – one that digital has made both easier and more difficult to manage. However, this question of effectiveness isn’t just about quantity. It’s also about quality aka finding and targeting the ideal audience – something artificial intelligence (AI) can help you do better.   Why Frequency Capping Isn’t Enough While frequency capping has certainly helped with controlling ad exposure by enabling limit setting on an individual’s contact with a campaign, the question of how many times is best continues to cause stress. Too few times and prospects may not notice it, or notice it enough; too many and there’s a chance it might move from being memorable to annoying, resulting in a poor response and, worse still, a damaged brand reputation. Plenty of research has been done over the years in an attempt to find an answer. While brands like Procter & Gamble have capped their digital ad exposure at three times a month, Facebook claims one to two impressions weekly over at least 10 weeks for a campaign would be ideal. However, searching for the right answer is kind of