Wednesday, September 28, 2011

Data Mining in Retail Industry

Retail industry collects large amount of data on sales and customer shopping history. The quantity of data collected continues to expand rapidly, especially due to the increasing ease, availability and popularity of the business conducted on web, or e-commerce. Retail industry provides a rich source for data mining. Retail data mining can help identify customer behavior, discover customer shopping patterns and trends, improve the quality of customer service, achieve better customer retention and satisfaction, enhance goods consumption ratios design more effective goods transportation and distribution policies and reduce the cost of business.

Some of the retail applications of data mining are in following areas:

Customer Relationship Management
 Customer Segmentation: Customer segmentation is a vital ingredient in a retail organization's marketing recipe. It can offer insights into how different segments respond to shifts in demographics, fashions and trends. For example it can help classify customers in the following segments:
·          Customers who respond to new promotions
·          Customers who respond to new product launches
·          Customers who respond to discounts
·          Customers who show propensity to purchase specific products

 Campaign/ Promotion Effectiveness Analysis: Once a campaign is launched its effectiveness can be studied across different media and in terms of costs and benefits; this greatly helps in understanding what goes into a successful marketing campaign. Campaign/ promotion effectiveness analysis can answer questions like:
·         Which media channels have been most successful in the past for various campaigns?
·         Which geographic locations responded well to a particular campaign?
·         What were the relative costs and benefits of this campaign?
·         Which customer segments responded to the campaign?
 Customer Lifetime Value (CLV): Not all customers are equally profitable. CLV attempts to calculate some projected relative measure of value by calculating Risk Adjusted Revenue (probability of customer owning categories/products in his portfolio that he currently doesn ‘t have), as well as Risk Adjusted Loss (probability of customer dropping categories/products in his portfolio that he currently owns) and adding to some Net Present Value, and deducting the value of servicing the customer.
Customer Potential: Also, there are those customers who are not very profitable today may have the potential of being profitable in future. Hence it is absolutely essential to identify customers with high potential before deciding what the best way to realize that potential is through the right marketing stimully..
 Customer Loyalty Analysis: It is more economical to retain an existing customer than to acquire a new one. To develop effective customer retention programs it is vital to analyze the reasons for customer attrition. Business Intelligence helps in understanding customer attrition with respect to various factors influencing a customer and at times one can drill down to individual transactions, which might have resulted in the change of loyalty.
 Cross Selling: Retailers use the vast amount of customer information available with them to cross sell other products at the time of purchase. This can be done through product portfolio analysis and then selling the products that are missing from typical portfolios. Also market basket analysis can be another food method for effective cross selling. Look-a-like modeling is yet another strategy where model is produce that produce some quantitative measure of affinity of the customer to a specific product.
 Product Pricing: Pricing is one of the most crucial marketing decisions taken by retailers. Often an increase in price of a product can result in lower sales and customer adoption of replacement products. Using data warehousing and data mining, retailers can develop sophisticated price models for different products, which can establish price - sales relationships for the product and how changes in prices affect the sales of other products.
 Target Marketing/Response Modeling: Retailers can optimize the overall marketing and promotion effort by targeting campaigns to specific customers or groups of customers. Target marketing can be based on a very simple analysis of the buying habits of the customer or the customer group; but increasingly data mining tools are being used to define specific customer segments that are likely to respond to particular types of campaigns.
Supply Chain Management & Procurement
Supply chain management (SCM) promises unprecedented efficiencies in inventory control and procurement to the retailers. With cash registers equipped with bar-code scanners, retailers can now automatically manage the flow of products and transmit stock replenishment orders to the vendors. The data collected for this purpose can provide deep insights into the dynamics of the supply chain. However, most of the commercial SCM applications provide only transaction-based functionality for inventory management and procurement; they lack sophisticated analytical capabilities required to provide an integrated view of the supply chain.
 Vendor Performance Analysis: Performance of each vendor can be analyzed on the basis of a number of factors like cost, delivery time, quality of products delivered, payment lead time, etc. In addition to this, the role of suppliers in specific product outages can be critically analyzed.
 Inventory Control (Inventory levels, safety stock, lot size, and lead time analysis): Both current and historic reports on key inventory indicators like inventory levels, lot size, etc. can be generated from the data warehouse, thereby helping in both operational and strategic decisions relating to the inventory.
 Product Movement and the Supply Chain: Some products move much faster off the shelf than others. On-time replenishment orders are very critical for these products. Analyzing the movement of specific products - using BI tools - can help in predicting when there will be need for re-order.
 Demand Forecasting: Complex demand forecasting models can be created using a number of factors like sales figures, basic economic indicators, environmental conditions, etc. If correctly implemented, a data warehouse can significantly help in improving the retailer’s relations with suppliers and can complement the existing SCM application.
Storefront Operations
The information needs of the store manager are no longer restricted to the day to day operations. Today’s consumer is much more sophisticated and she demands a compelling shopping experience. For this the store manager needs to have an in-depth understanding of her tastes and purchasing behavior. Data warehousing and data mining can help the manager gain this insight. Following are some of the uses of BI in storefront operations:
Store Segmentation: This analysis takes the data that is common for different stores, and finds out which stores are similar in terms of product or customer dimensions. In other words – what stores are similar based on products that are sold quickly or more slowly in comparison to rest of the stores. Next step is to build the profile of the customers that buys from specific store.
 Market Basket Analysis: It is used to study natural affinities between products. One of the classic examples of market basket analysis is the beer-diaper affinity, which states that men who buy diapers are also likely to buy beer. This is an example of 'two-product affinity'. But in real life, market basket analysis can get extremely complex resulting in hitherto unknown affinities between a number of products. This analysis has various uses in the retail organization. One very common use is for in-store product placement. Another popular use is product bundling, i.e.grouping products to be sold in a single package deal. Other uses include design ing the company's e-commerce web site and product catalogs.
 Category Management: It gives the retailer an insight into the right number of SKUs to stock in a particular category. The objective is to achieve maximum profitability from a category; too few SKUs would mean that the customer is not provided withadequate choice, and too many would mean that the SKUs are cannibalizing each other. It goes without saying that effective category management is vital for a retailer's survival in this market.
 Out-Of-Stock Analysis: This analysis probes into the various reasons resulting into an out of stock situation. Typically a number of variables are involved and it can get very complicated. An integral part of the analysis is calculating the lost revenue due to product stock out.
Alternative Sales Channels
 E Business Analysis: The Internet has emerged as a powerful alternative channel for established retailers. Increasing competition from retailers operating purely over the Internet - commonly known as 'e-tailers' - has forced the 'Bricks and Mortar' retailers to quickly adopt this channel. Their success would largely depend on how they use the Net to complement their existing channels. Web logs and Information forms filled over the web are very rich sources of data that can provide insightful information about customer's browsing behavior, purchasing patterns, likes and dislikes, etc. Two main types of analysis done on the web site data are:
·         Web Log Analysis: This involves analyzing the basic traffic information over the e-commerce web site. This analysis is primarily required to optimize the operations over the Internet. It typically includes following analyses:
·         Site Navigation: An analysis of the typical route followed by the user while navigating the web site. It also includes an analysis of the most popular pages in the web site. This can significantly help in site optimization by making it more user- friendly.
·         Referrer Analysis: An analysis of the sites, which are very prolific in diverting traffic to the company’s web site.
·         Error Analysis: An analysis of the errors encountered by the user while navigating the web site. This can help in solving the errors and making the browsing experience more pleasurable. n Keyword Analysis: An analysis of the most popular keywords used by various users in Internet search engines to reach the retailer’s e-commerce web site.
·         Product Recommendation: If someone buys product A which other product he may buy. Usually there are 3 different angles to exploit when setting up recommendation engine: natural product affinities, customers affinities and preferences, peer dynamics and wisdom of the crowds.

 Channel Profitability: Data mining can help analyze channel profitability, and whether it makes sense for the retailer to continue building up expertise in that channel. The decision of continuing with a channel would also include a number of subjective factors like outlook of key enabling technologies for that channel.
 Product – Channel Affinity: Some product categories sell particularly well on certain channels. Data mining can help identify hidden product-channel affinities and help the retailer design better promotion and marketing campaigns.
Finance and Fixed Asset Management
The role of financial reporting has undergone a paradigm shift during the last decade. It is no longer restricted to just financial statements required by the law; increasingly it is being used to help in strategic decision making. Also, many organizations have embraced a free information architecture, whereby financial information is openly available for internal use. Many analytics described till now use financial data. Many companies, across industries,have integrated financial data in their enterprise wide data warehouse or established separate Financial Data Warehouse (FDW). Following are some of the uses of BI in finance:
 Budgetary Analysis: Data warehousing facilitates analysis of budgeted versus actual expenditure for various cost heads like promotion  overruns can be analyzed in more detail. It can also be used to allocate budgets for the coming financial period.
Fixed Asset Return Analysis: This is used to analyze financial viability of the fixed assets owned or leased by the company. It would typically involve measures like profitability per sq. foot of store space, total lease cost vs. profitability, etc.
 Financial Ratio Analysis: Various financial ratios like debt-equity, liquidity ratios, etc. can be analyzed over a period of time. The ability to drill down and join inter-related reports and analyses – provided by all major OLAP tool vendors – can make ratio analysis much more intuitive.
 Profitability Analysis: This includes profitability of individual stores, departments within the store, product categories, brands, and individual SKUs.


  1. I always follow your blog because it is full of compelling information about various things. I like to read this post because I met so many new facts about it actually. It's really great that I noticed this post. Thank you very much again for sharing this informative article.

  2. Hello,

    Nice article has been shared here. It was fun reading your this article and also did get lots of good points from here. i would like to visit here again in future too. it would be great if you can share some information related to food presentation here in this article. keep on posting such article here in future too.


  3. Hey, nice site you have here! Keep up the excellent work!

    Data Mining Company in Chennai

  4. This is great information, thanks’ for share!

  5. really very nice article........

    Thank u............

  6. Thanks for enriching all with this information.

  7. A retail business should prioritize investing in Customer Relationship Management.

  8. Tthanks that is very good quality explanation

  9. how does location a factor in data mining

  10. hey nice source for us,thanks for sharing the nice blog with us and i read the blog and topic of this blog is the nice and provide the good information and i have to sure bookmark this blog for the future use.

    local price scraper

  11. Nice post. I learn something new and challenging on sites I stumbleupon every day. It will always be interesting to read through content from other writers and use something from their web sites.

    retail analytics

  12. In present time Data Mining Service is very use full for the business. Everyone need to the previous data to the related area of our competitors. Loginworks, A Website Scraping Company has expertise to providing Big Data, Data Analysis and Data Mining, mostly in the retail market(E-Commerce) Data Mining is most important. If you want to Data Mining Service than visit on

  13. Thanks for your valuable posting, it was very informative. Am working in Erp Development Company In India

  14. Lots of good ideas for retailers. Are there any suggestions for vendors who receive point of sale (POS) data from a retailer? i have mountains of data i receive weekly of sales of our products (by store, by product, by day). No competitive sales data or shopping basket data is provided.i would like to move beyond just comparing year on year results and would appreciate any suggestions.

  15. Great Post, I read it well. very useful info Thank you so much for sharing this one really well defined all peaceful info regarding Mobile Health Apps and Solutions Market Report | Network Analytics Market Report|Password Management Market Report

  16. Very Useful article indeed...!

  17. I like your given information very much. If you are looking for rajputan bedsheets collection, click here Online Shopping Store

  18. This post will be very useful to us....i like your blog and helpful to me....nice thoughts for your great work.

    Out of Gauge cargoes & Dangerous Goods transportation

  19. Thanks for sharing the useful info and very interesting.Today, Axper is a step ahead of its competitors. With all its services, Axper has become a retail specialist, helping retailers to achieve greater profits.
    retail analytics

  20. Invite people and Make New Friends. Share your Thoughts & Moments, Chat, Listen Music and Play Games. Find any Business, Follow the Shop and Enjoy a New Shopping Experience. Offers, Discounts and Earn Rewards and Much more.

  21. Thank you for sharing this a great information about the Retail Analytics and i really like it thank you.
    retail traffic counting solution

  22. I read your blog on daily basis. This is really great and informative post. Thanks for sharing. CRM For Retail Industry

  23. Data Mining is a professional IT service we offer to our clients in Retail, Real Estate, Automobiles, and other business for their online data collection needs.

  24. material handling equipments | Automated Storage & Retrieval System | Conveyors | Automated Guided Vehicles | Warehouse Management System | SCADA Supervision Software!

  25. This content creates a new hope and inspiration with in me. Thanks for sharing article like this. The way you have stated everything above is quite awesome. Keep blogging like this. Thanks.

    Dataware Housing Training in Chennai

  26. This blog is the general information for the feature. You got a good work for these blog.We have a developing our creative content of this mind.Thank you for this blog. This for very interesting and useful.
    Analytics Training in Chennai