The DataWeave Blog

Category: E Commerce

  • How Digital Shelf Analytics Can Fix Common Revenue Growth Management Challenges for Consumer Brands

    How Digital Shelf Analytics Can Fix Common Revenue Growth Management Challenges for Consumer Brands

    As consumer goods brands increasingly turn to eCommerce marketplaces as a source of profitable growth, it becomes harder for teams to grapple with the complexity of revenue growth management.

    This complexity emerges from multiple fonts: there are hundreds, and even thousands, of competitors to consider when formulating strategies for managing pricing, promotion, and assortment changes. The world is currently experiencing a period of unprecedented supply chain instability, shifting more consumers away from traditional retail and into eCommerce shopping. And finally, consumer buying patterns, preferences, and trends are constantly shifting.

    Revenue growth management (RGM) and net revenue management (NRM) were once less complex processes; but that is no longer the case. Now, some 80% of consumer brand CEOs report that they “aren’t satisfied with their RGM results.”

    Gathering data, analyzing it, and acting on it quickly stand out as major challenges that businesses must overcome to grow their market share, earn more profits, and capitalize on market shifts in real time. In this article, we’ll dive into RGM and NRM, the obstacles business teams face, and explore how using technology for digital shelf analytics can help bridge the gap.

    What is Net Revenue Management (NRM) or Revenue Growth Management (RGM)?

    Every consumer goods company aims to increase profits and grow market share. This requires a concerted effort in RGM and net revenue management (NRM) strategy. Whether a company has a specific team dedicated to this task or relies on the abilities of business analysts or merchandisers, this function is crucial.

    It’s worth mentioning that though the terms NRM and RGM are often used interchangeably, there are subtle differences. While both net revenue management and revenue growth management focus on maximizing overall revenue for the brand, NRM typically has a narrower focus and is specific to optimizing profitability through product pricing, promotion, product mix, and cost management. RGM strategies are a bit broader and tend to look at the top line to grow market share and expand the customer base.

    The Challenges Revenue Teams Face

    Differentiating between ‘good growth’ and ‘bad growth’ is central to NRM and RGM. Net revenue management and revenue growth management teams need the data and tools in place to determine if growth in one area is coming at the expense of another so as not to cannibalize business. Tracking and analyzing extensive data to successfully take action on opportunities and determine whether strategies are working as intended consumes a tremendous amount of mental bandwidth. The fact that these decisions are incredibly time-sensitive only compounds the issue.

    To cope, many teams in charge of NRM or RGM employ digital shelf analytics strategies to help speed up data aggregation and analysis to make sure they’re capitalizing on potential opportunities.

    eCommerce has added a whole new layer of complexity to consumer goods sales. Instead of a few relatively stable prices at big-box stores, a single item for sale may experience high price volatility, with dozens of minute pricing changes occurring online each day. In some cases, consumers become blind to price volatility, letting brands increase prices, but consumer sentiment, the overall price elasticity of the product, and dozens of other factors go into determining the final price of an online product. Net revenue teams need to modernize and adapt to changing eCommerce environments to competitively price, promote, and grow their revenue.

    Here are the top three challenges standing in the way of net revenue management and revenue growth management teams and solutions to address these issues.

    Challenge 1: Incomplete or Inaccurate Data

    Incomplete and inaccurate data are critical for Net Revenue Management and Revenue Growth Management teams to get under control when attempting to modernize in a digital-centric selling environment. As more competitors enter the market, many brands find it hard to make strategic decisions without the complete picture.

    Data may be incomplete or inaccurate because a brand is analyzing only part of the market, such as Amazon or another enterprise-scale eCommerce marketplace. Additionally, they might not be analyzing all types of online media, such as branded ads, sponsored search listings, or sponsored category listings.

    Most importantly, another pitfall is the lack of hyperlocal data. Generalized data across regions, states, ZIPs, and stores can skew the decision-making process and result in poor outcomes.

    Overcoming Incomplete or Inaccurate Data

    In order to get the full picture, consumer brands need to ensure they have a view of the entire competitive landscape across their channels. This includes gathering data down to the case pack, the unique product identifier, and the geography, including ZIP and store. They also need the respective MSRP by SKU, the unit normalized price, and the selling price at a specific moment in time. This is done by aggregating brick-and-mortar store information available online, such as when stores list curbside pickup SKUs and pricing online.

    Individual teams cannot manually gather all this detailed data. The growth in eCommerce means there is simply too much data to find and aggregate. Instead, they can employ digital shelf technology to get more data from more sites. Teams can leverage AI to better match product listings, ads, and even visuals to avoid missing data on listings that lack common attributes, such as UPCs for normalization.

    To add to this, advanced pricing intelligence systems can cache URLs to help teams audit and verify their data, avoiding delays and confusion when ad hoc requests arise.

    Challenge 2: Difficulty in Making Sense of the Competitive Landscape

    Once net revenue management and revenue growth management teams have gathered all of the available data, it’s time to make sense of it. This is a monumental challenge, and ends up being the stage where most NRM and RGM teams flounder. Disparate marketplaces include different product attributes and images. This makes it extremely complicated to sync competitors’ data to ready it for analysis, especially if this analysis is carried out manually in Excel. These are some of the attributes that teams need to harmonize in order to make sense of the competitive landscape:

    • Product identifiers (UPC, SKU, Internal Code)
    • Size, case, pack, volume, bundled offerings
    • Language
    • Currency
    • Stock Status (Whether the product is available or not)
    • Platform-specific attributes such as ‘Amazon’s Choice,’ ‘Best Seller,’ etc.

    Teams also need to group and classify various categories of promotions. These can include sponsored listings, banner ads, coupons, bank offers, and others. Each of these categories needs to be tracked separately. This vast array of data points across hundreds of sites creates a big data problem for teams.

    Making Sense of the Competitive Landscape

    The best way to overcome this challenge is to task a digital shelf analytics system with gathering and harmonizing data automatically across the consumer goods competitive landscape. Competitive and market intelligence tools can help break down an overwhelming amount of data, matching similar products across competing brands and analyzing their various strengths and weaknesses. Once the technology matches complex product attributes and identifiers, it becomes easier for teams to gain insights and exploit findings. In a sense, the data needs to be cleaned before analysis can occur.

    Technology can gather data in multiple ways, and the best systems employ several methods to get the best matches. Data consumption modes include API integrations, CSV and Excel file uploads, and proprietary scrapers that view websites independently of direct inputs. Having all the data in a single place helps net revenue management and revenue growth management teams gain indicative insights on product popularity, pricing, and sales, on their own and competitor products.

    Challenge 3: Lack of Timely Visibility

    The final challenge that many net revenue management and revenue growth management teams face is something of a ‘silent killer’ — timeliness. Even if they successfully gather data across the entire competitive landscape and harmonize that data into a format for easy analysis, a lack of timeliness can render even the best actions irrelevant.

    Speed is of the utmost importance when there are market changes. If a product goes viral and competitors raise prices in response to increased demand, without timely visibility, the trend may be over before a consumer goods brand can successfully increase its prices for the duration of the trend. This can mean lost margins.

    Another example is analyzing data and incorporating lagging promotional and sales data into analyses. This can skew pricing strategies because timely data is not accessible to inform decision-making. Many teams waste time firefighting due to a lack of timely pricing and promotional intelligence data.

    Get Near Real-Time Insights for Faster Decision Making

    Using technology that allows for net revenue management and revenue growth management teams at consumer goods brands to establish update frequencies can be a game changer. Teams can set update frequencies based on their need. They can set up the system to check a fast-moving product daily, while a slow-moving item might only need to be checked weekly, monthly, or even quarterly. This allows teams to focus on the highest-impact products first and address the largest exceptions before they lose out on an opportunity. Managing exceptions with a digital shelf analytics platform saves teams significant time instead of poring over low-impact changes in the data.

    Digital Shelf Analytics for Net Revenue Management

    Modernizing a consumer goods brand’s net revenue management or revenue growth management processes requires advanced digital shelf analytics. DataWeave provides consumer goods companies with the technology they need for quick and accurate pricing, promotional, and assortment intelligence. By tracking over 200 million products each day, users can be sure they get the widest and most timely view of the competitive landscape. DataWeave’s deep industry knowledge is baked into every aspect of its platform.

    Learn more by requesting a demo today!

  • Amazon Prime Day Pricing Trends 2024: Deals and Discounts Galore Across Categories

    Amazon Prime Day Pricing Trends 2024: Deals and Discounts Galore Across Categories

    Amazon Prime Day 2024 has once again shattered records, with more items sold during the two-day event than any previous Prime Day. Prime members worldwide saved billions across all categories, while independent sellers moved an impressive 200 million items.

    At DataWeave, we conducted an extensive analysis of the discounts offered by Amazon across major categories. By examining over 47,000 SKUs, we’ve uncovered compelling insights into pricing strategies, competitive positioning, and emerging trends in the eCommerce space.

    Since products on Amazon and other eCommerce websites are often sold at discounts even on normal days not linked to a sale event, we delved into the real value that Prime Day offers to shoppers by focusing on price reductions or the Additional Discount during the sale compared to the week before. As a result, our approach highlights the genuine benefits of the event for shoppers who count on lower prices during the sale. At the same time, our report also includes the Absolute Discounts offered during Prime Day, which represents the total markdown relative to the MSRP.

    Amazon’s Cross-Category Discount Strategy

    Our analysis reveals that the Electronics category saw the highest discounts with an average absolute discount of 20.4% and additional discounts on Prime Day amounting to 10.4%. Meanwhile the Home & Furniture had the lowest discount at 13.1%.

    Discounts offered Across Key Categories on Amazon Prime Day USA 2024

    The Health & Beauty category saw significant additional discounts during Prime Day, at 9.26%. The Apparel category offered attractive absolute (16.10%) and additional (8.90%) discounts.

    Category Deep Dive

    Consumer Electronics

    Still the star of the show, the electronics category saw the highest markdowns this Prime Day with absolute discounts at 20.40% and across 14.61% of their inventory.

    Discounts offered on Consumer Electronics Subcategories During Amazon Prime Day USA 2024.

    Across Electronics subcategories, Earbuds had the highest markdowns at 34.80%, followed closely by Wireless Headphones at 30.60% and Headphones at 29.00%, with steep additional discounts during Prime Day as well. Apple AirPods Pro, for example, retailed at $168 (down from $249) at a 32% discount.

    Discounts offered on Consumer Electronics Subcategories During Amazon Prime Day USA 2024 Featuring Apple Air Pods

    Meanwhile, smartphones had the lowest markdowns at 9.30%, followed by Laptops at 10.50%. Laptops also had the lowest additional discount during Prime Day at just 1.28%, significantly lower than other subcategories. Speakers (20.80%), Drones (19.10%), and Smartwatches (25.00%) offered moderate to high markdowns.

    Notably, all Amazon products including Kindle, Echo, Echo Earbuds, Alexa, Fire TV, Fire TV Stick, and Fire Tablets, were aggressively discounted upwards of 30% this Prime Day. These products also came with the label “Climate Pledge Friendly.”

    Sustainability Features For Amazon Products During Prime Day USA 2024

    These aspects indicate Amazon’s push to promote its own ecosystem of products to the top, as well as cater to changing consumer preferences.

    Apparel

    Discounts offered this Prime Day increased from 13.2% in 2023 to 16.1% in 2024.

    Discounts offered on Apparel Subcategories During Amazon Prime Day USA 2024

    Amid apparel subcategories, Amazon appears to be pushing Women’s apparel categories more aggressively, particularly in Tops, Shoes, and Athleisure.

    Women’s Shoes lead with the highest discounts at 26.50%, followed by Women’s Tops at 22.50% and Men’s Shoes at 22.80%. Women’s Tops also maintained the highest additional discount at 15.27%, followed by Women’s Athleisure at 13.03% and Men’s Swimwear at 12.44%.

    Similar to 2023, Men’s Innerwear offered significantly lower discounts, with only 1% absolute discount and 0.72% additional discount. Women’s Innerwear also shows low discounts at 3.20% absolute and 2.23% additional.

    Health & Beauty

    Amid health & beauty subcategories, Moisturizes witnessed the highest markdowns at 20.10%, followed by Make Up at 18.90%. The Moisturizer subcategory also offers highest additional discounts at 12.20%, followed closely by Sunscreen at 10.25% and Beard Care at 10.22%.

    Discounts offered on Health & Beauty Subcategories During Amazon Prime Day USA 2024

    The Toothpaste subcategory has the lowest discounts, at 10.90%. The lower discounts on everyday essentials like this might indicate a steady demand or an attempt to maintain margins on frequently purchased items.

    Most Health & Beauty subcategories fall in the 15-18% range for actual discounts and 8-10% range for additional discounts. Electric Toothbrush (16.90% actual, 9.91% additional) and Shampoo (16.50% actual, 8.78% additional) represent the middle of the pack. There were a few highly attractive deals though, such as the Philips Sonicare toothbrush retailing at $122.96 (down from $199.99), with a 39% discount.

    Discounts offered on Health & Beauty Subcategories During Amazon Prime Day USA 2024 Featuring A Philips Electric Toothbrush

    Amazon also offered significant discounts on Open Box products (products that are returned, but unused, out of mint condition boxes) to Prime members.

    Home & Furniture

    This category saw the lowest discounts for this Prime Day event at 13.1%. Across subcategories, Rugs lead with the highest average discount at 21.50%, closely followed by Luggage at 20.90%. Amazon seems to be pushing decorative and organizational items (Rugs, Bookcases) more aggressively, possibly due to higher margins. Rugs also stood out as the subcategory with the highest additional discount of 11.54%.

    Discounts offered on Home & Furniture Subcategories During Amazon Prime Day USA 2024

    Sofas have the lowest additional discount at 2.76%, followed by Dining Tables at 3.21%. Items like Cabinets (15.80% absolute, 6.66% additional) and Coffee Tables (14.40% absolute, 6.25% additional) represent the middle range of discounts.

    Watch Out For More

    As the holiday season approaches, it’s clear that the retail landscape continues to evolve. While Amazon remains a formidable force, there are opportunities for savvy competitors to carve out their niches and attract deal-hungry shoppers. By analyzing these trends and adjusting strategies accordingly, retailers can position themselves for success in the high-stakes world of summer sales events.

    Stay tuned to our blog for more insights on how Amazon’s competitors reacted to Prime Day, and how leading brands across categories fared in terms of their pricing and their visibility during the sale event. Reach out to us today to learn more.

  • Cracking the Code: How Retailers Can Adapt to Plummeting Egg Prices in 2024

    Cracking the Code: How Retailers Can Adapt to Plummeting Egg Prices in 2024

    Virtually every cuisine in the world uses eggs. They’re in your breakfast, lunch, dinner, and dessert — which is perhaps why the global egg market is expected to generate $130.70 billion in revenue in 2024 and is projected to grow to approximately $193.56 billion by 2029.

    More specifically, the United States is the fourth-largest egg producer worldwide. The country’s egg market is projected to generate $15.75 billion in 2024 and increase to $22.51 billion by 2029.

    This growth is driven by several factors, most notably:

    • Health-consciousness among consumers: Consumers value eggs for their essential nutrients and rich protein content.
    • Demand for convenience foods: Consumers’ preferences are shifting toward quick and easy foods, which drives demand for shell eggs and pre-packaged boiled or scrambled eggs.
    • Population Growth: A growing worldwide population increases the demand for eggs.
    • Affordability and accessibility: Eggs are an affordable and accessible nutrient-dense food source for many.

    Despite these factors contributing to the U.S. egg market’s growth, recent times have seen egg prices fall dramatically.

    Based on a sample of 450 SKUs, DataWeave discovered that egg prices in the U.S. fell by 6.7% between April 2023 and April 2024, dipping to its lowest (-12.6%) in December 2023.

    Egg Price Chart: Egg Prices USA Going Down 98.95% between April 2023 and April 2024

    So, what’s causing the decrease in egg prices?

    The Rise and Fall of Egg Prices: A Recent History

    In 2022, avian influenza severely impacted the United States. The disease affected wild birds in nearly every state and devastated commercial flocks in approximately half of the country.

    The 2022 incident was the first major outbreak since 2015 and led to the culling of more than 52.6 million birds, mainly poultry, to prevent the disease from spreading uncontrollably.

    With almost 12 million fewer egg-laying hens, the United States produced around 109.5 billion eggs in 2022 — a drop of nearly two billion from the previous year.

    Consequently, the cost of eggs soared, peaking at $4.82 a dozen — more than double the price of eggs in the previous year.

    The avian flu continues to affect egg-laying hens and other poultry birds across the United States. As of April 2024, farms have killed a total of 85 million poultry birds in an attempt to contain the disease.

    Despite the disease’s effects, production facilities have made significant efforts to repopulate flocks, leading to a steady increase in supply – and a much anticipated decrease in egg prices.

    According to the U.S. Bureau of Labor Statistics, there was an increase in producer egg prices in 2022, reaching a peak in November 2022, at which point they began to fall.

    Retailer’s egg prices followed suit. The egg price chart below depicts retailers’ declining egg prices over one year, from April 2023 to April 2024, with Giant Eagle showing the most significant price reductions and Walmart the least.

    Egg Price Chart Featuring Leading Retailers 2023-2024

    What Does the Future Hold for Egg Prices?

    The USDA reported recent severe avian flu outbreaks in June 2024. These outbreaks are estimated to have affected 6.23 million birds.

    With a reduction in egg-laying hens, egg prices are likely to increase — time will tell.

    Nonetheless, the annual per capita consumption of eggs in the U.S. is projected to reach 284.4 per person in 2024 from 281.3 per person in 2023. So for now, producers and retailers can rest assured of the growing demand for eggs.

    How Can Retailers Adapt to the Unpredictability of Egg Prices?

    Egg prices were down to $2.69 for a dozen in May 2024. However, they are still significantly higher than consumers were used to just a few years ago—eggs were, on average, $1.46 a dozen in early 2020.

    Additionally, while the avian flu puts pressure on producers, inflation and supply chain disruptions exert pressure on retailers.

    With such challenging egg market conditions, what can retailers do to maintain customer loyalty amid reduced consumer spending while maintaining profitability?

    1. Give the Customer What They Want: Increase Offerings of Organic, Cage-Free, and Free-Range Eggs

    As mentioned, Data Bridge Market Research’s trends and forecast report highlighted a significant increase in consumer health consciousness. Additionally, animal welfare increasingly influences consumers’ purchasing decisions when buying meat and dairy products.

    DataWeave data shows that the prices of organic, cage-free, and free-range eggs—such as those by brands like Happy Eggs and Marketside—have fallen less than those of non-organic, caged egg brands.

    Egg Price Chart Featuring Leading Egg Brand Prices 2023-2024

    2. Increase Private-Label Offerings

    Private labels typically offer retailers higher margins than national brands. These margins can shield consumers from sudden wholesale egg price swings, helping to preserve brand trust and consumer loyalty without sacrificing profitability.

    Moreover, eggs are particularly suited to private labeling, given their uniform appearance and taste and the lack of product innovation opportunities.

    Undoubtedly, this is why sales of private-label eggs dwarf sales of national egg brands in the United States. Statista reports that across three months in 2024, private label egg sales amounted to $1.55 billion U.S. dollars, while the combined sales of the top nine national egg brands totaled just $617.88 million U.S. dollars.

    3. Price Intelligently

    With the current and predicted fluctuations in egg prices over the foreseeable future, price competitiveness is paramount to margin management and customer loyalty.

    This is especially true when lower prices are the primary factor influencing the average consumer’s choice of supermarket for daily essentials purchases.

    AI-driven pricing intelligence tools like DataWeave give retailers valuable highly granular and reliable insights on competitor pricing and market dynamics. In today’s data-motivated environment, these insights are necessary for competitiveness and profitability.

    Final Thoughts

    Egg prices have fluctuated significantly due to the impact of avian flu. Despite recent price drops, future egg price increases are possible due to ongoing outbreaks. Retailers should adapt to unstable egg prices by increasing organic, free-range, cage-free, and private-label egg offerings while leveraging AI-driven pricing tools to maintain margins and customer loyalty.

    Speak to us today to learn more!

  • How Healthy is Your Assortment?

    How Healthy is Your Assortment?

    In 2025, both consumers and retailers continue to prioritize better health – albeit with evolving definitions and expectations.

    The pandemic fundamentally transformed how consumers approach wellness, with this shift becoming entrenched in shopping behaviors years later. As shopping habits have permanently altered, retailers now face increased pressure to rapidly adapt their assortments with in-demand health and wellness products that enhance customer experience across various channels – online and offline.

    Let’s explore how leading retailers are keeping consumers – and their own bottom lines – healthy by responding effectively to market trends to drive online sales and market share.

    Health & Wellness Influence The Product Mix Across Categories

    Consumption habits have changed dramatically since the onset of the pandemic. A McKinsey study shows that 82% and 73% of US, and UK consumers respectively now consider health & wellness a top priority. Typically shoppers adjust grocery shopping and meal planning at the start of the year, with many focusing on fresh, organic, and nutrient-rich foods.

    The influential health and wellness mega-trend spans diverse retail channels, including grocery, pharmacy and mass. It extends across numerous categories like:

    • Food and beverage (natural, organic, vegan, plant-based food)
    • Health and personal care
    • Beauty
    • Cleaning products
    • Fitness equipment 
    • Athleisure (apparel)
    • Consumer electronics like health wearables.

    Today’s health movement is so powerful and compelling that retailers have revised their business strategies to better serve health-conscious consumers. For instance, drugstores are reinventing themselves as healthcare destinations, with CVS and Kroger expanding into personalized care delivery and value-based clinics to enhance their health offerings.

    Major retailers like Amazon, Walmart, and Target report robust sales in health and wellness categories. For example, Walmart saw a 4.6% increase in comparable sales in early 2024, driven significantly by grocery, consumables, and health-related products.

    New product categories are gaining traction:

    • Functional foods and beverages are seeing unprecedented growth, with Target launching over 2,000 wellness items in the category, including exclusive products priced under $10.
    • Personalized nutrition and mental health products are surging, including tailored dietary solutions and stress-reducing items.
    • Health wearables and wellness tech continue to rise in popularity, with over 150 new wellness tech items launched at Target this year, including innovative red-light therapy devices.
    • Transparency and sustainability certifications like organic, non-GMO, and vegan labels are increasingly driving purchasing decisions.
    • Clinically proven benefits offered by health & wellness products are gaining traction among Gen Z.

    Retail’s Survival Of The Fittest Moves Online

    As the omnichannel retail sector continues to grow, more shoppers now make purchase decisions within minutes using just a few clicks rather than physically visiting brick-and-mortar stores. In some cases, AI agents like Operator from Chat-GPT or Gemini (Google’s Chatbot) even make personalized, curated lists and reduce the time taken to make purchase decisions. Traditional retail paradigms are rapidly becoming obsolete as consumers grow savvier, more empowered, and better informed than ever before.

    To stay competitive, more retailers are embracing AI-driven data insights to adjust their assortments to reflect consumer demand for health and wellness products.

    According to industry experts, data insights have emerged as a critical retail strategy that continues to gain momentum. This is because retailers can no longer afford to guess how to approach their omnichannel strategy. They need the accuracy, clarity, and efficiency of data insights to guide their assortment and pricing decisions to outmaneuver competitors, maximize sales, and win market share as shopping evolves online.

    Among its retail best practices, Bain & Company recommends retailers “lead with superior assortments that use a customer-centric lens to reduce complexity and increase space for the products customers love.” Insights can help retailers discover the optimal mix of national brands, private labels, limited-time offers, and value-added bundles.

    “Lead with superior assortments …
    increase space for the products consumers love    “
    ~ Bain & Company

    Determining the optimal mix of products also includes bestsellers and unique items that help retailers distinguish their offerings. Assortment insights help retail executives track competitors’ assortment changes and spot gaps in their own product assortment to adapt to emerging consumer trends and in-demand products.

    Why Effective Assortment Planning Matters

    Assortment planning sits at the heart of retail success, directly influencing profitability, customer satisfaction, and competitive differentiation. In today’s health-conscious market, getting your assortment right means:

    • Meeting Customer Expectations: Today’s health-conscious consumers expect relevant, high-quality products that match their wellness goals. A well-planned assortment signals that a retailer understands its customers’ evolving needs.
    • Optimizing Inventory Investment: Strategic assortment planning ensures capital is allocated to products with the highest return potential while minimizing investments in slow-moving items.
    • Creating Competitive Advantage: A distinctive assortment that includes popular health and wellness products alongside unique offerings helps retailers stand out in a crowded marketplace.
    • Reducing Lost Sales: Effective assortment planning minimizes the risk of stockouts on high-demand health and wellness items, preventing customers from shopping elsewhere.
    • Supporting Omnichannel Strategies: Well-executed assortment planning ensures consistency across physical and digital touchpoints, creating a seamless customer experience.
    • Improving Operational Efficiency: A thoughtfully curated assortment reduces complexity throughout the supply chain, from procurement to warehouse management to in-store operations.

    As health and wellness continues to drive consumer spending, retailers who excel at assortment planning can capitalize on these trends more effectively than their competitors, turning market insights into tangible business results.

    AI-Powered Assortment Analytics Driving Retail Success

    The synergy of AI and data analytics into retail assortment planning is changing how businesses approach inventory management. Retailers using AI-driven predictive analytics have achieved a 36% SKU reduction while increasing sales by 1-2%, showcasing the efficiency of data-driven approaches according to a McKinsey report.

    Retailers face several challenges that can hinder strategic assortment planning:

    • Limited Understanding of Competition: Retailers struggle to gain comprehensive insights into their product assortments relative to competitors, often lacking visibility into their strengths and weaknesses across categories.
    • Data Overload: Assortment planning involves handling vast amounts of data, making it challenging for category managers to extract actionable insights without user-friendly tools and visualization.
    • Cross-Channel Consistency: With omnichannel retailing, ensuring consistency across physical stores, e-commerce, and other channels is complex. Misalignment can lead to customer dissatisfaction and loss of loyalty.
    • Adapting to Changing Market Trends: Identifying top-selling products and tracking consumer preferences is challenging. Balancing the right mix of products is crucial; without analytics, retailers risk lost sales or excess slow-moving inventory.
    • Scalability and Efficiency: As retailers expand into new markets or categories, scaling their assortment planning processes efficiently becomes a challenge. Legacy systems and manual methods often fail to support the agility needed for quick decision-making at scale.

    DataWeave’s Assortment Analytics helps retailers address these challenges by providing a robust, easy-to-use platform that delivers actionable insights into product assortments and competitive positioning. With AI-driven, contextual insights and alerts, retailers can effortlessly identify high-demand, unique products, capitalize on catalog strengths, optimize pricing and promotions, improve stock availability, and refine assortments to maintain a competitive edge.

    Beyond Data: Actionable Insights That Drive Results

    DataWeave’s platform provides a comprehensive, insight-led view into assortments through several key dimensions:

    • Stock Insights: Monitor stock changes across retailers to stay updated on availability.
    • Category and Sub-Category Insights: Analyze assortment changes, identify newly introduced or discontinued categories, and track leading retailers in specific segments.
    • Brand Insights: Identify newly introduced, missing, or discontinued brands, as well as leading brands within chosen categories.
    • Product Insights: Identify bestsellers and evaluate their impact on your portfolio, analyzing pricing and promotions.
    • Personalized Recommendations: Receive suggestions tailored to your behavior and user profile to refine decision-making.
    • User-Configured Alerts: Stay informed with alerts designed to highlight significant changes or opportunities.

    The platform addresses data overload by providing an intuitive, insight-driven view of your assortment. Category managers gain a comprehensive, bird’s-eye perspective of key changes within specified timeframes, allowing them to focus on what matters most.

    Preparing for the Future of Retail Health

    To avoid supply chain bottlenecks, inventory shortages, and out-of-stock scenarios, retailers are strategically using data insights to anticipate fluctuations in demand and proactively plan how to manage disruptions that could affect their assortments.

    For variety that satisfies consumers’ diverse product needs, retailers are using data insights to determine whether to collaborate with nimble suppliers to promptly fill any gaps.

    To further strengthen their assortments’ attractiveness, retailers are using AI-powered pricing analytics to offer the right product at the right price. These analytics help retailers know exactly how they compare to rivals’ pricing moves with relevant data so they can keep up with market fluctuations and stay competitive by earning consumer engagement, sales, and trust.

    To Conclude…

    Like nourishing habits that improve consumers’ health, data insights improve retailers’ e-commerce health. Advanced assortment and pricing analytics, powered by artificial intelligence, help retailers make better decisions faster to boost their agility, outmaneuver rivals, and fuel online growth.

    In a retail landscape where consumer preferences for health and wellness continue to evolve rapidly, the retailers who thrive will be those who leverage data and AI to understand, anticipate, and meet these changing demands with the right products at the right time. Reach out to us to know more.

  • Using Siamese Networks to Power Accurate Product Matching in eCommerce

    Using Siamese Networks to Power Accurate Product Matching in eCommerce

    Retailers often compete on price to gain market share in high performance product categories. Brands too must ensure that their in-demand assortment is competitively priced across retailers. Commerce and digital shelf analytics solutions offer competitive pricing insights at both granular and SKU levels. Central to this intelligence gathering is a vital process: product matching.

    Product matching or product mapping involves associating identical or similar products across diverse online platforms or marketplaces. The matching process leverages the capabilities of Artificial Intelligence (AI) to automatically create connections between various representations of identical or similar products. AI models create groups or clusters of products that are exactly the same or “similar” (based on some objectively defined similarity criteria) to solve different use cases for retailers and consumer brands.

    Accurate product matching offers several key benefits for brands and retailers:

    • Competitive Pricing: By identifying identical products across platforms, businesses can compare prices and adjust their strategies to remain competitive.
    • Market Intelligence: Product matching enables brands to track their products’ performance across various retailers, providing valuable insights into market trends and consumer preferences.
    • Assortment Planning: Retailers can analyze their product range against competitors, identifying gaps or opportunities in their offerings.

    Why Product Matching is Incredibly Hard

    But product matching stands out as one of the most demanding technical processes for commerce intelligence tools. Here’s why:

    Data Complexity

    Product information comes in various (multimodal) formats – text, images, and sometimes video. Each format presents its own set of challenges, from inconsistent naming conventions to varying image quality.

    Data Variance

    The considerable fluctuations in both data quality and quantity across diverse product categories, geographical regions, and websites introduce an additional layer of complexity to the product matching process.

    Industry Specific Nuances

    Industry specific nuances introduce unique challenges to product matching. Exact matching may make sense in certain verticals, such as matching part numbers in industrial equipment or identifying substitute products in pharmaceuticals. But for other industries, exactly matched products may not offer accurate comparisons.

    • In the Fashion and Apparel industry, style-to-style matching, accommodating variants and distinguishing between core sizes and non-core sizes and age groups become essential for accurate results.
    • In Home Improvement, the presence of unbranded products, private labels, and the preference for matching sets rather than individual items complicates the process.
    • On the other hand, for grocery, product matching becomes intricate due to the distinction between item pricing and unit pricing. Managing the diverse landscape of different pack sizes, quantities, and packaging adds further layers of complexity.

    Diverse Downstream Use Cases

    The diverse downstream business applications give rise to various flavors of product matching tailored to meet specific needs and objectives.

    In essence, while product matching is a critical component in eCommerce, its intricacies demand sophisticated solutions that address the above challenges.

    To solve these challenges, at DataWeave, we’ve developed an advanced product matching system using Siamese Networks, a type of machine learning model particularly suited for comparison tasks.

    Siamese Networks for Product Matching

    Our methodology involves the use of ensemble deep learning architectures. In such cases, multiple AI models are trained and used simultaneously to ensure highly accurate matches. These models tackle NLP (natural language processing) and Computer Vision challenges specific to eCommerce. This technology helps us efficiently narrow down millions of product candidates to just 5-15 highly relevant matches.

    The Tech Powering Siamese Networks

    The key to our approach is creating what we call “embeddings” – think of these as unique digital fingerprints for each product. These embeddings are designed to capture the essence of a product in a way that makes similar products easy to identify, even when they look slightly different or have different names.

    Our system learns to create these embeddings by looking at millions of product pairs. It learns to make the embeddings for similar products very close to each other while keeping the embeddings for different products far apart. This process, known as metric learning, allows our system to recognize product similarities without needing to put every product into a rigid category.

    This approach is particularly powerful for eCommerce, where we often need to match products across different websites that might use different names or images for the same item. By focusing on the key features that make each product unique, our system can accurately match products even in challenging situations.

    How Siamese Networks Work?

    Imagine having a pair of identical twins who are experts at spotting similarities and differences. That’s essentially what a Siamese network is – a pair of identical AI systems working together to compare things.

    How it works:

    • Twin AI systems: Two identical AI systems look at two different products.
    • Creating ‘fingerprints’ or ‘embedding’: Each system creates a unique ‘fingerprint’ of the product it’s looking at.
    • Comparison: These ‘fingerprints’ are then compared to see how similar the products are.

    Architecture

    The architecture of a Siamese network typically consists of three main components: the shared network, the similarity metric, and the contrastive loss function.

    • Shared Network: This is the ‘brain’ that creates the product ‘fingerprints’ or ‘embeddings.’ It is responsible for extracting meaningful feature representations from the input samples. This network is composed of layers of neural units that work together. Weight sharing between the twin networks ensures that the model learns to extract comparable features for similar inputs, providing a basis for comparison.
    • Similarity Metric: After the shared network processes the inputs, a similarity metric is employed. This decides how alike two ‘fingerprints’ or ‘embeddings’ are. The selection of a similarity metric depends on the specific task and characteristics of the input data. Frequently used similarity metrics include the Euclidean distance, cosine similarity, or correlation coefficient, each chosen based on its suitability for the given context and desired outcomes.
    • Loss Function: For training the Siamese network, a specialized loss function is used. This helps the system improve its comparison skills over time. It guides and trains the network to generate akin embeddings for similar inputs and disparate embeddings for dissimilar inputs.

      This is achieved by imposing penalties on the model when the distance or dissimilarity between similar pairs surpasses a designated threshold, or when the distance between dissimilar pairs falls below another predefined threshold. This training strategy ensures that the network becomes adept at discerning and encoding the desired level of similarity or dissimilarity in its learned embeddings.

    How DataWeave Uses Siamese Networks for Product Matching

    At DataWeave, we use Siamese Networks to match products across different retailer websites. Here’s how it works:

    Pre-processing (Image Preparation)

    • We collect product images from various websites.
    • We clean these images up to make them easier for our AI to understand.
    • We use techniques like cropping, flipping, and adjusting colors to help our AI recognize products even if the images are slightly different.

    Training The AI

    • We show our AI system millions of product images, teaching it to recognize similarities and differences.
    • We use a special learning method called “Triplet Loss” to help our AI understand which products are the same and which are different.
    • We’ve tested different AI structures to find the one that works best for product matching, including ResNet, EfficientNet, NFNet, and ViT. 

    Image Retrieval 

    • Once trained, our AI creates a unique “fingerprint” for each product image.
    • We store these fingerprints in a smart database.
    • When we need to find a match for a product, we:
      • Create a fingerprint for the new product.
      • Quickly search our database for the most similar fingerprints.
      • Return the top matching products.

    Matches are then assigned a high or a low similarity score and segregated into “Exact Matches” or “Similar Matches.” For example, check out the image of this white shoe on the left. It has a low similarity score with the pink shoe (below) and so these SKUs are categorized as a “Similar Match.” Meanwhile, the shoe on the right is categorized as an “Exact Match.”

    Similarly, in the following image of the dress for a young girl, the matched SKU has a high similarity score and so this pair is categorized as an “Exact Match.”

    Siamese Networks play a pivotal role in DataWeave’s Product Matching Engine. Amid the millions of images and product descriptions online, our Siamese Networks act as an equalizing force, efficiently narrowing down millions of candidates to a curated selection of 10-15 potential matches. 

    In addition, these networks also find application in several other contexts at DataWeave. They are used to train our system to understand text-only data from product titles and joint multimodal content from product descriptions.

    Leverage Our AI-Driven Product Matching To Get Insightful Data

    In summary, accurate and efficient product matching is no longer a luxury – it’s a necessity. DataWeave’s advanced product matching solution provides brands and retailers with the tools they need to navigate this complex landscape, turning the challenge of product matching into a competitive advantage.

    By leveraging cutting-edge technology and simplifying it for practical use, we empower businesses to make informed decisions, optimize their operations, and stay ahead in the ever-evolving eCommerce market. To learn more, reach out to us today!

  • Why Strategic Competitive Insights Are Key to Optimizing Your Product Assortment

    Why Strategic Competitive Insights Are Key to Optimizing Your Product Assortment

    For retailers, the breadth and relevance of their product assortment are critical for success. Amid a crowded market filled with countless products clamoring for consumer attention, retailers must find innovative ways to distinguish themselves. While pricing undeniably impacts purchasing decisions, the diversity and distinctiveness of a retailer’s product range can provide a crucial competitive advantage.

    Creating an attractive and profitable assortment that resonates with your target audience requires more than intuition; it demands deep insights into both your own and your competitors’ offerings. A well-curated assortment aligned with current trends can drive higher conversions and foster customer loyalty. However, achieving this perfect balance is a formidable challenge without the right insights.

    This is where a data-driven strategy becomes essential, enabling you to curate a product mix that captivates and converts.

    However, retailers often encounter significant challenges when attempting to strategically plan their assortments:

    • Limited Competitive Insights: Gaining a clear understanding of your competitors’ assortment strengths and weaknesses across various categories is challenging. Without this visibility, it’s difficult to know where you have an edge or where you might be falling behind.
    • Tracking Demand Patterns: Identifying top-sellers and monitoring shifts in consumer demand can be a struggle. Without the ability to easily detect trends or changes in demand, you risk missing opportunities to stock trending items.

    Attempting to navigate these challenges manually is not only arduous but also susceptible to substantial errors.

    How Assortment Analytics Solutions Help

    The ideal Assortment Analytics solution must offer a fact-based approach to:

    • Identify Strengths and Weaknesses: Understand how your assortment measures up against the competition.
    • Stay Trend-Responsive: Keep your product mix fresh and aligned with the latest consumer trends.
    • Boost Conversions: Create a relatively unique, customer-focused assortment that enhances conversions.

    Many retailers attempt to analyze competitor assortments using manual, in-house methods, which inevitably leads to significant blind spots:

    • Variations in product classifications and taxonomies across competitors make meaningful comparisons challenging.
    • Gathering complete and accurate data across a vast competitive landscape is difficult.
    • Inconsistent titles and descriptions hinder reliable product matching without AI assistance.
    • Capturing and comparing detailed product attributes efficiently is nearly impossible without advanced tools.

    To overcome these challenges, retailers need a scalable, accurate Assortment Analysis solution designed specifically for the complexities of modern retail needs.

    DataWeave’s Assortment Analytics Solution

    DataWeave addresses these challenges by providing retailers with a robust platform to gain actionable insights into their product assortments and the competitive landscape. Leveraging advanced analytics and AI-driven algorithms, Assortment Analytics empowers retailers to make informed assortment management decisions, optimize their product offerings, and stay competitive.

    Armed with our insights, retailers can lead with their strengths and stock unique and in-demand products in their assortment. Further, by recognizing the strengths in their product catalog, they can craft effective pricing strategies and optimize their logistics, creating a more competitive and appealing shopping experience for their customers. Here are a few capabilities of DataWeave’s solution:

    In-Depth Competitive Analysis Across Retailers

    The solution offers detailed competitive analysis, revealing insights into competitors’ assortments. It maps competitor products to a common taxonomy, making comparisons accurate and meaningful. Retailers can visualize assortments at granular levels like category, sub-category, and product type.

    The data for these insights is collected at configurable intervals, typically monthly or quarterly, and is consumed not only via dashboard summaries but also raw data files to enable in-depth analysis. Retailers have the flexibility to choose specific competitors, brands, products, and categories for tracking, allowing for a tailored and strategic approach to assortment optimization.

    Brand and Category Views to Assess Your Portfolio

    The solution provides a comprehensive evaluation of your product assortment through brand and category views. In brand views, your portfolio is assessed against competitors at the brand level, highlighting:

    • Newly Introduced Brands: Insights into recently introduced brands, revealing shifts in the brand landscape.
    • Absence or Limited Presence: Identification of brands lacking representation or with minimal presence compared to competitors, indicating areas for improvement.
    • Strong Presence and Exclusivity: Recognition of brands where you excel, including exclusive offerings, showcasing your competitive edge.

    Identifying Top-Selling Competitive Products To Boost Assortment Strategy

    Beyond just comparing assortment numbers, the DataWeave solution surfaces insights into which competitor products are actually performing well. It equips category and assortment managers with indicators that assess competitor products in terms of their popularity and shelf velocity.

    It analyzes metrics like pricing fluctuations, ratings, customer reviews, search rankings, and replenishment rates to pinpoint hot sellers you may want to stock. With these insights, merchandizing managers can pinpoint top-selling products among competitors, enabling informed decisions to enhance their assortment in comparison.

    Sophisticated Attribute Tagging and Analysis

    Using AI-powered attribute tagging, the solution simplifies granular product analysis within specific categories. An Apparel retailer, for instance, can filter the data to compare assortments based on attributes like material, pattern, color, etc.

    Retailers can select attributes relevant to their products and gain detailed insights. These custom filter attributes dynamically populate the panel, facilitating targeted data exploration. Category and merchandizing managers can delve into critical details swiftly, enabling strategic decision-making and comprehensive competitive analysis within their categories.

    You can capitalize on opportunities by stocking in-demand, on-trend items and address assortment gaps quickly. At the same time, you can double down on your strengths by enhancing your exclusive or top-performing product sets.

    In summary, DataWeave’s Assortment Analytics solution provides an invaluable competitive edge. The insights enable evidence-based decisions to attract more customers, encourage bigger baskets, and maximize the value of every assortment choice.

    To learn more, read our detailed product guide here or get on a exploratory call with one of our experts today!

  • 6 Common Pricing Intelligence Challenges Retailers Face (And How to Overcome Them)

    6 Common Pricing Intelligence Challenges Retailers Face (And How to Overcome Them)

    When your product pricing is sub-optimal, you leave money on the table. This is especially significant for eCommerce retailers who must contend with their consumers ‘shopping around’ for the best price before making a purchase. All eCommerce retailers experience some amount of cart abandonment. In fact, the average cart abandonment rate is estimated at 70.19%, and the reason is often that customers find a better price elsewhere, whether at other online stores or in traditional brick-and-mortar ones.

    If you want to win the business of price-sensitive shoppers, you need a robust pricing strategy to keep up with changing competitor pricing. That’s one reason (among others) that retailers rely heavily on pricing intelligence solutions. With the right pricing intelligence solution, retailers can stay on top of market shifts, manage profit margins, maintain price perception, and of course, price their products competitively.

    Unfortunately, adding a new pricing intelligence solution to a retailer’s tech stack is not without its challenges. But the good news is there are ways to overcome them.

    In this post, we’ve rounded up six challenges most commonly cited by retailers and proposed strategies to overcome them. So if you’re considering a pricing intelligence solution that can get you closer to your business goals, read on to learn more.

    1. Scalability Constraints

    As access to the internet has expanded globally, the ratio of brick-and-mortar sales compared with eCommerce continues to narrow. A natural consequence of this is that more shoppers than ever before now browse and buy across diverse web environments, including mobile apps.

    This means that retailers need to track pricing across not just websites and physical stores, but also across mobile apps — a sales channel that was largely sidelined before.

    Modern pricing intelligence solutions need to consolidate data from:

    • Online storefronts
    • Mobile apps


    … and also from delivery channels, which often have different assortments and pricing:

    • Standard home delivery
    • Expedited, same-day home delivery
    • Buy online, pickup in-store (BOPIS)
    • Subscription
    • Curbside pickup


    In this context, imagine having to track the pricing of millions of SKUs compared against dozens of competitors each day. When new channels and devices are added, many pricing intelligence solutions in the market are unable to handle such data complexity and scale. They’re not built to continually grow and expand to meet changing needs. Even worse, some retailers opt for homegrown DIY systems, which struggle to keep the datasets updated, accurate, and current—activities that require significant cost and human effort.

    How DataWeave Bridges This Gap:

    What you need is a platform that can track millions of SKUs across dozens of competitors and geographies. No matter where the data is coming from or how vast the demand for the product is, an ideal solution should be able to synthesize huge amounts of complex data and generate meaningful insights.

    Your competitors are continually changing their eCommerce setup, whether through subtle changes to their product attribute listings or broader changes to domains or apps. With DataWeave’s pricing intelligence solution designed to scale up as required, you never need to worry about the backend flexing to accommodate changes.

    2. Inability to Match Products Without Clear UPC/EAN Identifiers

    Another problem with many pricing intelligence solutions is their inability to match products if a UPC/EAN identifier is missing. Often, a competitor will list an identical product on their storefront and omit any clear identifiers. On Amazon, an ASIN might be listed or you might be able to bring in a DPCI from Target.com. However, without clear identifiers across eCommerce platforms, retailers struggle to aggregate every instance of the products, and as a result, are unable to achieve accurate pricing comparisons. They often face this challenge when they work with commoditized web scraping service providers who have very limited expertise or experience in refining the data into meaningful insights.

    How DataWeave Bridges This Gap:

    If you can’t match UPC/EAN codes, you need a solution that leverages artificial intelligence to match products based on other variables, such as product titles, descriptions, and images. AI, in combination with human expertise, can take on the task at a speed and accuracy that would be unfeasible for humans alone.

    Artificial Intelligence is constantly learning and improving. At DataWeave, we accelerate this process by introducing new scenarios and datasets for the product to continually learn from. At the outset, our AI product matching is roughly 80-90% accurate every time. To improve this number to over 95%, we introduce human validation and nuanced judgments. Over the years, this feedback loop has continued to refine its algorithms, resulting in near-perfect data accuracy for retailers.

    Our solution uses AI built on more than ten years of data to perform robust product matching for retailers at a massive scale. Using a unified platform with text and image recognition, DataWeave matches products from among hundreds of eCommerce websites and across millions of products.

    3. Poor and Inconsistent Data

    Retailers often complain that the data within their pricing intelligence solution isn’t accurate, is inconsistent, and may even be comprised of statistical smoothing and gap-plugging smokescreens. The root of this problem often lies in the inability of these tools to consistently track prices across diverse web environments. Poorly designed web scraping infrastructure fail when eCommerce websites change their underlying configuration and structure (which happens periodically). As a result, they don’t have enough data to see the market as a whole, and end up viewing synthetic or small sample-set data.

    How DataWeave Bridges This Gap:

    At DataWeave, transparency drives our approach to delivering insights. We only present real-world data in our data feeds and dashboards to customers. This is possible only due to the supreme confidence we have in our ability to consistently capture and present accurate data. We achieve this by using a combination of AI and sophisticated web scraping infrastructure developed and enhanced over a decade.

    In fact, we are the first in the industry to launch a Data Statistics Dashboard that helps our customers scrutinize match rates, track data freshness, highlight any gaps in the data, and manage product matches independently.

    4. Limited Integration Options with Internal Systems

    Too often, a retailer will select a pricing intelligence solution that promises exceptional insights but then fails to offer a manageable workflow for day-to-day use. This usually happens because it doesn’t integrate with the retailer’s existing tech stack.

    Without a convenient process that connects internal systems, your pricing intelligence solution is just another piece of technology that your team does not use to its full potential. You may require your competitor pricing data to flow into price optimization tools, price management tools, BI tools, ERP systems, or revenue management systems. Without this capability, you’ll see limited ROI and underwhelming results because all the insights in the world are of little use if you can’t consume them easily and put them into action.

    How DataWeave Bridges This Gap:

    At DataWeave, we understand the importance of being able to integrate external data with your internal tech stack. Our data can be accessed and extracted using plug-and-play APIs, enabling businesses to combine their external and internal data to generate predictive intelligence.

    We also have other data feeds ready to be integrated, including FTP and Amazon S3. Our integration experts can work with you to create custom integrations to existing internal pricing platforms. Our ultimate goal here is to seamlessly elevate your pricing intelligence strategy with minimal change management.

    5. Limited Custom Analysis Capabilities

    Every retailer is unique. There are various geographies, languages, markets, product categories, and pricing strategies that differentiate one retailer from the next. Many retailers find it challenging to derive actionable insights from their pricing intelligence solution because the analysis and customization capabilities are too limited.

    For example, some retailers might want to evaluate their competitiveness after applying coupons and promos to selling prices. Others may want to perform a one-time pricing analysis of just list prices across competitors. Some may want to view insights that help them take tactical decisions day-to-day, while others would like a historical view across multiple dimensions to help make strategic long-term pricing decisions.

    Without the ability to customize their views or the underlying data, retailers could feel restricted in their ability to drive meaningful impact with their pricing intelligence.

    How DataWeave Bridges This Gap:

    What you need are foundational dashboards, reports, and visualizations in a web portal that can be tailored to your business needs. Then, you need the expertise and guidance of a team of business analysts who can help you configure custom reports and dashboards.

    At DataWeave, we offer bespoke insights for each persona, enabling swift actions on relevant competitive intelligence. These include day-to-day tactical recommendations or inputs for long-term strategies. And because all DataWeave customers get access to our team of expert analysts, it’s simple and straightforward to configure unique reports and dashboards to suit your business.

    6. Sloppy Support

    No solution, at least not one that undertakes complex work, works optimally with a ‘set it and forget it’ approach. From time-to-time, you need human intervention to ensure your pricing intelligence is working in the way that it needs to for you. Unfortunately, one of the most common challenges retailers face with their pricing intelligence tool is a lack of support.

    Unavailable or patchy customer support is a significant challenge that can result in low confidence, delayed resolutions, and even abandoned pricing actions.

    How DataWeave Bridges This Gap:

    Dataweave’s global team of pricing experts are available around the clock for support and guidance. Not only do we have tech experts and business analysts that you can consult at any point, we also have an exceptional team of customer success professionals to help you overcome any technical and strategic issue you might face.

    As one customer puts it, with DataWeave you gain access to: “Excellent customer service, super collaborative staff, user-friendly interface.”

    Another verified user from the consumer goods industry had this to say:

    “Great platform and customer service! Our client service team is very helpful and always responds to ad-hoc requests in a very timely matter!”

    Read more reviews from real DataWeave users on G2: https://www.g2.com/products/dataweave/reviews

    Finding The Right Pricing Intelligence Solution

    As the competition heats up, retailers need to unlock every available opportunity to gain an edge and capture market share. At DataWeave, our AI-powered pricing intelligence software helps you uncover gaps quickly and build a pricing strategy that is as attractive as it is effective. Our ability to scale, match your products across the entire ecosystem with consistent accuracy, and slide right into your current operations to provide advanced analytics, makes us the preferred choice for many of the world’s leading retailers.

    Want to start benefiting from actionable product matching and pricing intelligence? Request a demo today.

  • Cinco de Mayo 2024 Pricing Insights: An Analysis of Discounts Amid Inflation

    Cinco de Mayo 2024 Pricing Insights: An Analysis of Discounts Amid Inflation

    Cinco de Mayo is a vibrant celebration of Mexican-American and Hispanic heritage, marked by lively parades, festive tacos, and refreshing tequila across North America. For the service industry, brands, and retailers, this day offers a golden opportunity to roll out enticing promotions on beloved Mexican foods and beverages, drawing in large crowds and boosting sales.

    Americans love to indulge in Mexican cuisine during Cinco de Mayo. Take avocados, for example: despite inflation, avocado sales soared to 52.3 million units this year, marking a 25% increase from last year, according to the Hass Avocado Board’s 2023 Holiday Report. Such festive events see a significant sales spike, largely driven by appealing discounts and special offers.

    So, what discounts did retailers roll out this Cinco de Mayo?

    At DataWeave, our cutting-edge data aggregation and analysis platform tracked and analyzed the prices and deals on Mexican food and alcohol products offered by leading retailers. Our in-depth analysis sheds light on their pricing competitiveness during Cinco de Mayo, revealing how pricing strategies differed across various subcategories and brands.

    We conducted a similar analysis in 2022, allowing us to compare the prices of identical products this year versus last year. This comparison helps us understand the impact of inflation over the past two years on the prices offered today.

    Our Methodology

    For our analysis, we monitored the average discounts offered by major US retailers on over 2,000 food and beverage products during Cinco de Mayo, as well as in the days leading up to the event. Many retailers kick off their Cinco de Mayo promotions a week before, so we included the entire week leading up to May 5th in our analysis.

    Key Details:

    • Number of SKUs: 2000+
    • Retailers Analyzed: Target, Amazon Fresh, Safeway, Walmart, Total Wines & More, Sam’s Club, Meijer, Kroger
    • Categories: Food, Alcohol
    • Analysis Period: April 28 – May 5

    To truly demonstrate the value of Cinco de Mayo for shoppers, we concentrated on price reductions and additional discounts during the event. By comparing these with regular day discounts, we were able to highlight the genuine savings and benefits that Cinco de Mayo promotions offer to budget-conscious consumers.

    Our Findings

    Safeway led the pack with the highest average additional discount of 4.91%, covering 38.6% of their food inventory for Cinco de Mayo. Total Wine & More followed closely, offering an average discount of 3.46% across 70.8% of its tequila, whiskey, mezcal, and other spirit products during the Cinco de Mayo week.

    In contrast, Target provided minimal additional discounts, averaging just 0.8% over a small fraction (11.6%) of its SKUs. Similarly, Kroger’s additional discounts were also 0.8%, but they were spread across over 60% of its tracked products. Walmart (1.4%) and Amazon Fresh (1.2%) offered relatively conservative discounts during the sale period.

    During Cinco de Mayo, various brands rolled out attractive discounts to entice shoppers. Among beverage brands, The American Plains vodka led the way with the highest average discount of 20.80%. Coffee brands also joined the festivities with significant discounts: Death Wish Coffee at 14.30%, Dunkin’ at 11.10%, and Starbucks at 5.70%. Notably, Dunkin’ and Death Wish Coffee introduced complimentary beverages such as whiskey barrel-aged coffee and spiked coffee products to celebrate the event.

    In the wine category, Erath stood out with a 10% additional discount. However, brands like Jose Cuervo and Franzia offered more modest discounts of 0.70% and 1.80%, respectively.

    Food brands associated with traditional Mexican ingredients or products, such as tortillas, salsas, and spices, provided higher discounts compared to mainstream snack brands. For instance, McCormick (25%), El Monterey (13.3%), and La Tortilla Factory (16.7%)—known for ready-to-eat frozen foods, seasonings, and condiments—delivered the highest discounts. Other notable discounts included Jose Ole (12.5%), a frozen food brand, and Yucatan (8.3%), known for its guacamole.

    Safeway’s private label brand, Signature Select, offered a 5.20% discount. Additionally, Safeway provided deep discounts on brands like Pace, Herdez, and Taco Bell, indicating an aggressive discounting strategy. In contrast, brands closely associated with Mexican or Tex-Mex cuisine, such as Old El Paso, Mission, Rosarita, and La Banderita, offered relatively modest discounts ranging from 0.5% to 3.3%.

    The discount patterns varied between alcohol and food categories, with food brands generally offering higher discounts. This trend may be attributed to pricing being regulated in the alcohol industry. These differing discount levels highlight how brands navigated the balance between driving sales and maintaining profit margins during Cinco de Mayo, particularly in the context of inflation affecting costs.

    Impact of Inflation on Cinco de Mayo Prices (2024 vs 2022)

    To gauge the impact of inflation on popular Cinco de Mayo products, we analyzed the average prices at Walmart and Target between 2022 and 2024. These two retailers were chosen due to their prominence in the retail sector and the robustness of our sample data.

    At Walmart, the Tex Mex category saw the highest average price increase, rising by 22.51%. Other notable subcategories with significant price hikes include Condiments (23.21%), Vegetables/Packaged Vegetables (21.22%), and Lasagne (14.10%). Categories like Dips & Spreads (13.77%), Pantry Staples (14.92%), and Salsa & Dips (8.23%) experienced relatively lower increases.

    At Target, the Snacks subcategory had the steepest average price rise at 27.94%, followed by Meal Essentials (16.07%) and Deli Pre-Pack (8.82%). Categories such as Dairy (0.51%), Frozen Meals/Sides (7.11%), and Adult Beverages (7.41%) saw smaller price increases.

    Brands associated with traditional Mexican or Tex-Mex cuisine faced higher price hikes. Examples include Old El Paso (24.59% at Walmart, 8.70% at Target), Tostitos (35.44% at Walmart, 11.41% at Target), Ortega (30.59% at Walmart, 19.69% at Target), and Rosarita (14.39% at Walmart).

    In contrast, private label or store brands generally experienced lower price increases compared to national brands. For instance, Good & Gather (Target’s private label) saw a 9.55% increase, while Market Pantry (Walmart’s private label) had a 17.27% rise. This trend is understandable as retailers have more control over their costs with private label brands.

    The data clearly indicates that both Walmart and Target have significantly raised prices across various categories and brands, reflecting the broader inflationary environment where the cost of goods and services has been steadily climbing.

    Interestingly, we observed higher price increases at Walmart compared to Target. Although Walmart is renowned for its consumer-friendly pricing strategies, it too had to elevate grocery prices post-2022 to combat inflationary pressures. As consumers become more cost-conscious and reduce spending on discretionary items, Walmart and other retailers are now cutting prices across categories to align with shifting consumer behaviors.

    Mastering Pricing Strategies During Sale Events

    Our pricing analysis for Cinco de Mayo reveals compelling insights into the dynamics of retailer landscapes in the US. It highlights the enduring relevance of private label brands, even amidst fluctuating demand, showing the emergence of local, national, and small players vying for market share.

    As retailers navigate inflationary pressures and evolving consumer behaviors, understanding these pricing dynamics becomes crucial for optimizing strategies and bolstering market competitiveness. This analysis offers actionable intelligence for retailers seeking to navigate the intricate terrain of sale event promotions while addressing shifting consumer preferences and economic challenges.

    Access to reliable and timely pricing data equips retailers and brands with the tools needed to make informed decisions and drive profitable growth in an increasingly competitive environment. To learn more and gain guidance, reach out to us to speak to a DataWeave expert today!

  • How Monitoring and Analyzing  End-User Prices can Help Retailers and Brands Gain a Competitive Edge

    How Monitoring and Analyzing  End-User Prices can Help Retailers and Brands Gain a Competitive Edge

    Retailers and brands are constantly engaged in a fierce battle over prices and discounts. Whether it’s major events like Amazon Prime Day, brand-led sales, or everyday price wars, they depend on pricing intelligence and digital shelf analytics to fine-tune their strategies. With a variety of offers such as sales, promotions, and bundles, determining the actual cost to the customer becomes a complex task. The price set by the brand, the retailer’s offer, and the final amount paid by the customer often vary significantly.

    In their analysis, retailers and brands frequently focus on the listed price or the final sale price, overlooking a critical factor: the “end-user price.” This includes all discounts, taxes, and shipping costs, providing a more accurate picture of what customers are truly willing to pay at checkout.

    Grasping this end-user price is vital for both retailers and brands. For retailers, it helps them stay competitive and refine their promotional strategies. For brands, it offers insights into competitive positioning, net revenue management, and shaping customer price perception.

    However, emphasizing the end-user price is challenging, as it involves comprehending all the intricate elements of pricing.

    How end-user pricing is calculated

    The list price, also known as the manufacturer’s recommended retail price (MSRP), is the initial price set by the brand. This may not always be displayed on marketplaces, especially in categories like grocery. The selling price, on the other hand, is the amount at which a retailer offers the product, often reduced from the list price. The end-user price is the actual amount the customer pays at checkout, which includes taxes, promotions, and other factors that affect the final cost.

    The process involves 3 key stages:

    Step 1: Identifying and categorizing promotional offers

    The first critical step in calculating end-user pricing is to identify and categorize the various promotional offers available for a given product that can reduce the final amount paid by the consumer. These promotions span a wide range of types:

    • Bank Offers: Involving discounts or cash back incentives when paying with specific bank credit or debit cards. For instance, a customer may receive 10% cashback on their purchase by using a specific bank’s card.
    • Bundled Deals: Combining multiple products or services at a discounted bundle price. A common example is a smartphone bundle including the phone itself, a protective case, and earphones at a reduced total cost.
    • Promo Codes/Coupons: Customers can enter promo codes or coupons during checkout to unlock special discounted prices or percentage-off offers, like 20% off a hotel booking, or even a special brand discount personalized for their needs (think loyalty offers and in-app promotions).
    • Shipping Offers: These include free shipping or reduced shipping fees for certain products or orders, such as free delivery on orders above a set amount.
    • TPRs (Temporary Price Reductions): TPRs play a significant role in the strategies of most retailers. Brands and retailers use them to encourage shoppers to purchase more of a product or to try a new product they wouldn’t usually buy. A TPR involves reducing the price of a product by more than 5% from its regular shelf price.

    By accurately identifying and classifying each type of promotion available, brands can then calculate the potential end-user pricing points.

    Step 2: Accounting for location and fulfilment nuances (delivery, in-store pickup) that impact final pricing

    Product pricing and promotional offers can vary based on the consumer’s location or ZIP code. Additionally, customers may opt for different fulfilment modes like delivery, shipping, or in-store pickup, which can further impact the final cost. Accurately calculating the end-user price necessitates considering these location-based pricing nuances as well as the chosen fulfilment method.

    In the example below, the selling price is $4.32 for one retailer (on the left in the image) after a discount for online purchase. In another case with Meijer, the item total shows $17.91, but the consumer ends up paying $15.74 after taxes and fees are applied (on the right in the image).

    Step 3: Applying each eligible promotion or offer to the selling price to determine potential end-user price points

    With the various promotional offers and discounts categorized in the previous steps, retailers and brands can now apply each eligible promotion to the product’s selling price. This involves deducting percentages for bank cashback, implementing bundled pricing, applying coupon code discounts, and incorporating shipping promotions.

    For retailers, this step allows them to calculate their true effective selling price to customers after all discounts and promotions. They can then compare this end-user price against competitors to ensure they remain competitively priced.

    For brands, by systematically layering every applicable offer onto the baseline selling price, they can accurately calculate the multiple potential end-user price points a customer may pay at checkout for their products across different retailers and regions.

    Why the end-user price matters

    Optimizing pricing strategies using the end-user price can benefit retailers and brands in several ways:

    • Price Competitiveness: By monitoring end-user pricing, retailers can adjust for discounts and promotional offers to attract customers, while brands can refine their pricing models to stay ahead in the market.
    • Customer Acquisition and Loyalty: Offers, promotions, and discounts directly impact the final price paid by customers, playing a crucial role in attracting new customers and retaining existing ones. For example, Walmart’s competitive pricing in groceries boosts customer loyalty and repeat purchases.
    • Consumer Perception: End-user pricing significantly shapes how consumers perceive both retailers and brands. Competitive pricing and promotional transparency enhance reputation and conversion rates. Amazon, for instance, is known for its competitive pricing and fast deliveries, which strengthen its consumer perception and satisfaction.
    • Sales Volumes: The final checkout price influences affordability and perceived value, directly affecting sales volumes. Both retailers and brands benefit from understanding this, as it guides consumer purchasing decisions and drives revenue streams.
    • Brand Perception: Consistent and transparent pricing enhances the perception of both the retailer and the brand. This not only strengthens the value proposition but also builds consumer trust and fosters long-term loyalty.

    While the listed and selling prices are readily available, calculating the true end-user price is quite complex. It involves meticulous tracking and application of various types of promotions, offers, location-based pricing nuances, and fulfillment costs – an uphill task without robust technological solutions.

    Track and Analyze end-user prices with DataWeave

    DataWeave’s end-user price tracking capability empowers retailers and brands with the insights and tools necessary to comprehend the complexities of pricing dynamics. For retailers, it offers the ability to monitor end-user pricing across various products and categories compared to competitors, ensuring competitiveness after all discounts and enabling optimization of promotional strategies. Brands benefit from informed pricing decisions, optimized strategies across retail channels, and a strengthened position within their industries.

    Our intuitive dashboard presents classified promotions and corresponding end-user prices across retailers, providing both retailers and brands with a transparent, comprehensive view of the end-user pricing landscape.

    Within the detailed product view of DataWeave’s dashboard, the Price and Promotions panel showcases diverse promotions available across different retailers for each product, along with the potential end-user price post-promotions.

    Harness the power of DataWeave’s sophisticated Pricing Intelligence and Digital Shelf Analytics to gain an accurate, real-time understanding of your end-user pricing dynamics. Make data-driven pricing decisions that resonate with customers and propel your brand toward sustained success.

    Find out how DataWeave can empower your eCommerce pricing strategy – get in touch with us today or write to us at contact@dataweave.com!

  • Augmenting AI-powered Product Matching with Human Expertise to Achieve Unparalleled Accuracy

    Augmenting AI-powered Product Matching with Human Expertise to Achieve Unparalleled Accuracy

    In today’s expansive omnichannel commerce landscape, pricing intelligence has become indispensable for retailers seeking to stay competitive and refine their pricing strategies. The sheer magnitude of eCommerce, spanning thousands of websites, billions of SKUs, and various form factors, adds layers of complexity. Consequently, ensuring the accuracy and reliability of competitive insights presents a formidable challenge for retailers aiming to leverage pricing data effectively.

    At the core of any robust pricing intelligence system lies product matching. This process enables retailers to recognize identical or similar products across competitors. Once these matches are identified, tracking prices is a relatively more straightforward task, facilitating ongoing analysis and informed decision-making.

    Accurate matching is crucial for meaningful price comparisons and tailoring product assortments. The challenge is matching products is often complicated, especially for non-local brands, niche categories, or items lacking consistent global identifiers. It becomes even trickier when trying to match very similar but not identical products. A comprehensive approach that compares and analyzes multiple attributes like product titles, descriptions, images and more is essential.

    Artificial intelligence algorithms are commonly used to automate product matching, leveraging machine learning techniques to analyze patterns in images and text data. While AI can adapt and improve over time, the question remains: Can it fully address the complexities of product matching on its own?

    The reality is that many retailers still struggle with incomplete, inaccurate, or outdated product data, despite these AI-powered product matching solutions. This can lead to suboptimal pricing decisions, missed opportunities, and reduced competitiveness.

    Challenges in an ‘AI-only’ Approach to Product Matching

    While AI plays a vital role in automated product matching solutions, there are complexities that AI alone cannot fully address:

    Subjectivity in Matching Criteria

    Some product categories have subjective or hard-to-quantify criteria for determining similarity. AI learns from historical data, so it may struggle with nuanced aspects like:

    Aesthetics, style, and design: In the Fashion and Jewellery vertical, for example, products are matched according to attributes like style, aesthetics, design – all of which have some subjectivity involved.

    Quantity/packaging variations: In the grocery sector, variations in product packaging and quantities can introduce complexities that require subjective decision-making. For example, apples may be sold in different packaging like a 0.5 kg bag or a pack of 4 individual apples. Determining if these different packaging options should be considered equivalent often involves making a qualitative judgment call, rather than a clear-cut objective decision.

    Matching product sets: For categories like home furnishings, the focus is often on matching coordinated sets rather than individual items. For example, in the bedroom category, matching may involve grouping together an entire set of complementary furniture like a bed frame, dresser, and wardrobe based on their cohesive design and style. This goes beyond simply making one-to-one product associations, requiring more nuanced judgments about aesthetic coordination.

    Contextual Factor

    Products can have regional preferences, cultural differences, or evolving trends that impact how they are matched. AI may miss important context like Local/regional product names or distinct brand names across countries.

    For instance, in the image we see Sprite (in the US) is branded Xubei in China. Continuous human curation is needed to help AI adapt to this context.

    High Accuracy & Coverage Expectations

    Retailers rely on AI powered and automated pricing adjustments based on product matching for insight. To ensure that pricing recommendations and updates are accurate, accurate product matching is crucial. For this, simply identifying similar top results is not enough – the process must comprehensively capture all relevant matches. While AI excels at finding the top groupings with around 80% accuracy, even small matching errors can have significant consequences.

    As AI matching improves, customer expectations may rise even higher. If AI achieves 90% accuracy, for instance, SLAs may demand over 95%. Reaching such a high level of accuracy is very challenging for AI alone, especially when faced with incomplete data, contextual nuances, evolving trends, and subjective matching criteria across products and categories.

    The solution is to combine the power of AI with human expertise. This is the key to achieving true data veracity – the accuracy, freshness, and comprehensive coverage required for precise and reliable product matching.

    Human-in-the-Loop Approach for Elevated Product Matching

    Human intelligence and quality testing can elevate the AI powered product matching process by addressing key challenges:

    • Matching Validation: AI algorithms may identify product matches with 80-90% accuracy initially. Having humans validate these AI-suggested matches allows for correcting errors and pushing the accuracy close to 100%. As humans flag issues, provide context, and re-label incorrect predictions, it allows the AI model to learn and enhance its reliability for complex, high-stakes decisions.
    • Applying Contextual Judgment: For subjective matching criteria like aesthetics, design, and categorizing product sets, human discernment is needed. Humans can make nuanced judgments beyond just quantitative rules, ensuring meaningful apples-to-apples product comparisons. Their contextual understanding augments AI’s capabilities.
    • Continuous Learning Via Feedback Loop: Product experts possess rich category knowledge across markets. Integrating this human insight through an iterative feedback loop helps AI models quickly learn and adapt to changing trends, preferences, and context. As humans explain their match assessments, the AI continuously enhances its precision over time.

    By combining AI’s automation and scale with human validation, judgment, and knowledge curation, pricing intelligence solutions can achieve the accuracy and coverage demanded for actionable competitive pricing insights.

    DataWeave’s Data Veracity Framework: A Scalable Workflow Combining AI and Human Expertise

    Given the vast number of products, retailers, and brands that exist today, any product matching solution must be highly scalable. At DataWeave, we bring you such a scalable workflow to address these complexities by integrating human expertise with AI-driven automation. The image below outlines our approach for combining AI with human intelligence in a seamless, scalable workflow for accurate product matching:

    Retailers and brands can benefit in several ways with this workflow, as listed below.

    Several Rounds of Data Verification Due to Hierarchical Validation Teams

    The workflow employs a hierarchical validation team of Leads and Executives to efficiently integrate human expertise without creating bottlenecks. Verification Leads play a pivotal role in managing the distribution of product matches identified by DataWeave’s AI model to the Verification Executives.

    The Executives then meticulously validate these AI-suggested matches, adding any missing product associations and removing inaccurate matches. After validation, the matched product groups are sent back to the Leads, who perform random sampling checks to ensure quality.

    Throughout this entire workflow, feedback and suggestions are continuously gathered from both the Executives and Leads. This curated input is then incorporated back into DataWeave’s AI model, allowing it to learn and improve its matching accuracy on an ongoing basis.

    This hierarchical structure ensures that human validation seamlessly scales alongside the AI’s matching capabilities. Leveraging the respective strengths of AI automation and human expertise in an iterative feedback loop prevents operational bottlenecks while steadily elevating overall accuracy.

    Confidence-based Distribution of Matched Articles for Validation

    The AI model assigns confidence scores, differentiating high-confidence (>95%) and low-confidence matches. For high-confidence groups, executives simply remove incorrect matches – a quicker process. Low-confidence matches require more human effort in adding/removing matches.

    As the AI model improves over time with feedback, the share of high-confidence matches increases, making validation more efficient and swift.

    Automated, Standardized Process with Iterative Feedback Loop

    The entire workflow is standardized and automated, with verification metrics seamlessly tracked. At each step, feedback captured from both leads and executives flows back into the AI, enhancing its matching accuracy and coverage iteratively.

    DataWeave’s closed-loop system of AI automation with hierarchical human validation allows product matching to achieve comprehensive accuracy at a vast scale.

    Unleash the Power Accurate and Comprehensive Product Matching

    In summary, combining AI and human expertise in product matching is crucial for retailers navigating the complexities of omnichannel retail. While AI algorithms excel in automation, they often struggle with subjective criteria and contextual nuances. DataWeave’s approach integrates AI-driven automation with human validation, delivering the industry’s most accurate product matching capabilities, enabling actionable competitive pricing insights.

    To learn more, reach out to us today!

  • Why Localized, Store-Specific Pricing and Availability Insights is Critical for Consumer Brands

    Why Localized, Store-Specific Pricing and Availability Insights is Critical for Consumer Brands

    Brands are becoming increasingly proficient in monitoring and refining their presence on online marketplaces, utilizing Digital Shelf Analytics to gather and analyze data on their online performance. These tools offer invaluable insights into enhancing visibility, adjusting pricing strategies, and improving content quality on eCommerce sites.

    Yet, as the retail landscape shifts towards a more integrated omnichannel approach, it’s crucial for brands, particularly those in CPG, to apply similar strategies to their offline channels. For brands that count physical stores among their primary sales channels, gaining localized insights is key to boosting in-store sales performance.

    Collecting shelf data from offline channels presents more challenges than online. Traditional methods, such as physical store visits, often fall short in reliability, timeliness, scale, and level of coverage.

    However, the world of eCommerce provides a solution. As part of the effort to facilitate options like buy-online-pickup-in-store (BOPIS) for shoppers, major retailers make store-specific product details available online. Consumers often go online and select their nearest store to make purchases digitally before choosing a fulfillment option like picking up at the store or direct delivery. Aggregating this store-level information offers brands critical insights into pricing and inventory across a vast network of stores, enabling them to make informed decisions that improve pricing strategies and supply chain efficiency, thus minimizing stockouts in crucial markets.

    Further, as consumers increasingly seek flexibility in how they receive their purchases—be it through in-store pickup, delivery, or shipping—brands need to adeptly monitor pricing and availability for these different fulfilment options. Such granular insight empowers brands to adapt swiftly and maintain a competitive edge in today’s dynamic retail environment.

    Why does monitoring pricing and availability data across stores matter to brands?

    • Hyperlocal Competitive Strategy: This allows brands to adjust their pricing strategies based on regional competition. By understanding the local market, brands can decide whether to position themselves as cost leaders or premium offerings. In particular, this is indispensable for Net Revenue Management (NRM) teams.
    • Targeted Marketing Initiatives: Understanding regional price and availability enables brands to customize their marketing efforts for specific markets. By aligning their strategies with local demand trends and inventory levels, brands can more effectively engage their target audiences.
    • Efficient Inventory Management: By keeping a close eye on store-level data, brands can better manage their stock, ensuring high-demand products are readily available while minimizing the risk of overstocking or running out of stock.
    • Minimum Advertised Price (MAP) Monitoring: While brands cannot directly control retail pricing, staying updated on pricing trends helps them adjust their MAP to reflect the competitive landscape, consumer expectations, cost considerations, and regional differences. A strategic approach to MAP management supports brand competitiveness and profitability in a fluctuating market.

    DataWeave’s Digital Shelf Analytics solutions equip brands with the necessary data and insights to do all of the above.

    DataWeave’s Digital Shelf Analytics is location-aware

    DataWeave’s Digital Shelf Analytics platform stands out with its sophisticated location-aware capabilities, enabling the aggregation and analysis of localized pricing, promotions, and availability data. Our platform defines locations using a range of identifiers, including latitudes and longitudes, ZIP codes, or specific stores, and can aggregate this data for particular states or regions.

    The strength of the platform lies in its robust data collection and processing framework, which operates seamlessly across thousands of stores and regions. This system is designed to operate at configurable intervals—daily, weekly, or monthly—allowing brands to keep a vigilant eye on product availability, pricing strategies, and delivery timelines based on the selected fulfillment option.

    Unlike many other providers, who may provide limited insights from a sample of stores, our solution delivers exhaustive analytics from every storefront. This comprehensive approach grants brands a strategic edge, facilitating efficient inventory tracking, precise pricing adjustments, and rapid responses to fluctuating market dynamics. It cultivates brand consistency and loyalty by enabling brands to adapt proactively to the changing landscape.

    Aggregated store-level digital shelf insights via DataWeave

    In the summarized view shown above, a brand can track how its various products are positioned across stores and retailers like Walmart, Amazon, Meijer, and others in the US.

    Using DataWeave, brands can easily see important metrics like availability levels, prices, and other metrics across these stores gaining immediate visibility without having to physically audit them. the brand can track the same metrics for products across competitor brands and inform its own pricing, stock, and assortment decisions.

    Store-level availability insights

    We provide a comprehensive view of product availability, highlighting the distribution of out-of-stock (OOS) scenarios across various retailers and pinpointing the availability status throughout a brand’s network of stores. This capability enables swift identification of widespread availability issues, offering a bird’s-eye view of where shortages are most pronounced. By simply hovering over a specific location, detailed information about stock status and pricing for individual stores becomes accessible.

    Such insights are crucial for brands to adapt their strategies, mitigate risks, and ensure they meet consumer needs despite the ever-changing retail ecosystem.

    Store-level pricing insights

    Retailers often adopt different pricing strategies to deal with margin pressure, local competition, and surplus stock. Grasping these pricing dynamics at a hyperlocal level enables brands to tailor their strategies effectively to maintain a competitive edge.

    Our platform offers an in-depth look at how prices vary among retailers, across different stores, and throughout various regions. This analysis reveals the nuanced pricing tactics employed by retailers on a regional scale.

    For example, brands might see that some retailers, like Kroger and Walmart in the chart below, maintain consistent pricing across their outlets, demonstrating a uniform pricing strategy. In contrast, others, such as Meijer and Shoprite, might adjust their prices to match local market conditions, indicating a more localized approach to pricing.

    With DataWeave, brands can dive deeper into the pricing landscape of a specific retailer, examining a price map that provides detailed information on pricing at the store level upon hovering over a given location.

    By presenting a historical analysis of average selling prices across different retailers, we equip brands with the insights needed to understand past pricing strategies and anticipate future trends, helping them to strategize more effectively in an ever-evolving market.

    Digital Shelf Analytics that work for both eCommerce and brick-and-mortar store data

    While established brands have made strides in gathering online pricing and availability data through Digital Shelf Analytics solutions, integrating comprehensive insights from both brick-and-mortar and eCommerce channels often remains a challenge.

    DataWeave stands out for its capacity to collect data across diverse digital platforms, including desktop sites, mobile sites, and mobile applications. This capability ensures that omnichannel brands can have a holistic view of their pricing, promotional, and inventory strategies across all locations and digital landscapes.

    Leveraging localized Digital Shelf Analytics to understand the intricacies of pricing and availability at the store level allows brands to fine-tune their approaches, swiftly adapt to local market shifts, and uphold a unified brand presence across the digital and offline spheres. This strategic agility places them in a favorable competitive position, enhancing customer satisfaction and trust, which are crucial for sustained success.

    Know more about DataWeave’s Digital Shelf Analytics here.

    Schedule a call with a specialist to see how it can work for your brand.

  • How AI-Powered Visual Highlighting Helps Brands Achieve Product Consistency Across eCommerce

    How AI-Powered Visual Highlighting Helps Brands Achieve Product Consistency Across eCommerce

    As eCommerce increasingly becomes a prolific channel of sales for consumer brands, they find that maintaining a consistent and trustworthy brand image is a constant struggle. In an ecosystem filled with dozens of marketplaces and hundreds of third-party merchants, ensuring that customers see what aligns with a brand’s intended image is quite tricky. With many fakes and counterfeit products doing the rounds, brands may further struggle to get the right representation.

    One way brands can track and identify inconsistencies in their brand representation across marketplaces is to use Digital Shelf Analytics solutions like DataWeave’s – specifically the Content Audit module.

    This solution uses advanced AI models to identify image similarities and dissimilarities compared with the original brand image. Brands could then use their PIM platform or work with the retailer to replace inaccurate images.

    But here’s the catch – AI can’t always accurately predict all the differences. Relying solely on scores given by these models poses a challenge in tracking the subtle differences between images. Often, image pairs with seemingly high match scores fail to catch important distinctions. Fake or counterfeit products and variations that slip past the AI’s scrutiny can lead to significant inaccuracies. Ultimately, it puts the reliability of the insights that brands depend on for crucial decisions at risk, impacting both top and bottom lines.

    Dealing with this challenge means finding a balance between the number-based assessments of AI models and the human touch needed for accurate decision-making. However, giving auditors the ability to pinpoint variations precisely goes beyond simply sharing numerical values of the match scores with them. Visualizing model-generated scores is important as it provides human auditors with a tangible and intuitive understanding of the differences between two images. While numerical scores are comparable in the relative sense, they lack specificity. Visual interpretation empowers auditors to identify precisely where variations occur, aiding in efficient decision-making.

    How AI-Powered Image Scoring Works

    At DataWeave, our approach involves employing sophisticated computer vision models to conduct extensive image comparisons. Convolutional Neural Network (CNN) models such as Resnet-50 or YOLO, in conjunction with feature extraction models, analyze images quantitatively. This AI-powered image scoring process yields scores that indicate the level of similarity between images.

    However, interpreting these scores and understanding the specific areas of difference can be challenging for human auditors. While computer vision models excel at processing vast amounts of data quickly, translating their output into actionable insights can be a stumbling block. A numerical score may not immediately convey the nature or extent of the differences between images

    In the assessment of these images, all fall within the 70 to 80 range of scores (out of a maximum of 100). However, discerning the nature of differences—whether they are apparent or subtle—poses a challenge for the AI models and human auditors. For example, there are differences in the placement or type of images in the packaging, as well as packing text that are often in an extremely small font size. It is, of course, possible for human auditors to identify the differences in these images, but it’s a slow, error-prone, and tiring process, especially when auditors often have to check hundreds of image pairs each day.

    So how do we ensure that we identify differences in images accurately? The answer lies in the process of visual highlighting.

    How Visual Highlighting Works

    Visual highlighting is a method that enhances our ability to comprehend differences in images by combining sophisticated algorithms with human understanding. Instead of relying solely on numerical scores, this approach introduces a visual layer, resembling a heatmap, guiding human auditors to specific areas where discrepancies are present.

    Consider the scenario depicted in the images above: a computer vision model assigns a score of 70-85 for these images. While this score suggests relatively high similarity, it fails to uncover major differences between the images. Visual highlighting comes into play to overcome this limitation, precisely indicating regions where even subtle differences are seen.

    Visual highlighting entails overlaying compared images and emphasizing areas of difference, achieved through techniques like color coding, outlining, or shading specific regions. The significance of the difference in a particular area determines the intensity of the visual highlight.

    For instance, if there’s a change in the product’s color or a discrepancy in the packaging, these variations will be visually emphasized. This not only streamlines the auditing process but also enables human evaluators to make well-informed decisions quickly.

    Benefits of Visual Highlighting

    • Intuitive Understanding: Visual highlighting offers an intuitive method for interpreting and acting upon the outcomes of computer vision models. Instead of delving into numerical scores, auditors can concentrate on the highlighted areas, enhancing the efficiency and accuracy of the decision-making process.
    • Accelerated Auditing: By bringing attention to specific regions of concern, visual highlighting speeds up the auditing process. Human evaluators can swiftly identify and address discrepancies without the need for exhaustive image analysis.
    • Seamless Communication: Visual highlighting promotes clearer communication between automated systems and human auditors. Serving as a visual guide, it enhances collaboration, ensuring that the subtleties captured by computer vision models are effectively conveyed.

    The Way Forward

    As technology continues to evolve, the integration of visual highlighting methodologies is likely to become more sophisticated. Artificial intelligence and machine learning algorithms may play an even more prominent role in not only detecting differences but also in refining the visual highlighting process.

    The collaboration between human auditors and AI ensures a comprehensive approach to maintaining brand integrity in the ever-expanding digital marketplace. By visually highlighting differences in images, brands can safeguard their visual identity, foster consumer trust, and deliver a consistent and reliable online shopping experience. In the intricate dance between technology and human intuition, visual highlighting emerges as a powerful tool, paving the way for brands to uphold their image with precision and efficiency.

    To learn more, reach out to us today!


    (This article was co-authored by Apurva Naik)

  • How Enterprise AI is Transforming Business Outcomes for Customers Across Industries

    How Enterprise AI is Transforming Business Outcomes for Customers Across Industries

    Is AI just a flashy new trend that helps you create some amusing or stunning art and whip up amazing content in seconds (not this one) or is it a force for much greater good? Let’s dive into one of the most disruptive tech moments in our recent history in analyzing the use and transformative powers of AI, for not just end consumers but also businesses as customers. 

    “Enterprise AI can bring joy and meaning to its stakeholders. No more meaningless work, we are delivering value at the speed of need”, golden words from tech leader Vala Afshar, one of the staunchest endorsers of AI tech today as AI continues to drive top-line revenue growth for the Enterprise (B2B).

    How AI has evolved from basic tasks to complex processes

    AI or Artificial Intelligence which essentially means the use of a machine – typically computer – to perform tasks usually performed by humans such as processing data, making connections, and coming up with solutions has come a long way since its chess playing days.

    Since its application in various industries, AI has been changing the way we live and work. From enabling personalized experiences  to automating marketing and CRM to processing vast amounts of complex and scattered data, AI has been helping businesses perform increasingly complex tasks.

    With recent advances in Machine Learning and large Language Learning Models (LLM) AI is becoming increasingly sophisticated and is being commissioned in a growing range of applications, from healthcare and education to transportation and finance across the B2B/Enterprise industry.

    Enterprise AI vs Consumer AI

    Enterprise AI is an ecosystem of tools, processes and companies that leverages AI to provide solutions to businesses, as opposed to the end consumer.

    To draw a simple example, a generative prompt-based AI tool like ChatGPT or MidJourney is a consumer AI which helps consumers perform individual tasks. On the other hand, Salesforce provides various AI-led tools that help other businesses in their marketing and CRM processes.  A 2020 McKinsey study showed that nearly 70% of all businesses are taking AI seriously and increasibly looking to adopt it into their processes. 

    The potential of AI is virtually limitless across industries and everyday AI is being leveraged to drive efficiency, innovation and growth across sectors. It is being used to automate routine tasks, provide predictive analytics, analyze customer data, and improve supply chain operations.  In this article, we’ll dive into how Enterprise AI is transforming business outcomes for customers across industries through four real world examples. 

    Enterprise AI at play in these five industries

    1. Enterprise AI in Ecommerce

    For big ecommerce giants that play in a complex and multi-player ecosystem of today, being on top of their competition is the name of the game. However, it’s nearly impossible to keep a tab on the market manually and that’s where Enterprise AI technology in the domain of Price Intelligence and comparisons come in. Once a domain of manual and web scraping, Enterprise AI now equips both brands and ecommerce marketplaces with large, real-time and dynamic data to help them keep on top of competition and adjust their prices and other variables accordingly. 

    One of the biggest use cases for Enterprise AI in ecommerce is DataWeave, which provides SaaS-based Pricing Intelligence and Digital Shelf Analytics to its retail and ecommerce clients. Their AI-led matching and image recognition, can scrape millions of ecommerce data like price, inventory, image and others across the ecommerce landscape and enable the companies to make strategic pricing and competitive decisions. According to the company, these real-time pricing insights have helped their 50+ retail customers save millions in revenue by offering the right product at the most strategic price points.

    2. Enterprise AI in logistics

    AI has a profound impact on logistics, transport and global shipping commerce.  By predicting demand, identifying the most efficient routes, and improving warehouse management, AI logistics enterprises are helping their enterprise customers improve delivery rates, timelines and helping reduce carbon emissions.

    3. Enterprise AI in healthcare

    A case study in how AI has helped logistics comes from Far Eye, an AI-led delivery logistics platform, that helped one of its key clients BlueDart improve first attempt success rate by 22% and delivery success rate by 75%.

    AI can be used to improve patient outcomes by evaluating patient data, including processing complex medical report imagery and developing personalized treatment plans. One of the biggest players disrupting the field of AI in healthcare is IBM with its “Watson for Oncology”, a SaaS that delivers an advanced ability to analyze the meaning and context of structured and unstructured data in clinical notes and reports, easily assimilating key patient information written in plain English. By combining attributes from the patient’s file with clinical expertise from Memorial Sloan Kettering, external research, and data, Watson for Oncology identifies and ranks potential treatment plans and options.  It has been implemented by several hospitals around the world, including established ones like Apollo in India.

    4. Enterprise AI in marketing and CRM

    It would be a safe assumption to make in saying that marketing is one of the biggest beneficiaries from the evolution of AI. Marketing is at its core all about understanding the consumer and their problems, crafting a messaging and value to appeal to that consumer, and presenting the solutions  at the right time and at the right place. Various AI tools, systems and processes have been continuously enriching marketing. From tools to analyse large amounts of customer data, to generative AI content generators like ChatGPT and Grok, to AI-assisted CRM tools that have made personalization at scale a possibility, AI in marketing has been a boon.  

    One of the case studies in how a large company has been Uber Eats that used Salesforce’s Einstein’s AI that powers its service operations. With a shared view of merchants, end consumer data, and uber-fast response times in issue resolution, the company can keep 25 million restaurateurs and their customers happy.

    Sitting at the confluence of technology, innovation, strategy and foresight, the world is limitless in how AI can be leveraged to improve systems, provide solutions, and drive business growth. Enterprises, by harnessing the ever-evolving powers of AI, can improve business outcomes not only for their top line growth and revenue, but also in offering superior customer experiences and service.

    To learn more, reach out to us today or email us at contact@dataweave.com.

  • How DataWeave Enhances Transparency in Competitive Pricing Intelligence for Retailers

    How DataWeave Enhances Transparency in Competitive Pricing Intelligence for Retailers

    Retailers heavily depend on pricing intelligence solutions to consistently achieve and uphold their desired competitive pricing positions in the market. The effectiveness of these solutions, however, hinges on the quality of the underlying data, along with the coverage of product matches across websites.

    As a retailer, gaining complete confidence in your pricing intelligence system requires a focus on the trinity of data quality:

    • Accuracy: Accurate product matching ensures that the right set of competitor product(s) are correctly grouped together along with yours. It ensures that decisions taken by pricing managers to drive competitive pricing and the desired price image are based on reliable apples-to-apples product comparisons.
    • Freshness: Timely data is paramount in navigating the dynamic market landscape. Up-to-date SKU data from competitors enables retailers to promptly adjust pricing strategies in response to market shifts, competitor promotions, or changes in customer demand.
    • Product matching coverage: Comprehensive product matching coverage ensures that products are thoroughly matched with similar or identical competitor products. This involves accurately matching variations in size, weight, color, and other attributes. A higher coverage ensures that retailers seize all available opportunities for price improvement at any given time, directly impacting revenues and margins.

    However, the reality is that untimely data and incomplete product matches have been persistent challenges for pricing teams, compromising their pricing actions. Inaccurate or incomplete data can lead to suboptimal decisions, missed opportunities, and reduced competitiveness in the market.

    What’s worse than poor-quality data? Poor-quality data masquerading as accurate data.

    In many instances, retailers face a significant challenge in obtaining comprehensive visibility into crucial data quality parameters. If they suspect the data quality of their provider is not up to the mark, they are often compelled to manually request reports from their provider to investigate further. This lack of transparency not only hampers their pricing operations but also impedes the troubleshooting process and decision-making, slowing down crucial aspects of their business.

    We’ve heard about this problem from dozens of our retail customers for a while. Now, we’ve solved it.

    DataWeave’s Data Statistics and SKU Management Capability Enhances Data Transparency

    DataWeave’s Data Statistics Dashboard, offered as part of our Pricing Intelligence solution, enables pricing teams to gain unparalleled visibility into their product matches, SKU data freshness, and accuracy.

    It enables retailers to autonomously assess and manage SKU data quality and product matches independently—a crucial aspect of ensuring the best outcomes in the dynamic landscape of eCommerce.

    Beyond providing transparency and visibility into data quality and product matches, the dashboard facilitates proactive data quality management. Users can flag incorrect matches and address various data quality issues, ensuring a proactive approach to maintaining the highest standards.

    Retailers can benefit in several ways with this dashboard, as listed below.

    View Product Match Rates Across Websites

    The dashboard helps retailers track match rates to gauge their health. High product match rates signify that pricing teams can move forward in their pricing actions with confidence. Low match rates would be a cause for further investigation, to better understand the underlying challenges, perhaps within a specific category or competitor website.

    Our dashboard presents both summary statistics on matches and data crawls as well as detailed snapshots and trend charts, providing users with a holistic and detailed perspective of their product matches.

    Additionally, the dashboard provides category-wise snapshots of reference products and their matching counterparts across various retailers, allowing users to focus on areas with lower match rates, investigate underlying reasons, and develop strategies for speedy resolution.

    Track Data Freshness Easily

    The dashboard enables pricing teams to monitor the timeliness of pricing data and assess its recency. In the dynamic realm of eCommerce, having up-to-date data is essential for making impactful pricing decisions. The dashboard’s presentation of freshness rates ensures that pricing teams are armed with the latest product details and pricing information across competitors.

    Within the dashboard, users can readily observe the count of products updated with the most recent pricing data. This feature provides insights into any temporary data capture failures that may have led to a decrease in data freshness. Armed with this information, users can adapt their pricing decisions accordingly, taking into consideration these temporary gaps in fresh data. This proactive approach ensures that pricing strategies remain agile and responsive to fluctuations in data quality.

    Proactively Manage Product Matches

    The dashboard provides users with proactive control over managing product matches within their current bundles via the ‘Data Management’ panel. This functionality empowers users to verify, add, flag, or delete product matches, offering a hands-on approach to refining the matching process. Despite the deployment of robust matching algorithms that achieve industry-leading match rates, occasional instances may arise where specific matches are overlooked or misclassified. In such cases, users play a pivotal role in fine-tuning the matching process to ensure accuracy.

    The interface’s flexibility extends to accommodating product variants and enables users to manage product matches based on store location. Additionally, the platform facilitates bulk match uploads, streamlining the process for users to efficiently handle large volumes of matching data. This versatility ensures that users have the tools they need to navigate and customize the matching process according to the nuances of their specific product landscape.

    Gain Unparalleled Visibility into your Data Quality

    With DataWeave’s Pricing Intelligence, users gain the capability to delve deep into their product data, scrutinize match rates, assess data freshness, and independently manage their product matches. This approach is instrumental in fostering informed and effective decisions, optimizing inventory management, and securing a competitive edge in the dynamic world of online retail.

    To learn more, reach out to us today!

  • Capturing and Analyzing Retail Mobile App Data for Digital Shelf Analytics: Are Brands Missing Out?

    Capturing and Analyzing Retail Mobile App Data for Digital Shelf Analytics: Are Brands Missing Out?

    Consumer brands around the world increasingly recognize the vital role of tracking and optimizing their digital shelf KPIs, such as Content Quality, Share of Search, Availability, etc. These metrics play a crucial role in boosting eCommerce sales and securing a larger online market share. With the escalating requirements of brands, the sophistication of top Digital Shelf Analytics providers is also on the rise. Consequently, the adoption of digital shelf solutions has become an essential prerequisite for today’s leading brands.

    As brands and vendors continue to delve further and deeper into the world of Digital Shelf Analytics, a significant and often overlooked aspect is the analysis of digital shelf data on mobile apps. The ability of solution providers to effectively track and analyze this mobile-specific data is crucial.

    Why is this emphasis on mobile apps important?

    Today, the battle for consumer attention unfolds not only on desktop web platforms but also within the palm of our hands – on mobile devices. As highlighted in a recent Insider Intelligence report, customers will buy more on mobile, exceeding 4 in 10 retail eCommerce dollars for the first time.

    Moreover, thanks to the growth of delivery intermediaries like Instacart, DoorDash, Uber Eats, etc., shopping on mobile apps has received a tremendous organic boost. According to an eMarketer report, US grocery delivery intermediary sales are expected to reach $68.2 billion in 2025, from only $8.8 billion in 2019.

    In essence, mobile is increasingly gaining share as the form factor of choice for consumers, especially in CPG. In fact, one of our customers, a leading multinational CPG company, revealed to us that it sees up to 70% of its online sales come through mobile apps. That’s a staggering number!

    The surge in app usage reflects a fundamental change in consumer behavior, emphasizing the need for brands to adapt their digital shelf strategies accordingly.

    Why Brands Need To Look at Apps and Desktop Data Differently

    Conventionally, brands that leverage digital shelf analytics rely on data harnessed from desktop sites of online marketplaces. This is because capturing data reliably and accurately from mobile apps is inherently complex. Data aggregation systems designed to scrape data from web applications cannot easily be repurposed to capture data on mobile apps. It requires dedicated effort and exceptional tech prowess to pull off in a meaningful and consistent way.

    In reality, it is extremely important for brands to track and optimize their mobile digital shelf. Several digital shelf metrics vary significantly between desktop sites and mobile apps. These differences are natural outcomes of differences in user behavior between the two form factors.

    One of these metrics that has a huge impact on a brand’s performance on retail mobile apps is their search discoverability. Ecommerce teams are well aware of the adverse impact of the loss of even a few ranks on search results.

    Anyone can easily test this. Searching something as simple as “running shoes” on the Amazon website and doing the same on its mobile app shows at least a few differences in product listings among the top 20-25 ranks. There are other variances too, such as the number of sponsored listings at the top, as well as the products being sponsored. These variations often result in significant differences in a brand’s Share of Search between desktop and mobile.

    Share of Search is the share of a brand’s products among the top 20 ranked products in a category or subcategory, providing insight into a brand’s visibility on online marketplaces.

    Picture a scenario in which a brand heavily depends on desktop digital shelf data, confidently assuming it holds a robust Share of Search based on reports from its Digital Shelf Analytics partner. However, unbeknownst to the team, the Share of Search on mobile is notably lower, causing a detrimental effect on sales.

    To fully understand the scale of these differences, we decided to run a small experiment using our proprietary data analysis and aggregation platform. We restricted our analysis to just Amazon.com and Amazon’s mobile app. However, we did cover over 13,000 SKUs across several shopping categories to ensure the sample size is strong.

    Below, we provide details of our key findings.

    Share of Search on The Digital Shelf – App Versus Desktop

    Our analysis focused on three popular consumer categories – Electronics, CPG, and Health & Beauty.

    In the electronics category, brands like Apple, Motorola, and Samsung, known for their mobile phones, earbuds, headphones, and more, have a higher Share of Search on the Amazon mobile app compared to the desktop.

    Meanwhile, Laptop brands like Dell, Acer, and Lenovo, as well as other leading brands like Google have a higher Share of Search on the desktop site compared to the app. This is the scenario that brands need to be careful about. When their Share of Search on mobile apps is lower, they might miss the chance to take corrective measures since they lack the necessary data from their provider.

    In the CPG category, Ramen brand Samyang, with a lot of popularity on Tiktok and Instagram, shows a higher Share of Search on Amazon’s mobile app. Speciality brands like 365 By Whole Foods, pasta and Italian food brands La Moderna, Divinia, and Bauducco too have a significantly higher Share of Search on the app.

    Cheese and dessert brands like Happy Belly, Atlanta Cheesecake Company, among others, have a lower Share of Search on the mobile app. Ramen brand Sapporo is also more easily discovered on Amazon’s desktop site. Here, we see a difference of more than 5% in the Share of Search of some brands, which is likely to have a huge impact on the brand’s mobile eCommerce sales levels and overall performance.

    Lastly, in the Health & Beauty category, Shampoos and hair care brands like Olaplex, Dove, and Tresemme exhibited a higher Share of Search on the mobile app compared to the desktop.

    On the other hand, body care brands like Neutrogena and Hawaiian Tropic, as well as Beardcare brand Viking Revolution displayed a higher Share of Search on Amazon’s desktop site.

    Based on our data, it is clear that there are several examples of brands that do better in either one of Amazon’s desktop sites or mobile apps. In many cases, the difference is stark.

    So What Must Brands Do?

    Our findings emphasize the imperative for brands to move beyond a one-size-fits-all approach to digital shelf analytics. The striking variations in Share of Search between mobile apps and desktops conclusively demonstrate that relying solely on desktop data for digital shelf optimization is inadequate.

    If brands see that they’re falling behind on the mobile digital shelf, there are a few things they can do to help boost their performance:

    • If a brand’s Share of Search is lower on the mobile app, they can divert their retail spend to mobile in order to inorganically compensate for this difference. This way, any short-term impact due to lower discoverability is mitigated. This is also likely to result in optimized budget allocation and ROAS.
    • Brands also need to ensure their content is optimized for the mobile form factor, with images that are easy to view on smaller screens, and tailored product titles that are shorter than on desktops, highlighting the most important product attributes from the consumer’s perspective. Not only will this help brands gain more clicks from mobile shoppers, but this will also gradually lead to a boost in their organic Share of Search on mobile.
    • CPG brands, specifically, need to optimize their digital shelf for delivery intermediary apps (along with marketplaces). The grocery delivery ecosystem is booming with companies like DoorDash, Delivery Hero, Uber Eats, Swiggy, etc. leading the way. Using Digital Shelf Analytics to optimize performance on delivery apps is quite an involved process with a lot of bells and whistles to consider. Read our recently published whitepaper that specifically details how brands can successfully boost their visibility and conversions on delivery apps.

    But first, brands need to identify and work with a Digital Shelf Analytics partner that is able to capture and analyze mobile app data, enabling tailored optimization approaches for all eCommerce platforms.

    DataWeave leads the way here, providing the world’s most comprehensive and sophisticated digital shelf analytics solution, rising above all other providers to provide digital shelf insights for both web applications and mobile apps. Our data aggregation platform successfully navigates the intricacies of capturing public data accurately and reliably from mobile apps, thereby delivering a comprehensive cross-device view of digital shelf KPIs to our brand customers.

    So reach out to us today to find out more about our digital shelf solutions for mobile apps!

  • AI-powered Product Matching: The Key to Competitive Pricing Intelligence in eCommerce

    AI-powered Product Matching: The Key to Competitive Pricing Intelligence in eCommerce

    With thousands of products and hundreds of online retailers to choose from, the average modern-day shopper usually compares prices across several e-commerce sites effortlessly before often settling for the lowest priced option. As a result, retailers today are forced to execute millions of price changes per day in a never-ending race to be the lowest priced – without losing out on any potential margin.

    Identifying, classifying, and matching products is the first step to comparing prices across websites. However, there is no standardization in the way products are represented across e-commerce websites, causing this process to be fairly complex.

    Here’s an example:

    What’s needed is a pricing intelligence solution that first matches products across several websites swiftly and accurately, and then enables automated tracking of competitor pricing data on an ongoing basis.

    Pricing intelligence solutions already exist. What’s wrong with using them?

    There are several challenges with the incumbent solutions in the market – the biggest one being that they don’t work in a timely manner. In essence, it’s like deferring the process of finding actionable information that helps retailers acquire a competitive advantage, and instead doing it in hindsight. Like an autopsy of sorts.

    Here are the various solution types we have in the market today:

    • Internally developed systems – Solutions developed by retailers themselves often rely on heavy manual data aggregation and have poor product matching capabilities. Since these solutions have been developed by professionals not attuned to building data crunching machines, they pose significant operational challenges in the form of maintenance, updates, etc.
    • Web scraping solutions – These solutions have no data normalization or product matching capabilities, and lack the power to deliver relevant actionable insights. What’s more, it’s a struggle to scale them up to accommodate massive volumes of data during peak times such as promotional campaigns.
    • DIY solutions – These solutions require manual research and entry of data. It goes without saying that due to the level of human intervention and effort required, they’re expensive, difficult to scale, slow, and of questionable accuracy.

    As common as it is nowadays, AI has the answer

    DataWeave’s competitive pricing intelligence solution is designed to help retailers achieve precisely the competitive advantage they need by providing them with accurate, timely, and actionable pricing insights enabled by matching products at scale. We provide retailers with access to detailed pricing information on millions of products across competitors, as frequently as they need it.

    Our technology stack broadly consists of the following.

    1. Data Aggregation

    At DataWeave, we can aggregate data from diverse web sources across complex web environments – consistently and at a very high accuracy. Having been in the industry for close to a decade, we’re sitting on a lot of data that we can use to train our product matching platform.

    Our datasets include data points from tens of millions of products and have been collected from numerous geographies and verticals in retail. The datasets contain hierarchically arranged information based on retail taxonomy. At the root level, there’s information such as category and subcategory, and at the top level, we have product details such as title, description, and other <attribute, value> relationships. Our machine learning architectures and semi-automated training data building systems, augmented by the skills of a strong QA team, help us annotate the necessary information and create labeled datasets using proprietary tools.

    2. AI for Product Matching

    Product matching at DataWeave is done via a unified platform that uses both text and image recognition capabilities to accurately identify similar SKUs across thousands of e-commerce stores and millions of products. We use an ensemble deep learning architectures tailored to NLP and Computer Vision problems specific to us and heuristics pertinent to the Retail domain. Products are also classified based on their features, and a normalization layer is designed based on various text/image-based attributes.

    Our semantics layer, while technically an integral part of the product matching process, deserves particular mention due to its powerful capabilities.

    The text data processing consists of internal, deep pre-trained word embeddings. We use state-of-the-art, customized word representation techniques such as ELMO, BERT, and Transformer to capture deeply contextualized text with improved accuracy. A self-attention/intra-attention mechanism learns the correlation between the word in question and a previous part of the description.

    Image data processing starts with object detection to identify the region of interest of a given product (for example, the upper body of a fashion model displaying a shirt). We then leverage deep learning architectures such as VggNet, Inception-V3, and ResNet, which we have trained using millions of labeled images. Next, we apply multiple pre-processing techniques such as variable background removal, face removal, skin removal, and image quality enhancing and extract image signatures via deep learning and machine learning-based algorithms to uniquely identify products across billions of indexed products.

    Finally, we efficiently distribute billions of images across multiple stores for fast access, and to facilitate searches at a massive scale (in a matter of milliseconds, without the slightest compromise on accuracy) using our image matching engine.

    3. Human Intelligence in the Loop

    In scenarios where the confidence scores of the machine-driven matches are low, we have a team of Quality Assurance (QA) specialists who verify the output.

    This team does three things:

    • Find out why the confidence score is low
    • Confirm the right product matches
    • Figure out a way to encode this knowledge into a rule and feed it back to the algorithm

    In this way, we’ve built a self-improving feedback loop which, by its very nature, performs better over time. This system has accumulated knowledge over the 8 years of our operations, which is going to be hard for anyone to replicate. Essentially, this process enables us to match products at massive scale quickly and at very high levels of accuracy (usually over 95%).

    4. Actionable Insights Via Data Visualization

    Once the matching process is completed, the prices are aggregated at any frequency, enabling retailers to optimize their prices on an ongoing basis. Pricing insights are typically consumed via our SaaS-based web-portal, which consists of dashboards, reports, and visualizations.

    Alternatively, we can integrate with internal analytics platforms through APIs or generate and deliver spreadsheet reports on a regular basis, depending on the preferences of our customers.

    To summarize

    The benefits of our solution are many. Detailed price improvement opportunity-related insights generated in a timely manner empower retailers to significantly enhance their competitive positioning across categories, product types, and brands, as well as ability to influence their price perception among consumers. These insights, when leveraged at a higher granularity over the long term, can help maximize revenue through price optimization at a large scale.

    Our solution also helps drive process-based as well as operational optimizations for retailers. Such modifications help them better align themselves to effectively adopt a data-driven approach to pricing, in turn helping them achieve much smarter retail operations across the board.

    All of this wouldn’t be possible if the product matching process, inherent to this system, was unreliable, expensive, or time-consuming.

    If you would like to learn more about DataWeave’s proprietary product matching platform and the benefits it offers to eCommerce businesses and brands, talk to us now!

  • The Indian E-Commerce Showdown: Unveiling the Price War Between Flipkart’s Big Billion Days and Amazon’s Great Indian Festival

    The Indian E-Commerce Showdown: Unveiling the Price War Between Flipkart’s Big Billion Days and Amazon’s Great Indian Festival

    India’s homegrown eCommerce giant Flipkart, now backed by Walmart, reported a record 1.4 Billion customer visits during the early access phase and throughout the seven days of its premier shopping event, the Big Billion Days, launched on 8th October 2023. Competing with Flipkart, Amazon’s Great Indian Festival sale event started on October 8th as well and saw a whopping 95 Million customer visits to the website within the first 48 hours of the event.

    For consumers, the most pressing question was, “Who offered more attractive deals and lower prices during these sale events?”

    To answer this question, we leveraged our proprietary data aggregation and analysis platform and analyzed the prices and discounts on Amazon and Flipkart across key product categories..

    The details of our sample are mentioned below:

    • Number of SKUs Analyzed: 30,000+
    • Websites: Amazon.com and Flipkart.com
    • Categories: Apparel, Home & Furniture, Electronics, Health & Beauty
    • Dates: 7th Oct 2023 to 22nd Oct 2023

    Key Findings

    Based on our analysis, the Big Billion Days by Flipkart showcased relatively higher price reductions across categories compared to the Great Indian Festival sale by Amazon. The Apparel category on Flipkart saw the highest average discount at 50.6%. The Health & Beauty category had the lowest discount across Flipkart at 39.4% and Amazon at 33%.

    Overall, Flipkart offered higher discounts in each product category. It is clear that the retailer invested heavily in leveraging its supplier partnerships with key brands or sellers to enable them to offer higher discounts, thereby attracting more customers.

    Next, let’s take a closer look at each product category.

    Apparel

    While a majority of retailers expected demand for apparel and clothing to dip this festive season in India, eCommerce giants like Amazon and Flipkart are likely to recognize the strong consumer inclination towards apparel during this period.

    In the detailed assessment of Apparel sub-categories, Women’s Dresses, Women’s Tops, Men’s Shirts, Men’s Shoes, and Women’s Innerwear emerged as the segments showcasing the most substantial discounts during the sale events. While Flipkart offered higher average discounts across all sub-categories, Amazon offered competitive discounts as well.

    We observed significant differences in the average discounts across brands between Flipkart’s Big Billion Days and Amazon’s Great Indian Festival. Reinforcing the significant discounts on the Shoes subcategory, brands like Red Tape, Arrow, Adidas, Reebok, Nike, and more offered extensive discounts on both Flipkart and Amazon. Notably, Adidas and Reebok offered better deals on Amazon’s Great Indian Festival as compared to Flipkart.

    One8 by Virat Kohli had a significantly lower discount on Amazon compared to Flipkart, indicating an exclusive partnership.

    For brands, however, reducing prices is just one approach to entice shoppers. They must also guarantee their prominent presence and easy discoverability within Amazon and Flipkart search results. To gain insight into this, we monitored brands’ Share of Search across various frequently used search terms in addition to the discounts they provided. The Share of Search denotes the portion of a brand’s products within the top 20 search results for a specific search query.

    Our data indicates that Jockey and Speedo gained in Share of Search on Flipkart, but reduced discoverability on Amazon. Van Heusen fell behind in search results on Flipkart but showed a higher Share of Search on Amazon.

    Home & Furniture

    With demand for home and furniture products picking up in October, right before the festive season, Amazon and Flipkart offered significant discounts in this category.

    Discounts on both Amazon and Flipkart hovered around 50%. Across a few subcategories, Flipkart offered slightly lower discounts compared to Amazon. Only Luggage, Rugs, Sofas, and Entertainment Units saw lower markdowns on Flipkart during the Big Billion Days. 

    Dishwashers and Washer/ Dryers saw higher discounts on Amazon compared to Flipkart. The significant discounts on these products on Amazon possibly point to changing consumer preferences, as demand for these products is traditionally low in India, but seems to be growing.

    When it comes to Home & Furniture brands, Nasher Miles, Safari, Aristocrat, VIP, and American Tourister, luggage brands mostly, offered higher discounts on Flipkart, followed closely by Amazon.

    In terms of Share of Search, Skybags had high discoverability on both Flipkart and Amazon. The brand leveraged a strategy of offering big discounts this festive season as well as ensuring prominent placement in search results. Wildcraft lost out on its discoverability on Flipkart in contrast to its prominence on Amazon. Duroflex saw lower searchability on Amazon compared to Flipkart’s Big Billion Days.

    Consumer Electronics

    The Consumer Electronics and Appliances Manufacturers Association (CEAMA) expected an uptick in sales of consumer electronics products this festive season in India. With more consumers buying premium products using credit cards and EMIs, demand for expensive, high-end electronics was expected to increase.

    Again, average discounts in this category hovered around 50% on Flipkart and Amazon.

    Across electronics subcategories, Smartwatches, Earbuds, and Drones had the highest markdowns with Flipkart leading the pack during the Big Billion Days. Amazon offered relatively higher discounts at 44.9% on the TV subcategory, compared to Flipkart’s 40.6%.

    Speakers, Laptops, Smartphones, and Tablets also saw lower markdowns on Amazon compared to Flipkart. Amazon was the official partner for the launch of many high-level smartphones and products in September-October, contributing to the higher markdowns in the subcategory.

    Across brands, Lenovo’s discounts were the most differentiated between the two sites, with the brand offering higher discounts on Amazon (45.4%) compared to Flipkart (24.7%). Noise offered the highest discounts at 72.5% on Amazon and 52.8% on Flipkart. Brands like Boat and Zebronics, also saw lower discounts on Flipkart.

    Mi and JBL offered deeper discounts on Flipkart’s Big Billion Days. Apple meanwhile stands out with only 11.83% discounts on Amazon, but the brand offered impressive 31.4% discounts on Flipkart.

    Samsung dominated the Share of Search on Amazon at 15.7%, compared to only 2.6% on Flipkart. Apple and Lenovo also saw higher discoverability on Amazon. On Flipkart, JBL and Skullcandy stand out as brands with high search visibility.

    Health & Beauty

    The Health & Beauty category saw the lowest markdowns with only 39.4% discounts on Flipkart and 33% on Amazon.

    In the subcategories analyzed, Electric Toothbrushes had relatively high markdowns across both sites. Staple and lower priced subcategories like Toothpaste had the lowest markdowns across both sale events, with Amazon offering only 17.4% average discounts.

    Across brands, Beardo, a leading beard care brand, offered significantly higher discounts on Amazon compared to Flipkart. Most other well-known brands, including Nivea and Vaseline, saw higher discounts on Amazon compared to Flipkart. Only Tresmme and Dove were exceptions with higher discounts on Flipkart.

    In terms of Share of Search, once again, Beardo was the most discoverable brand in this category. Brands like Dove, Pond’s, Swiss Beauty, and Tresemme saw a lower Share of Search on Flipkart compared to Amazon.

    Navigating the Competitive Landscape: How To Thrive During Sale Events

    Amazon and Flipkart’s strategic pricing during the Big Billion Days and the Great Indian Festival Sale reflects a balance of profitability, inventory, and competition. Competitive pricing insights empower retailers to make informed decisions, optimize strategies, and thrive during high-stakes sale events with timely and relevant insights at a massive scale.

    To learn more about how you can leverage competitive pricing insights to stay ahead of the game during sale events, reach out to us today!

  • Black Friday Cyber Monday 2023: Unveiling Health & Beauty Pricing and Discount Trends

    Black Friday Cyber Monday 2023: Unveiling Health & Beauty Pricing and Discount Trends

    On Black Friday this year, Health & Beauty brands saw a significant increase with a 13% jump in foot traffic, according to a report by RetailNext. Despite caution from various sources, higher prices for everyday goods, and high interest rates, consumers chose to spend big this cyber week.

    So what kind of deals did top retailers and brands offer in the Health & Beauty category this BFCM? At DataWeave, we harnessed the power of our proprietary data aggregation and analysis platform to track and analyze the prices and deals of Health & Beauty products across prominent retailers to uncover unique insights into their price competitiveness this BFCM, as well as understand how pricing strategies varied across diverse subcategories and brands.

    Also check out our insights on discounts and pricing for Consumer Electronics, Apparel, and Home & Furniture categories this Black Friday and Cyber Monday.

    Our Methodology

    For this analysis, we tracked the average discounts among leading US retailers in the Health & Beauty category during the Thanksgiving weekend sale, including Black Friday and Cyber Monday. We noticed prices and discounts didn’t change significantly over the course of the weekend, and hence the average prices of products between the 24th and 27th of November are being reported. Our sample was chosen to encompass the top 500 ranked products in each product subcategory across leading retailers during the sale.

    • Sample size: 15,253 SKUs
    • Retailers tracked: Amazon, Walmart, Target, Sephora, Ulta Beauty
    • Subcategories reported on: Shampoo, Toothpaste, Conditioner, Sunscreen, Makeup, Electric Toothbrush, Beard Care, Moisturizer
    • Timeline of analysis: 24 to 27 November 2023

    Our Key Findings

    Average Discounts Across Retailers

    Amazon leads the pack with a huge margin, offering an average discount of 31.9%, covering 62% of its products analyzed. Target follows an 18.8% average discount across only 5% of its analyzed assortment. The other retailers aren’t even close.

    Ulta Beauty was the next in line, providing a 9.2% average discount followed by Walmart with a 6.8% average discount. Sephora, known for its premium beauty offerings, adopted a more conservative approach with a 3.5% average discount, targeting only 9% of its top products

    Across retailers, it is clear that Amazon led the charge by far this cyber week, with the other retailers choosing to markdown prices conservatively in the Health & Beauty category.

    Average Discounts: Subcategories

    Amazon offered high discounts on lower priced subcategories like Toothpaste (49.4%), Sunscreen (46.3%), Moisturizers (38.5%), and Conditioners (37.5%), highlighting its focus on products with high demand that consumers would look to stock up on. Ulta Beauty also focused its discounts on Toothpaste (15.6%), Moisturizers (14.9%), and Conditioners (12.6%), targeting skincare and grooming.

    Sephora, meanwhile, offered the most attractive deals on the Makeup subcategory at 5.3% across 12.67% of its analyzed assortment, banking on the demand generated due to the brand’s popularity in this subcategory.

    Target prioritized discounts on Toothpaste (22.5%), Shampoo (21.6%), and Moisturizers (18.9%). Walmart too offered significant discounts on Shampoo (21.6%) and Toothpaste (22.5%).

    Retailers prioritized staple subcategories like Toothpaste and Moisturizer with substantial discounts during this Black Friday Cyber Monday, ensuring a broad consumer appeal. In contrast, discretionary items like Makeup may be less motivated by discounts alone, and hence saw lower discounts during the sale.

    Average Discounts: Brands

    Brands offered the most attractive deals on Amazon, with OGX leading the pack at 58.4% average discount. Neutrogena and Colgate followed with an average discount of 50.4% and 44%. This mirror’s Amazon’s subcategory focus on shampoos, conditioners, and toothpastes.

    Other instances of brands offering attractive deals across retailers include Belif (27.9%) and Anastasia Beverly Hills (17.6%) on Sephora, Johnson’s (20%) and Philips Sonicare (18.8%) on Target, and Olay (12.2%) and Colgate (10.6%) on Walmart.

    Ulta Beauty hosted several attractive deals by specific brands, including Moon (30.7%), Joico (24%), and Clinique (22.3%).

    Share of Search For Health & Beauty Brands Across Subcategories

    Our Share of Search analysis illuminates the strategic moves made by brands to enhance their visibility, playing a crucial role in influencing consumer choices during Black Friday and Cyber Monday.

    Among some of the leading brands, Head & Shoulders and Oral-B increased their Share of Search by 2.3% and 1% respectively, reflecting a successful strategy to boost brand visibility during the Black Friday and Cyber Monday shopping events. On the other hand, L’Oreal Paris, Colgate, and Neutrogena faced marginal decreases in Share of Search.

    Overall, since the difference in Share of Search values did not change dramatically, the visibility levels of leading brands across key subcategories remained consistent during the Thanksgiving weekend.

    —

    For deeper insights on pricing and discounting trends across a diverse range of shopping categories during Black Friday and Cyber Monday, check out our blog!

    To learn more about our AI-powered Pricing Intelligence and Digital Shelf Analytics platform, contact us today!