Skip to content
Anand Bajrangi SEO consultant and author Get free SEO audit
Add as preferred source

Duplicate Content in SEO: Causes, Fixes, Canonicals & Best Practices (2026)

Duplicate Content Explained

Duplicate content is substantially similar or identical content available at more than one URL. It can occur on the same website or across different websites. It is common on blogs, ecommerce stores, news sites and websites with tracking parameters or multiple URL formats.

Most duplicate content is not a Google penalty. Search engines generally try to identify representative versions of similar pages and decide which URL to show. The practical challenge is helping search engines understand your preferred URL while ensuring that each page offers a useful experience.

Quick answer: how should you handle duplicate content?

  • Choose one preferred URL for each important page.
  • Use a 301 redirect when an alternate URL should permanently move to the preferred page.
  • Use a canonical tag when similar pages need to remain accessible but you want to indicate the preferred version.
  • Keep internal links and XML sitemaps consistent with the preferred URLs.
  • Do not block a URL in robots.txt if Google needs to crawl it to see a canonical or noindex directive.
  • Make pages meaningfully different when they serve different user needs.

1. What is duplicate content?

Duplicate content refers to blocks of content that are identical or very similar across multiple URLs. It can be created intentionally or as a side effect of normal website features.

Internal duplicate content

This happens when the same or very similar page is available at multiple URLs on one website. Examples include HTTP and HTTPS versions, www and non-www versions, tracking parameters, print pages and inconsistent trailing slashes.

External duplicate content

This happens when content appears on different domains. Examples include syndicated articles, copied product descriptions, manufacturer descriptions reused by retailers and content republished without substantial changes.

2. Common causes of duplicate content

Cause Example What to check
Protocol or host variations http://example.com and https://www.example.com Redirect and canonical consistency
Trailing slash differences /guide/ and /guide Preferred URL format and internal links
Tracking parameters ?utm_source=newsletter Canonical target and parameter handling
Filters and sorting ?colour=blue&sort=price Whether filtered pages deserve separate search visibility
Session IDs ?sessionid=123 Remove session-based URL duplication where possible
Print or alternate views /article/print/ Redirect or canonical where appropriate
Copied product descriptions Same supplier text on many stores Add original, useful product information
Pagination and archives Category pages and page 2 Ensure each page has a clear purpose and URL

3. Does duplicate content cause a Google penalty?

Ordinary duplicate content is not automatically a spam violation and does not automatically trigger a manual penalty. Google may select one representative URL from a group of similar pages and show that version in search results.

However, duplication can still create practical problems. Search engines may choose a different canonical URL than the one you prefer, users may land on inconsistent versions, and your team may waste time maintaining pages that serve the same purpose.

There is an important distinction between normal duplication and deceptive or manipulative behaviour. Copying or scraping content at scale, creating doorway pages, or publishing large volumes of low-value pages to manipulate rankings can violate Google’s spam policies. Assess the purpose and implementation, not simply the presence of matching text.

4. How Google chooses a canonical URL

When Google finds several pages with identical or very similar content, it may group them and select a representative URL, known as the canonical URL. Your declared canonical is a signal, not an instruction that guarantees Google’s selection.

Google can consider redirects, rel=canonical annotations, sitemap inclusion, HTTPS, internal links and other signals. Consistency across these signals helps Google understand your preference.

5. Duplicate content fixes: canonical, redirect, noindex or robots.txt?

Method Use it when Important note
301 redirect An alternate URL should permanently move to another URL Users and crawlers are sent to the destination
rel=canonical Similar URLs must remain accessible, but one is preferred for indexing A hint; Google may select another canonical
noindex A page should not appear in search results Allow crawling so Google can see the directive
robots.txt You need to control crawling of URL paths or patterns It is not a reliable way to remove a URL from the index

Canonical tag example

<link rel="canonical" href="https://example.com/preferred-page/" />

Place the canonical annotation in the page’s HTML head. Use an absolute URL, point to the preferred page, and avoid conflicting canonical declarations. Most pages should have a self-referencing canonical unless there is a clear reason to specify another URL.

301 redirect example

If an old URL has been replaced and should no longer be used, redirect it directly to the final preferred URL. Avoid redirect chains and do not redirect unrelated pages to a generic destination simply to preserve traffic.

6. How to find duplicate content on your website

  1. Crawl the website: use a crawler to collect URLs, titles, headings, status codes, canonical tags and content similarity signals.
  2. Export indexable URLs: focus on pages that can be crawled and indexed, while also checking important excluded URLs.
  3. Group URL patterns: identify parameters, host variations, trailing slash differences, archives, filters and print pages.
  4. Compare page content: distinguish genuinely duplicated pages from pages that share only navigation, footers or standard product details.
  5. Check canonical declarations: find missing, conflicting, non-indexable or incorrect canonical targets.
  6. Review Search Console: inspect Page Indexing and URL Inspection data for Google’s selected canonical and the user-declared canonical.
  7. Prioritise business-important pages: fix duplicates affecting key landing pages, products and articles first.

7. Duplicate content in WordPress

WordPress sites can create overlapping URLs through category archives, tags, author archives, date archives, pagination, attachment pages, search results and plugins. Not every archive is a problem; decide whether it serves a useful search or navigation purpose.

  • Choose consistent HTTPS and host settings.
  • Use a consistent permalink structure.
  • Review category and tag archives for thin or overlapping content.
  • Check whether attachment pages provide useful standalone value.
  • Ensure SEO plugins do not output conflicting canonical tags.
  • Keep XML sitemaps focused on preferred, indexable URLs.
  • Link internally to the preferred version of each page.

8. Duplicate content on ecommerce websites

Ecommerce websites often generate duplicate or near-duplicate URLs through product filters, sorting, variants, pagination and faceted navigation. Do not automatically canonicalise every filtered URL to the category page. Some filtered combinations may satisfy distinct user searches and deserve their own indexable landing pages.

Decide which combinations have genuine search demand and unique value. Control low-value URL combinations, avoid endless crawl paths and make sure product variants have clear canonical and indexing rules. Read Google’s guidance on faceted navigation.

9. Duplicate content across different websites

If another website republishes your article, do not assume that you will automatically receive a penalty or that every copy will outrank the original. Search engines decide which version is most appropriate to show. Where you syndicate content by agreement, ask the publisher to use a canonical to the original where practical, or consider other arrangements that make the original source clear.

For your own content, publish original insights, examples, images or research where possible. If you use supplier specifications or common facts, add useful context and information that helps customers make a decision.

10. Practical duplicate content audit checklist

  • ☐ Confirm one preferred HTTPS and host version.
  • ☐ Check trailing slash and case consistency.
  • ☐ Identify tracking and session parameters.
  • ☐ Review filter, sort and pagination URLs.
  • ☐ Find duplicate titles, headings and substantially similar body content.
  • ☐ Check canonical tags and their destinations.
  • ☐ Review redirect chains and loops.
  • ☐ Confirm internal links point to preferred URLs.
  • ☐ Check XML sitemaps contain preferred, indexable URLs.
  • ☐ Inspect important examples in Google Search Console.
  • ☐ Record the chosen fix and test it after deployment.

11. Common duplicate content mistakes

  • Canonicalising everything to the homepage: canonical targets should be relevant equivalents, not unrelated pages.
  • Blocking duplicates before Google can see canonical or noindex: crawling may be required to process those directives.
  • Redirecting unrelated pages: a redirect should lead to a genuinely relevant replacement.
  • Assuming every repeated phrase is harmful: navigation, legal text and standard interface elements naturally repeat.
  • Deleting useful pages without checking demand: assess traffic, links, conversions and user purpose before consolidation.
  • Expecting canonical tags to force Google’s choice: canonicalisation is a signal, not a guarantee.

Frequently asked questions

Is duplicate content bad for SEO?

Not automatically. Normal duplication is common. It becomes an SEO concern when it creates confusing URL signals, unnecessary crawl paths, competing pages or low-value search experiences.

How much duplicate content is acceptable?

Google does not publish a universal percentage threshold for acceptable duplicate content. Evaluate whether pages serve distinct user needs and whether the duplication creates a technical or quality problem.

Can I publish the same article on my website and another website?

You can syndicate or republish content, but understand that search engines may choose either version to show. Agree on attribution and canonical handling with the publisher where possible.

Does a canonical tag remove a duplicate page?

No. It signals the preferred URL for canonicalisation. The duplicate URL may remain accessible, and Google may choose a different canonical.

Should I use noindex or canonical for duplicate pages?

Use canonical when pages are duplicates or very similar and you want to indicate the preferred version. Use noindex when a page should not appear in search results. Choose based on the page’s purpose, not as interchangeable fixes.

Can duplicate product descriptions hurt an ecommerce site?

Repeated manufacturer descriptions are common and do not automatically cause a penalty. Add original product details, comparisons, images, usage guidance and customer information that genuinely help shoppers.

Final thoughts

Duplicate content management is mainly about clarity. Identify why multiple versions exist, decide which pages deserve to remain available and use the right technical signal for each situation. Redirect obsolete URLs, use canonical annotations for appropriate duplicates, and create genuinely useful content when pages need to serve different audiences. Do not remove or block pages without checking their purpose and impact first.

Official Google resources

Share this article

LinkedIn X WhatsApp Email
Anand Bajrangi

Written by

Anand Bajrangi

SEO consultant, author and co-founder of EvolvCode Solutions

Anand is a self-taught SEO consultant from Bihar, India. He started learning SEO in 2020, and he and his team have since helped more than 100 businesses get found on Google. He wrote two books on SEO, The Truth About SEO and SEO Words Made Simple, and builds free SEO tools, a WordPress SEO plugin and the SEO Inspector Chrome extension.

See more of Anand’s articles on Google

Choose anandbajrangi.com as a preferred source, and Google will show you more of its articles in Top Stories and in “From your sources”.

Add as preferred source

Want Anand to look at your site?

Request a free SEO audit. You get a plain-English list of what to fix first, by email.

Get free SEO audit