Google Sitemap & Robots

Version v1.2.0
Platform Magento 2
Released 2 August 2025

Troubleshooting Sitemap Issues in Magento 2

Common issues and solutions for the Google Sitemap & Robots extension. Start with quick diagnostics, then find your specific issue below.

Quick Diagnostics

  1. Check sitemap module enabled: Magmodules → Sitemap → General → Enabled
  2. Check feed generation enabled: Feed Generation Settings → Enable (per store view)
  3. Verify cron running: Check cron_schedule table or run generation manually via CLI
  4. Check logs: var/log/ for debug information

Sitemap Issues

Problem: Sitemap is empty or has no URLs

Symptoms:

  • Sitemap generates but contains 0 URLs
  • XML file is very small

Solutions:

  1. Check module is enabled:

    • Magmodules → Sitemap → General → Enabled must be Yes
  2. Check feed generation enabled:

    • Feed Generation Settings → Enable must be Yes for the store view
  3. Check noindex exclusion:

    • If "Exclude No-Index" is enabled, verify pages aren't all marked noindex
  4. Verify products/categories exist:

    • Ensure you have enabled products and active categories

Prevention: Start with basic configuration, then add exclusions as needed.

Problem: Sitemap generation fails or times out

Symptoms:

  • Sitemap generation never completes
  • PHP timeout errors in logs
  • Memory exhausted errors

Solutions:

  1. Run via CLI instead of admin:

    bin/magento mm-sitemap:generate --store-id=1
    

    CLI has longer timeouts and no browser limitations.

  2. Reduce sitemap size:

    • Lower "Maximum No of URLs Per File" setting
    • The module will create multiple files automatically
  3. Increase PHP limits (temporary):

    • Increase max_execution_time and memory_limit for CLI

Problem: Sitemap URL returns 404

Symptoms:

  • Clicking sitemap URL shows page not found
  • Sitemap file doesn't exist

Solutions:

  1. Check sitemap was generated:

    • Look for the file in your Magento root or configured location
    • Check generation timestamp in admin
  2. Regenerate sitemap:

    • Click Generate button or run CLI command
  3. Check file permissions:

    • Ensure web server can write to the sitemap location
  4. Verify filename configuration:

    • Check the configured filename in Feed Generation Settings

Problem: Missing pages in sitemap

Symptoms:

  • Specific categories/products don't appear
  • URL count is lower than expected

Solutions:

  1. Check page status:

    • Products/categories must be Enabled
    • CMS pages must be Active
  2. Check noindex settings:

    • If "Exclude No-Index" is enabled, check page meta tags
  3. Check visibility (products):

    • Products set to "Not Visible Individually" may be excluded
  4. Check store assignment:

    • Pages must be assigned to the store view

Debug tip: Enable Debug Mode and check logs for exclusion reasons.

Problem: Sitemap file too large

Symptoms:

  • File exceeds size limit
  • Search engines reject sitemap

Solutions:

  1. Configure file limits:

    • Set "Maximum No of URLs Per File" to 50,000 or less
    • Set "Maximum File Size" appropriately
  2. Module handles this automatically:

    • When limits are exceeded, a sitemap index is created
    • Multiple sitemap files are generated
  3. Verify sitemap index:

    • Check if a sitemap index XML was created pointing to sub-files

Robots Issues

Problem: Robots settings not applying

Symptoms:

  • Pages show wrong robots meta tag
  • Default settings being ignored

Solutions:

  1. Check robots module enabled:

    • Magmodules → Robots → General → Enabled must be Yes
  2. Clear cache:

    • Full page cache may be serving old meta tags
    bin/magento cache:flush
    
  3. Check page-level overrides:

    • Individual pages may have robots set at the page level
    • Page-level settings override defaults
  4. Verify correct store view:

    • Settings are per store view

Problem: Wrong robots on specific pages

Symptoms:

  • Some pages have correct robots, others don't
  • Inconsistent behavior

Solutions:

  1. Check page-level settings:

    • Categories: Catalog → Categories → [Category] → Search Engine Optimization
    • Products: Catalog → Products → [Product] → Search Engine Optimization
    • CMS Pages: Content → Pages → [Page] → Search Engine Optimization
  2. Page settings take precedence:

    • Module sets defaults, but page-level overrides win
  3. Review the hierarchy:

    • Page-level > Module defaults > Magento defaults

Cron Issues

Problem: Sitemap not auto-generating

Symptoms:

  • Sitemap doesn't update automatically
  • Manual generation works fine

Solutions:

  1. Check cron is enabled:

    • Feed Generation Settings → Cron Enable must be Yes
  2. Verify Magento cron running:

    bin/magento cron:run
    
  3. Check cron schedule table:

    SELECT * FROM cron_schedule WHERE job_code LIKE '%sitemap%' ORDER BY scheduled_at DESC LIMIT 10;
    
  4. Check server cron:

    • Ensure system cron is configured to run Magento cron

Debug Mode

Enable detailed logging:

  1. Go to Magmodules → Sitemap → Debug
  2. Set Debug Mode to Yes
  3. Save and regenerate sitemap
  4. Check var/log/ for detailed logs

Remember: Disable debug mode in production when troubleshooting is complete.

CLI Commands for Troubleshooting

# Generate sitemap manually (bypasses cron)
bin/magento mm-sitemap:generate --store-id=1

# Generate for all enabled store views
bin/magento mm-sitemap:generate

# Clear cache after configuration changes
bin/magento cache:flush

CLI output shows progress and any errors during generation.

Need More Help?

Documentation:

Support:

Created:
Updated:
star star star star star
star star star star star
Alexandru-Manuel Carabus
Magmodules sets the bar for Magento module quality and support—we check their catalog first for client feature requests, and they’re our first choice for licenses.
Google 11 Nov 2025
star star star star star
star star star star star
Matt Austin
Possibly the fastest support response times of any Magento Extension vendor. Great extensions too!
Google 09 Sep 2025
star star star star star
star star star star star
Jan Privé
Dankzij de heldere uitleg en snelle reactie van Magmodules kon mijn vraag, en dus mijn Magento-probleem, binnen enkele uren worden beantwoord. Doeltreffend, zonder moeilijke termen, gewoon zo als het zou moeten zijn.... Bedankt!
Google 05 Sep 2025
star star star star star
star star star star star
Denis Metzler
To evaluate a provider, it is not enough to consider only the product offered, but also its after-sales service, such as support and troubleshooting. Magmodules has been extremely satisfactory at all levels on multiple occasions and sets the bar at the top when comparing the competition.
Google 02 Sep 2025
star star star star star
star star star star star
Bleijenberg winkelinrichting en materialen
Goed bereikbaar, reageren snel en denken oplossingsgericht. Een aanrader.
Google 30 Jul 2025
star star star star star
star star star star star
Patrick Verduijn
Magmodules biedt plugins aan die van hoge kwaliteit zijn tegen een goede prijs, waar dit bedrijf in uitblinkt is de bereidheid om de zeldzame feedback & problemen met de plugins te willen onderzoeken, mee te willen denken in het debuggen van problemen en goede oplossingen toe te passen. In mijn decennium ervaring met Magento & 3th parties is Magmodules absoluut een uniqum binnen de markt.
Google 25 Jul 2025
star star star star star
star star star star star
Erik de Groot
Magemodules heeft hele sterke Magento extensies en een proactieve support. Al jaren heel erg tevreden over jullie service en producten!
Google 18 Jul 2025
star star star star star
star star star star star
René Zeuner
We are using the Mollie Magento extension from Magmodules. It works excellently without flaws. Very fast, competent and friendly support. Thanks!
Google 30 Jun 2025
star star star star star
star star star star star
R. U.
Erg goed team, reageren snel en duidelijk en hebben met toegang tot onze database erg goed geholpen (eigenlijk een gratis customization).
Google 18 Jun 2025
star star star star star
star star star star star
Hugo de Groot
Uitstekende support! Wij gebruiken o.a. de Rich Snippets Suite extensie voor onze Magento 2 webshop (Hyvä) en hadden een specifieke vraag over structured data op PLP-pagina’s. Binnen no-time kregen we een inhoudelijk en duidelijk antwoord. Zeer prettig contact en goed onderbouwde uitleg. Absoluut een betrouwbare partner voor Magento-extensies!
Google 13 Jun 2025