AI Crawler Control: A Compliant TDM Opt-Out in 2026
Text and data mining is permitted unless a machine-readable reservation exists. How shops declare the TDM opt-out in three places – without accidentally blocking retrieval crawlers too.
Insights on e-commerce, web development and digital solutions
Here you find our articles about online shops, websites and web tech. We explain new rules, tools and good ways of working. You can filter the articles by topic. At the top of an article you find a short version in plain words. Ask us if something is still not clear.
Text and data mining is permitted unless a machine-readable reservation exists. How shops declare the TDM opt-out in three places – without accidentally blocking retrieval crawlers too.
Filter and sort URLs turn a few thousand products into millions of pages – Google names faceted navigation as the single largest cause of crawling problems. A decision matrix instead of guesswork: which facets deserve a landing page, which belong out of the crawl, and why robots.txt and noindex are not interchangeable.
A product image without alt text is invisible to screen reader users and mute to search engines.
Share of Model, citation rate and AI referral conversion as reliable KPIs: how shops make their visibility in language models measurable and controllable.
A system switch puts hard-earned visibility at stake: 66.5% of links to the sampled websites have been dead since 2013 (Ahrefs). How to switch CMS with a content audit, redirect strategy, and phased rollout without losing your SEO substance.
Google lets users mark their favorite sources – marked sites get clicked 2× more often. How online shops and brands become a preferred source in Top Stories and AI Overviews.
In an analysis of 23 million internal links, well-linked pages received roughly four times as many clicks from Google Search as weakly linked ones. Yet a well-planned link architecture can increase organic traffic by up to 24% and noticeably improve crawl efficiency.
Google increasingly evaluates how comprehensively a site covers a topic. Sites that cover a topic in full and link it cleanly get found more readily than sites relying solely on individual pages and backlinks.
Only 43% of all websites pass all Core Web Vitals (incl. INP). Learn how to optimize your online shop's interactivity and increase conversions.
Larger targets, terms explained, input help, clear focus, no time limits
You decide which optional data processing to allow.
Our anonymous reach measurement runs without cookies and without IP storage, including campaign parameters in links – we do not ask for consent for it because none is legally required.
Strictly required: language preference, core site functions and storing your cookie choice. Without these the site does not work. Settings you choose yourself (light/dark appearance, accessibility) are kept in your browser's local storage only once you choose them; "Reset" in the accessibility settings removes them.
Records your interactions (clicks, scrolling, inputs) pseudonymously so we can spot usability issues. Form field inputs are masked automatically before storage; your IP address is not saved with the recording. Served from our own domain, no external tool. Opt-in, revocable any time.