Redirect Waste
Learn how to analyze repeated crawler requests to redirected URLs, remove chains and internal hops, and preserve necessary redirects safely.
Redirect Waste identifies URL paths repeatedly requested by crawlers that return a redirect. Screpy reports the path, redirect status, and redirected-request volume so you can find old URLs still being generated or referenced.
Redirects are necessary when content moves. Waste occurs when the site itself repeatedly sends users and crawlers through avoidable hops instead of linking to the final destination.
Understand redirect behavior
| Status | Typical meaning |
|---|---|
| 301 / 308 | The resource moved permanently |
| 302 / 307 | The move is temporary |
| Meta refresh / JavaScript redirect | Client-side or page-level redirection; usually less direct than server-side HTTP redirects |
Use the status that matches the real change. Google's redirect guidance recommends permanent server-side redirects for permanent moves and temporary redirects for temporary changes.
Find the source of repeated redirects
Check:
- navigation and footer links;
- contextual links inside content;
- XML sitemaps;
- canonical and hreflang annotations;
- structured data;
- image, script, and stylesheet URLs;
- campaign templates and email links;
- HTTP-to-HTTPS and hostname normalization;
- external backlinks and old bookmarks.
Internal sources should normally point directly to the final canonical URL. External sources may continue using old URLs, which is why necessary redirects should remain available.
Analyze redirect waste step by step
- Sort by redirected-request volume.
- Follow the complete redirect path to the final response.
- Confirm the final destination is relevant, successful, indexable, and canonical.
- Determine whether the redirect is permanent, temporary, or accidental.
- Find internal references to every intermediate URL.
- Update the source links and annotations to the final URL.
- Keep required redirects for external traffic and historical URLs.
Redirect chains and loops
A chain sends A → B → C when A → C would be sufficient. Chains add latency, increase failure points, and consume crawler requests. A loop never reaches a final page and must be repaired immediately.
During migrations, create a direct one-to-one mapping where possible. Avoid redirecting every removed page to the homepage; irrelevant destinations confuse users and can be treated as soft errors.
Example
An old blog path redirects from HTTP to HTTPS, then from www to the preferred hostname, then from an old slug to a new slug. The site navigation still uses the HTTP old slug.
Keep a direct permanent redirect from the historical URL to the final page, but update navigation, sitemaps, canonicals, and internal content links to the final HTTPS canonical URL. This preserves external value while removing internal waste.
When not to remove a redirect
- The old URL has external links or direct traffic.
- Users may have bookmarks.
- A permanent migration still needs continuity.
- A short-term campaign or test genuinely requires a temporary destination.
- Hostname and protocol normalization protect one canonical URL.
The objective is not “zero redirects.” It is zero unnecessary internally generated redirects and no broken redirect paths.
Verify the cleanup
Run a new crawl and confirm internal links resolve directly, chains are removed, and all final destinations return the intended status. Compare fresh redirected-request volume over a similar period. Residual external requests can be normal even after internal cleanup.
Links report
Find internal links that still point to redirected URLs.
Crawl Failure Hotspots
Investigate redirect destinations that return failures.
Keyword Cannibalization
Plan safe redirects when consolidating overlapping pages.
Measure waste by scale and importance
One redirected link in an old article is different from a redirected URL used in every navigation menu. Prioritize by number of source pages, redirect hops, destination relevance, page importance, and whether the redirect occurs during a conversion path.
Inspect patterns rather than editing exported rows one by one. Common root causes include old CMS fields, hard-coded navigation, protocol rules, trailing slashes, locale routing, and historical category paths.
What the next crawl should show
Updating internal references should reduce redirect observations and increase direct 2xx destinations. The total number of discovered URLs can also fall because intermediate addresses are no longer requested.
If redirect waste remains, find whether links are coming from rendered components, canonical tags, sitemaps, structured data, or cached HTML. If it rises after a migration, confirm that new routes are not redirecting again through old routes.
Keep necessary redirects for external links and bookmarks. Google's redirect guidance supports permanent server-side redirects for permanent moves; the optimization is to stop your own site from repeatedly using outdated addresses.
Related guidance
Return to the Quick Wins overview to compare redirect waste with other crawl opportunities. MDN's HTTP status reference explains the response classes behind each redirect and error in the chain.
Crawl Traps
Learn how to detect crawl traps caused by faceted navigation, parameters, calendars, searches, sessions, and other unbounded URL patterns.
Crawl Cost Analysis
Learn how to analyze expensive URLs using request count, total transferred bytes, bytes per request, cache behavior, and page importance.