Skip to content

Remove 164 dead and stale RSS feeds#14

Open
Emlembow wants to merge 1 commit intochainfeeds:mainfrom
Emlembow:update-remove-dead-rss-feeds
Open

Remove 164 dead and stale RSS feeds#14
Emlembow wants to merge 1 commit intochainfeeds:mainfrom
Emlembow:update-remove-dead-rss-feeds

Conversation

@Emlembow
Copy link

@Emlembow Emlembow commented Aug 1, 2025

Summary

This PR performs a comprehensive cleanup of the RSS feed list, removing dead and stale feeds.

Changes:

  • Removed 77 dead feeds (404, 403, DNS errors, etc.)
  • Removed 87 stale feeds (no posts in 12+ months)
  • Reduced total feeds from 611 to 447

Methodology

1. Dead Feed Detection

  • Tested all 611 feeds for HTTP response codes
  • Removed feeds returning 403, 404, 500+ errors
  • Removed feeds with DNS/connection failures
  • Kept feeds with temporary issues (429 rate limiting)

2. Freshness Check

  • Checked last post date for all accessible feeds
  • Used 12-month cutoff (August 1, 2023)
  • Removed feeds with no recent activity

3. Medium.com Handling

  • Medium aggressively rate limits RSS access (HTTP 429)
  • Kept all 224 Medium feeds to avoid user disruption
  • Users may need alternative methods to access these feeds

Results

Category Count
Original feeds 611
Dead feeds removed 77
Stale feeds removed 87
Active feeds kept 447

Notable Removals

Dead Feeds

  • Major sites: Paradigm, a16z Crypto, OpenZeppelin blog
  • Personal blogs: Vitalik Buterin, Dan Finlay
  • Project blogs: Filecoin, Polkadot Network, Gitcoin

Stale Feeds (examples)

  • Unenumerated: 2687 days since last post
  • AlfaBlok: 1898 days
  • Many abandoned GitHub release feeds

Testing Details

See RSS_CLEANUP_REPORT.md for complete methodology and list of removed feeds.

The cleanup was performed using automated scripts with:

  • Parallel processing for efficiency
  • Conservative rate limiting for Medium
  • Proper SSL handling for HTTPS feeds

🤖 Generated with Claude Code

Co-Authored-By: Claude [email protected]

Comprehensive cleanup of RSS feed list:
- Removed 77 dead feeds (404, 403, DNS errors, etc.)
- Removed 87 stale feeds (no posts in 12+ months)
- Kept 447 active feeds
- Medium.com feeds kept despite rate limiting issues

See RSS_CLEANUP_REPORT.md for detailed methodology and results.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants