In >90% of cases the standard way of checking meta tags is enough to find the feeds. But my goal for this tool is that it finds feeds regardless if they're linked somewhere or not. That if this feed finder doesn't find a feed, no feed exists.
It's a big goal and admittedly not there yet, but it does a few things that are a step in that direction.
* Checks meta tags of parent pages (sometimes the article itself doesn't have the meta tag, but the main blog page does)
* Checks common suffixes like /rss, /index.xml and many others (sometimes the feed exists but isn't linked)
* Checks the sitemap
* Checks all links on the page
* Checks 3rd party feeds (OpenRSS for now, when I find more such repositories I'll add them too)
There are a couple of additional ideas I have, like checking search engines and crawling the entire domain (highly inefficient, but possible).
Would love if you could try it, and even more if you post sites where it doesn't work.
If you maintain any website with a news feed, go right now and check that you have this in your <head>:
(Also note whether and where you need to use application/rss+xml, application/atom+xml, or application/json.)I suspect some sites are just running some framework than enables it and don't even realize they have one.
I have used this site in the past to find feeds: https://www.rsssearchhub.com/
In the past I was looking for a feed for https://ra.co, but could not find it, though I had seen old posts referencing a RSS feed.
I ended up emailing them and, to my delight, they let me know they still have an unsupported RSS feed here:
https://ra.co/xml/rss_news.xml
Just for feedback, this tool doesn't find the feed, though it doesn't look like a standard URL to me.
>Mozilla is working on alternatives such as Pocket or Reader Mode, and on improving WebExtensions which could provide features related to RSS/Atom feeds without the toll on maintenance. (ref: https://www.ghacks.net/2018/07/25/mozilla-plans-to-remove-rs...)
Probably they're expecting people to just paste the website URL in the feed reader and them identifying it. But it would be nice to see the RSS URL linked somewhere.
Ok then.
Also, this would make more sense as a browser extension. Especially if it brought back the RSS icon in the address bar to indicate when a feed is available (although maybe you don't want it to do all of the checks until prompted).
Yeah the checks are quite expansive, depending on the URL it might more than a hundred requests.
A browser extension would make sense. Guess I have another project :D
TypeError: URL constructor: is not a valid URL. [NextJS] (5603-cb6f1c5a9761f9d0.js:14:5466)
Browser is Firefox 130.0 on Windows.
Would be really nice to see this working really well since I search for RSS feeds a lot for a bunch of different things. Whether the RSS feed is good is always another question.
Your method described above should have found at least two feeds I think.
[1] https://www.npmjs.com/package/rss-url-finder
[0] https://refeed.to
Since creating it I also use it to inject a few extra cartoons into my feed (xkcd every day!) and have also had fun with tech flashbacks from trustedreviews.com. So it's just a way to add a little variation to my feed.
https://github.com/DIYgod/RSSHub/
https://github.com/DIYgod/RSSHub-Radar
I always use RSSHub Radar , Your tools support more website than RSSHub Radar
Detection of /feed could be added, most wordpres supported sites have this suffix
Wondering if it's necessary to continue with the other checks if you find a feed in the meta tags?
I guess the best option is to show results as soon as they are found, without waiting for everything to complete.