Re: [Lynx-dev] sudden site access failure: realclearpolitics.com

[Karen Lewellen]

Actually no,
The owner of fanfiction.net is also blocking normal fanfiction download 
programs with also are lower graphics in nature.  Same for some 
mobile platforms by using an everyone or anything that cannot solve the 
captcha is an enemy approach, at least in part.
Cloudflare has settings,  I have actually visited some sites using 
cloudflare and still gotten through in Lynx.
also, an owner can accept things like ip address
 and user agent, but again that is done on the site owner's side.
Kare


On Wed, 10 Nov 2021, Jude DaShiell wrote:

> I tried fanfiction.net and cloudflair blew up.  It wanted me to complete a
> captcha and wanted cookies on and javascript in use and no way lynx is
> doing all of that.  Maybe could code be put in lynx to block cloudflair
> whenever a lynx user attempts a site cloudflair handles?  The code
> probably ought to also ding the handlers of cloudflair that a lynx user
> was going to access say fanfiction.net or whatever the other site
> cloudflair handles and the lynx browser is set to automatically drop any
> cloudflair traffic since cloudflair is lynx browser hostile?
>
>
> On Wed, 10 Nov 2021, Karen Lewellen wrote:
>
> > Hi Rudy,
> > Have  you tried this site today?
> > Granted I am using the Lynx configuration at shellworld, but I just typed the
> > address you provided, and reached the page perfectly.
> > something to consider about cloudflare is that it tracks sometimes by IP
> > address.
> > Would love to learn how the fanfiction.net site works with your user agent
> > though, smiles.
> > Karen
> >
> >
> >
> > On Wed, 10 Nov 2021, Rudy Vener wrote:
> >
> > > Hi all,
> > >
> > > Yesterday realclearpolitics.com started returning the following page
> > > when I tried to access it with lynx.
> > >
> > >   Please enable JS and disable any ad blocker
> > >
> > > I invoke lynx as follows:
> > > /usr/local/bin/lynx-2.9.0-dev9 -useragent="Mozilla/5.0 (Macintosh; Intel Mac
> > > OS X 10_8_0) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.79
> > > Safari/537.1 lynx" $*
> > >
> > > The above user agent spoof normally lets me slip the Cloud Flare
> > > gatekeepers, but this seems to be something new.
> > >
> > > For what it's worth, the same problem now occurs with w3m, however,
> > > links (the chain)  can access the site just fine.
> > > If there is a simple configuration fix for this, I'd really like to know.
> > >
> > > Thank you.
> > >
> > > --
> > > Rudy Vener
> > > Website: http://www.rudyvener.com
> > > Twitter: https://twitter.com/RudySalt