Re: [Lynx-dev] sudden site access failure: realclearpolitics.com

[Rudy Vener]

Looks like the most direct solution would be to have the user settings modified 
to accept
any connections with "lynx" in the user agent string.

But then, everyone will start spoofing lynx.

On Wed, Nov 10, 2021 at 04:56:27PM -0500, Karen Lewellen wrote:
> Actually no,
> The owner of fanfiction.net is also blocking normal fanfiction download
> programs with also are lower graphics in nature.  Same for some mobile
> platforms by using an everyone or anything that cannot solve the captcha is
> an enemy approach, at least in part.
> Cloudflare has settings,  I have actually visited some sites using
> cloudflare and still gotten through in Lynx.
> also, an owner can accept things like ip address
>  and user agent, but again that is done on the site owner's side.
> Kare
> 
> 
> On Wed, 10 Nov 2021, Jude DaShiell wrote:
> 
> > I tried fanfiction.net and cloudflair blew up.  It wanted me to complete a
> > captcha and wanted cookies on and javascript in use and no way lynx is
> > doing all of that.  Maybe could code be put in lynx to block cloudflair
> > whenever a lynx user attempts a site cloudflair handles?  The code
> > probably ought to also ding the handlers of cloudflair that a lynx user
> > was going to access say fanfiction.net or whatever the other site
> > cloudflair handles and the lynx browser is set to automatically drop any
> > cloudflair traffic since cloudflair is lynx browser hostile?
> > 
> > 
> > On Wed, 10 Nov 2021, Karen Lewellen wrote:
> > 
> > > Hi Rudy,
> > > Have  you tried this site today?
> > > Granted I am using the Lynx configuration at shellworld, but I just typed 
> > > the
> > > address you provided, and reached the page perfectly.
> > > something to consider about cloudflare is that it tracks sometimes by IP
> > > address.
> > > Would love to learn how the fanfiction.net site works with your user agent
> > > though, smiles.
> > > Karen
> > > 
> > > 
> > > 
> > > On Wed, 10 Nov 2021, Rudy Vener wrote:
> > > 
> > > > Hi all,
> > > > 
> > > > Yesterday realclearpolitics.com started returning the following page
> > > > when I tried to access it with lynx.
> > > > 
> > > >   Please enable JS and disable any ad blocker
> > > > 
> > > > I invoke lynx as follows:
> > > > /usr/local/bin/lynx-2.9.0-dev9 -useragent="Mozilla/5.0 (Macintosh; 
> > > > Intel Mac
> > > > OS X 10_8_0) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.79
> > > > Safari/537.1 lynx" $*
> > > > 
> > > > The above user agent spoof normally lets me slip the Cloud Flare
> > > > gatekeepers, but this seems to be something new.
> > > > 
> > > > For what it's worth, the same problem now occurs with w3m, however,
> > > > links (the chain)  can access the site just fine.
> > > > If there is a simple configuration fix for this, I'd really like to 
> > > > know.
> > > > 
> > > > Thank you.
> > > > 
> > > > --
> > > > Rudy Vener
> > > > Website: http://www.rudyvener.com
> > > > Twitter: https://twitter.com/RudySalt
> > > > 
> > > > 
> > > 
> > > 
> > 
> > 

-- 
Rudy Vener
Website: http://www.rudyvener.com
Twitter: https://twitter.com/RudySalt