Re: [Lynx-dev] sudden site access failure:

[Rudy Vener]

Hi Karen,
When I enter "child of hogwarts" I arrive at a page
filled with links to both stories and reviews. I can navigate to
the review pages, but the story links  send me here:
   REFRESH(35 sec): https://m.fanfiction.net/s/8145179/3/The-Child-of-Hogwarts

Please turn JavaScript on and reload the page.

Checking your browser before accessing m.fanfiction.net.

   Please enable Cookies and reload the page.

   This process is automatic. Your browser will redirect to your requested 
content shortly.

   Please allow up to 5 seconds...

   Redirecting...
   DDoS protection by Cloudflare
   Ray ID: 6ae199417c320c9d


Now I do click on the refresh links too, but end up at the same page.
Conclusion: Cloud Flare doesn't like Lynx, even when we lie and pretend we're 
Firefox running on a Mac.

Yeah, I know. It's a bummer. And I strongly suspect the only real solution
is to have javascript operational even if it tosses out much of the resulting 
rendered objects. 

Rudy

On Sun, Nov 14, 2021 at 12:30:46AM -0500, Karen Lewellen wrote:
> Okay,
> That is what you should be getting.
> One more test please?
> There is a text field under the option list, story for example.
> just for this test type with quotation marks,
> "child of Hogwarts"
> That is a story title.
> you will get a list of stories with comparative aspects, just choose one
> then share what happens.
> Reason why I am asking is, on my dreamhost shell, I get that too, even using
> the basic lynx user agent header, comprised of the edition of lynx being
> run.
> when I choose a story though I get the cloudflare  page, but it is supposed
> to redirect.
> I am wondering if it will for your user agent header.
> does all that make sense?
> Karen
> 
> 
> 
> On Sat, 13 Nov 2021, Rudy Vener wrote:
> 
> > Hi Karen,
> > No. Here's what I get:
> >   FanFiction
> >   Just In
> >   Community
> >   Forum
> >   V
> >   More
> > 
> >                                                             [Story____] 
> > ____________________ Go
> > 
> >   [INS: :INS]
> > 
> >   Regular           Crossover
> >   [INLINE] Anime    [INLINE] Anime
> >   [INLINE] Books    [INLINE] Books
> >   [INLINE] Cartoons [INLINE] Cartoons
> >   [INLINE] Comics   [INLINE] Comics
> >   [INLINE] Games    [INLINE] Games
> >   [INLINE] Misc     [INLINE] Misc
> >   [INLINE] Movies   [INLINE] Movies
> >   [INLINE] Plays    [INLINE] Plays
> >   [INLINE] TV       [INLINE] TV
> >   Twitter Ads info and privacy
> >   Tweets by @FictionPress
> >   (BUTTON) Load new Tweets
> >    1. FictionPress @FictionPress
> >       We have fixed a login issue with some version of Firefox browsers. If 
> > you are using Firefox and was having login problems, please try it now.
> >       Apr 1, 2019
> >          +
> > [ lots of stuff deleted ]
> > 
> > On Sat, Nov 13, 2021 at 09:47:42PM -0500, Karen Lewellen wrote:
> > > Rudy,
> > > When you use your user agent and visit
> > > m.fanfiction.net
> > > Are you presented with cloudflare?
> > > Karen
> > > 
> > > 
> > > 
> > > On Sat, 13 Nov 2021, Rudy Vener wrote:
> > > 
> > > > Hi Karen,
> > > > The standard default is not to save the user agent string to the 
> > > > .lynxrc file.
> > > > And even if you change the user agent during one session, it wouldn't 
> > > > overwrite
> > > > your current .lynxrc file unless you save the changes.
> > > > 
> > > > The flip side of this is that you have to enter a new user agent string 
> > > > each time you run lynx.
> > > > That's the main reason I use my own lynx script.
> > > > 
> > > > On the other hand, you can use an alias:
> > > > alias lynx="lynx -useragent=\"Mozilla/5.0 (Macintosh; U; PPC Mac OS X 
> > > > Mach-O; XH; rv:8.578.498) fr, Gecko/20121021 Camino/8.723+ (Firefox 
> > > > compatible Lynx)\"  "
> > > > and lynx will  use that user agent string for the life of the shell 
> > > > session.
> > > > 
> > > > When you are done, then
> > > > unalias lynx
> > > > will return everything back to normal.
> > > > 
> > > > Caveat. All my examples are for the ksh shell. I know most people use 
> > > > bash, but
> > > > I'm not familiar with it.
> > > > 
> > > > Rudy
> > > > On Sat, Nov 13, 2021 at 07:49:15PM -0500, Karen Lewellen wrote:
> > > > > Rudy,
> > > > > All of my access  to lynx is tied  to shell services.  Shellworld 
> > > > > mainly,
> > > > > and the shell provided by dreamhost.
> > > > > There is a choice in the options menu, below the send user agent 
> > > > > check box
> > > > > that  is a field which I would have to remove and edit.
> > > > > I do not run scripts  for anything, and try not to make major changes 
> > > > > to
> > > > > config files for the services I use.
> > > > > its been several   years since anyone has built  lynx for DOS which 
> > > > > remains
> > > > > my desktop operating system.
> > > > > I do have a copy of Links the chain for dos which  is a mix, mostly 
> > > > > because
> > > > > it does not read  things as fluidly.
> > > > > So for those not using a script, as Rudy does, would my testing the 
> > > > > user
> > > > > agent be a firm change if not written to disc?
> > > > > I have no access to the lynx.cfg files on my dreamhost shell, the 
> > > > > place
> > > > > where I would  be doing this test.
> > > > > Thanks,
> > > > > Karen
> > > > > 
> > > > > 
> > > > > 
> > > > > On Sat, 13 Nov 2021, Rudy Vener wrote:
> > > > > 
> > > > > > >   realclearpolitics.com
> > > > > > > Message-ID:
> > > > > > >   <Pine.LNX.4.64.2111121843100.1976823@server2.shellworld.net>
> > > > > > > Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed
> > > > > > 
> > > > > > Hi Karen,
> > > > > > By default, lynx doesn't save the User Agent string in .lynxrc. This
> > > > > > could be changed in lynx.cfg, but I just call lynx from
> > > > > > a script in ~/bin/lynx like this:
> > > > > > /usr/local/bin/lynx-2.9.0-dev9 -useragent="Mozilla/5.0 (Macintosh; 
> > > > > > U; PPC Mac OS X Mach-O; XH; rv:8.578.498) fr, Gecko/20121021 
> > > > > > Camino/8.723+ (Firefox compatible Lynx)" $*
> > > > > > 
> > > > > > Rudy
> > > > > > 
> > > > > > > From: Karen Lewellen <klewellen@shellworld.net>
> > > > > > > 
> > > > > > > Hi Rudy, everyone.
> > > > > > > Is the user agent header field saved when changed, if one chooses 
> > > > > > > the
> > > > > > > write  options to disc  selection?
> > > > > > > I want to test Rudy's  user agent on my office shell,  and as 
> > > > > > > that does
> > > > > > > not seem to be a cut  / paste box, wanted to ask before I try and 
> > > > > > > work on
> > > > > > > this.
> > > > > > > Thanks,
> > > > > > > Karen
> > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > 
> > > > > > --
> > > > > > Rudy Vener
> > > > > > Website: http://www.rudyvener.com
> > > > > > Twitter: https://twitter.com/RudySalt
> > > > > > 
> > > > > > 
> > > > 
> > > > --
> > > > Rudy Vener
> > > > Website: http://www.rudyvener.com
> > > > Twitter: https://twitter.com/RudySalt
> > > > 
> > > > 
> > 
> > -- 
> > Rudy Vener
> > Website: http://www.rudyvener.com
> > Twitter: https://twitter.com/RudySalt
> > 
> > 

-- 
Rudy Vener
Website: http://www.rudyvener.com
Twitter: https://twitter.com/RudySalt