Welcome to ShenZhenJia Knowledge Sharing Community for programmer and developer-Open, Learning and Share
menu search
person
editAsk a Question
Welcome To Ask or Share your Answers For Others

Categories

PHP爬取数据遇到前端判断是否爬虫并跳转，如何跳过限制

in Technique[技术] by (71.8m points)

监测到的跳转如下：
image.png

可以看到访问的步骤如下：

  1. 当我访问搜索结果页时，先是访问了设置是否爬虫的链接（settings/crawlerVerify）
  2. 浏览器中添加名为 IsCrawler 的cookie
  3. js判断并跳转到了真正的搜索结果页。

JS判断部分如下：
image.png

这个该如何用php去处理呢？感谢！


与恶龙缠斗过久,自身亦成为恶龙；凝视深渊过久,深渊将回以凝视…
thumb_up_alt 0 like thumb_down_alt 0 dislike
425 views
Welcome To Ask or Share your Answers For Others

1 Answer

by (71.8m points)
等待大神解答

与恶龙缠斗过久,自身亦成为恶龙；凝视深渊过久,深渊将回以凝视…
thumb_up_alt 0 like thumb_down_alt 0 dislike
Welcome to ShenZhenJia Knowledge Sharing Community for programmer and developer-Open, Learning and Share

Just Browsing Browsing

548k questions

547k answers

4 comments

86.3k users

Most popular tags

Theme made by Momin Raza, Modified by Ostack
Powered by Question2Answer
...