移动端菜单

网站日志抓取及百度页面收录分析记录

大唐营销老胡 2019-09-07 14:48:09 SEO案例分析 阅读

导读:如果网站收录出现了问题,大家可以进行网站日志分析,以下为笔者进行网站日志分析记录,并且监控网站收录情况。以下内容仅作为自己查看使用。

如果网站收录出现了问题,大家可以进行网站日志分析,以下为笔者进行网站日志分析记录,并且监控网站收录情况。以下内容仅作为自己查看使用。python实现方法:SEO与python应用编程:网站日志分析小功能

百度搜索蜘蛛抓取记录:

ps:笔者使用python写的程序,批量分析网站日志工具


日期:05/Sep/2019:09:06:35-网址:http://www.datangyingxiao.com/seo/gongju/108.html
日期:05/Sep/2019:11:43:35-网址:http://www.datangyingxiao.com/seo/zhenduan/123.html
日期:05/Sep/2019:10:36:54-网址:http://www.datangyingxiao.com/python/shipin/122.html
日期:05/Sep/2019:07:59:55-网址:http://www.datangyingxiao.com/sns/article-15004.html

日期:06/Sep/2019:09:24:36-网址:http://www.datangyingxiao.com/seo/
日期:06/Sep/2019:11:00:23-网址:http://www.datangyingxiao.com/seo/qiye/124.html
日期:06/Sep/2019:07:53:04-网址:http://www.datangyingxiao.com/sem/zhuanyuan/
日期:06/Sep/2019:09:25:06-网址:http://www.datangyingxiao.com/sem/
日期:06/Sep/2019:09:40:23-网址:http://www.datangyingxiao.com/sem/
日期:06/Sep/2019:10:27:03-网址:http://www.datangyingxiao.com/sem/edian/40.html
日期:06/Sep/2019:03:13:05-网址:http://www.datangyingxiao.com/python/ide/117.html
日期:06/Sep/2019:04:19:44-网址:http://www.datangyingxiao.com/sns/doing/default/all.html
日期:06/Sep/2019:04:53:03-网址:http://www.datangyingxiao.com/sns/doing/default/all/38.html
日期:06/Sep/2019:06:23:03-网址:http://www.datangyingxiao.com/sns/doing/default/all/2.html
日期:06/Sep/2019:09:25:20-网址:http://www.datangyingxiao.com/sns/
日期:06/Sep/2019:23:20:43-网址:http://www.datangyingxiao.com/tags-etagid26-0.html
日期:06/Sep/2019:00:13:04-网址:http://www.datangyingxiao.com/tags-etagid99-0.html

日期:07/Sep/2019:06:33:57-网址:http://www.datangyingxiao.com/sem/index_2.html
日期:07/Sep/2019:06:33:57-网址:http://www.datangyingxiao.com/sem/index.html
日期:07/Sep/2019:06:34:18-网址:http://www.datangyingxiao.com/sem/jiaocheng/63.html
日期:07/Sep/2019:06:34:53-网址:http://www.datangyingxiao.com/sem/jiaocheng/63.html
日期:07/Sep/2019:06:35:03-网址:http://www.datangyingxiao.com/sem/zhushou/33.html
日期:07/Sep/2019:06:35:19-网址:http://www.datangyingxiao.com/sem/index_2.html
日期:07/Sep/2019:06:35:20-网址:http://www.datangyingxiao.com/sem/index.html
日期:07/Sep/2019:06:35:22-网址:http://www.datangyingxiao.com/sem/kaihu/32.html
日期:07/Sep/2019:06:35:23-网址:http://www.datangyingxiao.com/tags-etagid41-0.html
日期:07/Sep/2019:06:35:23-网址:http://www.datangyingxiao.com/sem/peixun/35.html
日期:07/Sep/2019:06:35:23-网址:http://www.datangyingxiao.com/tags-etagid3-0.html
日期:07/Sep/2019:06:35:24-网址:http://www.datangyingxiao.com/tags-etagid42-0.html
日期:07/Sep/2019:06:35:37-网址:http://www.datangyingxiao.com/sem/zhushou/33.html
日期:07/Sep/2019:06:35:43-网址:http://www.datangyingxiao.com/sem/index_2.html
日期:07/Sep/2019:06:35:45-网址:http://www.datangyingxiao.com/sem/index.html
日期:07/Sep/2019:06:35:48-网址:http://www.datangyingxiao.com/sem/kaihu/32.html
日期:07/Sep/2019:06:35:48-网址:http://www.datangyingxiao.com/tags-etagid41-0.html
日期:07/Sep/2019:06:35:48-网址:http://www.datangyingxiao.com/tags-etagid3-0.html
日期:07/Sep/2019:06:35:49-网址:http://www.datangyingxiao.com/sem/peixun/35.html
日期:07/Sep/2019:06:35:49-网址:http://www.datangyingxiao.com/tags-etagid42-0.html
日期:07/Sep/2019:06:35:49-网址:http://www.datangyingxiao.com/sem/feiyong/31.html
日期:07/Sep/2019:06:35:49-网址:http://www.datangyingxiao.com/sem/zhanghu/34.html
日期:07/Sep/2019:06:35:50-网址:http://www.datangyingxiao.com/sem/jiaocheng/63.html
日期:07/Sep/2019:06:35:50-网址:http://www.datangyingxiao.com/sem/shuju/30.html
日期:07/Sep/2019:06:35:50-网址:http://www.datangyingxiao.com/sem/zhushou/33.html
日期:07/Sep/2019:06:35:50-网址:http://www.datangyingxiao.com/sem/zhaopin/29.html
日期:07/Sep/2019:06:35:50-网址:http://www.datangyingxiao.com/tags-etagid39-0.html
日期:07/Sep/2019:06:35:51-网址:http://www.datangyingxiao.com/sem/what/28.html
日期:07/Sep/2019:06:35:51-网址:http://www.datangyingxiao.com/tags-etagid40-0.html
日期:07/Sep/2019:06:35:52-网址:http://www.datangyingxiao.com/sem/jiaocheng/27.html
日期:07/Sep/2019:06:35:52-网址:http://www.datangyingxiao.com/sem/edian/40.html
日期:07/Sep/2019:06:35:52-网址:http://www.datangyingxiao.com/sem/gongju/26.html
日期:07/Sep/2019:06:35:52-网址:http://www.datangyingxiao.com/sem/jingpin/39.html
日期:07/Sep/2019:06:35:53-网址:http://www.datangyingxiao.com/sem/zhuoluye/25.html
日期:07/Sep/2019:06:35:53-网址:http://www.datangyingxiao.com/sem/zhuanqian/38.html
日期:07/Sep/2019:06:35:53-网址:http://www.datangyingxiao.com/sem/edian/64.html
日期:07/Sep/2019:06:35:53-网址:http://www.datangyingxiao.com/sem/zhuanyuan/37.html
日期:07/Sep/2019:06:35:54-网址:http://www.datangyingxiao.com/sem/tuoguan/36.html
日期:07/Sep/2019:07:33:23-网址:http://www.datangyingxiao.com/sem/jingpin/39.html
日期:07/Sep/2019:09:35:56-网址:http://www.datangyingxiao.com/
日期:07/Sep/2019:15:21:08-网址:http://www.datangyingxiao.com/python/peixun/126.html
日期:07/Sep/2019:18:17:26-网址:http://www.datangyingxiao.com/sem/kaihu/32.html
日期:07/Sep/2019:22:31:25-网址:http://www.datangyingxiao.com/tags-etagid101-0.html
日期:07/Sep/2019:23:44:59-网址:http://www.datangyingxiao.com/sem/edian/40.html

备注:9月7日百度蜘蛛开始抓取网站主要内容,包括seo、sem、python、tags下面的内容,继续观察蜘蛛抓取和收录。

日期:08/Sep/2019:03:39:09 网址:http://www.datangyingxiao.com/sem/edian/
日期:08/Sep/2019:05:09:09 网址:http://www.datangyingxiao.com/tags-etagid85-0.html
日期:08/Sep/2019:06:39:09 网址:http://www.datangyingxiao.com/sem/kaihu/32.html
日期:08/Sep/2019:12:39:24 网址:http://www.datangyingxiao.com/seo/anli/125.html
日期:08/Sep/2019:21:15:46 网址:http://www.datangyingxiao.com/sem/kaihu/32.html
日期:09/Sep/2019:00:44:39 网址:http://www.datangyingxiao.com/seo/gongju/108.html


09/Sep/2019:12:39:52 http://www.datangyingxiao.com/sem/
09/Sep/2019:13:10:04 http://www.datangyingxiao.com/seo/gongju/127.html
09/Sep/2019:14:12:57 http://www.datangyingxiao.com/sem/zhanghu/
09/Sep/2019:14:16:44 http://www.datangyingxiao.com/tags-etagid43-0.html
09/Sep/2019:15:23:24 http://www.datangyingxiao.com/python/jiaocheng/128.html
09/Sep/2019:23:24:53 http://www.datangyingxiao.com/seo/riji/129.html


10/Sep/2019:10:09:46 http://www.datangyingxiao.com/seo/anli/125.html
10/Sep/2019:12:36:15 http://www.datangyingxiao.com/seo/zhishi/130.html
10/Sep/2019:18:18:25 http://www.datangyingxiao.com/sem/tuoguan/
10/Sep/2019:18:38:49 http://www.datangyingxiao.com/sem/zhaopin/

11/Sep/2019:11:39:09 http://www.datangyingxiao.com/seo/zhenduan/131.html
11/Sep/2019:16:05:25 http://www.datangyingxiao.com/sns/article-15052.html
11/Sep/2019:16:31:07 http://www.datangyingxiao.com/tags-etagid99-0.html
11/Sep/2019:17:04:26 http://www.datangyingxiao.com/sem/zhuanyuan/
11/Sep/2019:22:14:05 http://www.datangyingxiao.com/sem/kaihu/32.html

13/Sep/2019:01:06:46 http://www.datangyingxiao.com/sem/zhuanyuan/
13/Sep/2019:01:29:30 http://www.datangyingxiao.com/python/peixun/126.html
13/Sep/2019:09:06:54 http://www.datangyingxiao.com/sem/peixun/35.html
13/Sep/2019:11:06:41 http://www.datangyingxiao.com/sem/tuoguan/
13/Sep/2019:13:14:32 http://www.datangyingxiao.com/sem/kaihu/32.html
13/Sep/2019:15:54:20 http://www.datangyingxiao.com/tags-etagid101-0.html
14/Sep/2019:06:48:22 http://www.datangyingxiao.com/sem/kaihu/32.html
14/Sep/2019:16:44:38 http://www.datangyingxiao.com/sem/kaihu/32.html
15/Sep/2019:22:20:28 http://www.datangyingxiao.com/sns/c-7/1.html

16/Sep/2019:13:08:23 http://www.datangyingxiao.com/sem/jingpin/39.html

17/Sep/2019:03:56:20 http://www.datangyingxiao.com/tags-etagid99-0.html
17/Sep/2019:04:29:40 http://www.datangyingxiao.com/seo/jiaocheng/133.html
17/Sep/2019:05:03:00 http://www.datangyingxiao.com/python/peixun/126.html
17/Sep/2019:05:36:23 http://www.datangyingxiao.com/sns/new/default/1.html
17/Sep/2019:09:27:57 http://www.datangyingxiao.com/sem/what/
17/Sep/2019:10:39:37 http://www.datangyingxiao.com/seo/jiaocheng/134.html
17/Sep/2019:13:30:50 http://www.datangyingxiao.com/tags-etagid55-0.html
17/Sep/2019:15:01:20 http://www.datangyingxiao.com/sem/gongju/
17/Sep/2019:15:34:40 http://www.datangyingxiao.com/seo/gongju/
17/Sep/2019:19:27:26 http://www.datangyingxiao.com/tags-etagid101-0.html

18/Sep/2019:08:05:40 http://www.datangyingxiao.com/sns/article-15000.html
18/Sep/2019:08:25:57 http://www.datangyingxiao.com/tags-etagid54-0.html
18/Sep/2019:20:26:10 http://www.datangyingxiao.com/sem/zhanghu/

19/Sep/2019:04:25:02 http://www.datangyingxiao.com/seo/zhenduan/135.html
19/Sep/2019:05:54:20 http://www.datangyingxiao.com/sem/tuoguan/
19/Sep/2019:06:27:40 http://www.datangyingxiao.com/seo/what/41.html
19/Sep/2019:07:01:02 http://www.datangyingxiao.com/sem/zhanghu/
19/Sep/2019:07:34:19 http://www.datangyingxiao.com/tags-etagid54-0.html
19/Sep/2019:08:07:40 http://www.datangyingxiao.com/seo/anli/
19/Sep/2019:08:15:26 http://www.datangyingxiao.com/sem/peixun/
19/Sep/2019:08:41:00 http://www.datangyingxiao.com/sem/tuoguan/36.html
19/Sep/2019:09:14:18 http://www.datangyingxiao.com/sem/peixun/
19/Sep/2019:09:47:38 http://www.datangyingxiao.com/sem/kaihu/
19/Sep/2019:10:21:00 http://www.datangyingxiao.com/seo/gongju/
19/Sep/2019:10:54:18 http://www.datangyingxiao.com/sem/shuju/
19/Sep/2019:12:01:00 http://www.datangyingxiao.com/sns/q-209.html
19/Sep/2019:12:34:22 http://www.datangyingxiao.com/sem/zhuoluye/
19/Sep/2019:13:07:38 http://www.datangyingxiao.com/seo/qiye/136.html
19/Sep/2019:13:40:58 http://www.datangyingxiao.com/sns/topic/default/9.html
19/Sep/2019:14:14:18 http://www.datangyingxiao.com/sns/topic/default/8.html
19/Sep/2019:14:47:42 http://www.datangyingxiao.com/sns/topic/default/7.html
19/Sep/2019:15:21:02 http://www.datangyingxiao.com/seo/jiaocheng/19.html
19/Sep/2019:15:54:22 http://www.datangyingxiao.com/sem/peixun/35.html
19/Sep/2019:16:27:42 http://www.datangyingxiao.com/sem/kaihu/32.html
19/Sep/2019:17:01:00 http://www.datangyingxiao.com/seo/yingxiao/44.html
19/Sep/2019:17:34:24 http://www.datangyingxiao.com/sem/jiaocheng/
19/Sep/2019:18:40:58 http://www.datangyingxiao.com/seo/
19/Sep/2019:19:14:20 http://www.datangyingxiao.com/seo/zhaopin/
19/Sep/2019:19:47:40 http://www.datangyingxiao.com/sem/what/
19/Sep/2019:20:21:01 http://www.datangyingxiao.com/tags-etagid84-0.html
19/Sep/2019:20:54:42 http://www.datangyingxiao.com/sem/gongju/
19/Sep/2019:21:27:42 http://www.datangyingxiao.com/sem/zhuanqian/38.html
19/Sep/2019:22:01:00 http://www.datangyingxiao.com/sem/zhaopin/
19/Sep/2019:22:34:24 http://www.datangyingxiao.com/sem/zhuoluye/
19/Sep/2019:23:07:42 http://www.datangyingxiao.com/seo/index_2.html
20/Sep/2019:00:14:22 http://www.datangyingxiao.com/sem/edian/40.html
20/Sep/2019:00:47:42 http://www.datangyingxiao.com/tags-etagid5-0.html

ps:使用python进行网站日志分析效率提升N倍,之前使用了几次手工分析,效率实在太低,如果数据量小手工可以应付,如果数据量大,或者经常分析,建议使用工具。

20/Sep/2019:01:21:02 http://www.datangyingxiao.com/sem/jingpin/
20/Sep/2019:01:54:22 http://www.datangyingxiao.com/sem/zhaopin/29.html
20/Sep/2019:02:27:42 http://www.datangyingxiao.com/seo/zhenduan/
20/Sep/2019:03:34:24 http://www.datangyingxiao.com/tags-etagid6-0.html
20/Sep/2019:04:07:40 http://www.datangyingxiao.com/sem/zhuanyuan/
20/Sep/2019:04:41:00 http://www.datangyingxiao.com/seo/what/
20/Sep/2019:05:47:42 http://www.datangyingxiao.com/seo/what/41.html
20/Sep/2019:15:10:04 http://www.datangyingxiao.com/seo/zhenduan/137.html
20/Sep/2019:16:16:48 http://www.datangyingxiao.com/python/shuji/
21/Sep/2019:13:35:31 http://www.datangyingxiao.com/seo/anli/55.html
21/Sep/2019:18:55:35 http://www.datangyingxiao.com/seo/heimao/
22/Sep/2019:22:34:43 http://www.datangyingxiao.com/sem/zhuoluye/

23/Sep/2019:11:38:28  http://www.datangyingxiao.com/sem/zhanghu/
23/Sep/2019:12:12:11 http://www.datangyingxiao.com/seo/zhenduan/138.html
23/Sep/2019:18:00:14 http://www.datangyingxiao.com/tags-etagid110-0.html
23/Sep/2019:19:40:13 http://www.datangyingxiao.com/sns/q-220.html
23/Sep/2019:20:13:33 http://www.datangyingxiao.com/sns/article-15055.html

24/Sep/2019:10:13:32  http://www.datangyingxiao.com/seo/zhenduan/139.html
24/Sep/2019:11:20:12 http://www.datangyingxiao.com/seo/zhenduan/140.html
24/Sep/2019:12:26:52 http://www.datangyingxiao.com/sem/edian/40.html
24/Sep/2019:13:00:22 http://www.datangyingxiao.com/sem/zhaopin/29.html
24/Sep/2019:14:00:25 http://www.datangyingxiao.com/seo/zhenduan/140.html
24/Sep/2019:14:00:42 http://www.datangyingxiao.com/seo/zhenduan/139.html
24/Sep/2019:14:01:09 http://www.datangyingxiao.com/seo/zhenduan/138.html
24/Sep/2019:21:06:35 http://www.datangyingxiao.com/sem/edian/40.html
24/Sep/2019:22:24:23 http://www.datangyingxiao.com/seo/zhenduan/137.html
24/Sep/2019:22:44:34 http://www.datangyingxiao.com/seo/qiye/136.html
24/Sep/2019:23:51:14 http://www.datangyingxiao.com/sns/c-3.html

25/Sep/2019:01:15:14 http://www.datangyingxiao.com/python/peixun/118.html
25/Sep/2019:08:48:45 http://www.datangyingxiao.com/tags-etagid71-0.html
25/Sep/2019:11:48:06 http://www.datangyingxiao.com/seo/zhishi/141.html
25/Sep/2019:18:31:47 http://www.datangyingxiao.com/tags-etagid71-0.html
25/Sep/2019:20:10:45 http://www.datangyingxiao.com/sem/zhuoluye/

26/Sep/2019:03:25:22 http://www.datangyingxiao.com/seo/zhenduan/138.html
26/Sep/2019:06:37:35 http://www.datangyingxiao.com/tags-etagid71-0.html
26/Sep/2019:09:09:10 http://www.datangyingxiao.com/sem/edian/40.html
26/Sep/2019:10:15:50 http://www.datangyingxiao.com/sns/c-7/all.html
26/Sep/2019:10:16:49 http://www.datangyingxiao.com/python/peixun/118.html
26/Sep/2019:11:43:46 http://www.datangyingxiao.com/seo/zhishi/142.html
26/Sep/2019:21:17:57 http://www.datangyingxiao.com/sem/zhuoluye/

 

文章作者: 大唐营销老胡
文章地址:http://www.datangyingxiao.com/seo/anli/125.html
版权所有:转载时必须以链接形式注明作者和原始出处及本声明。

大唐营销老胡 大唐营销老胡微信二维码
栏目导航
最新文章
热门文章
热门标签