要爬取的字段:
- 来源:url
- 图片
- 系列名 + 系列编号:My Weirdest School #7
- 书名
- 作者
- Grades
- 不同等级分类
- Guided Reading
- Lexile Measure
- Grade Level Equivalent
- DRA Level
- Genre
- ISBN
- Pages
- 标签tags
- 相关推荐
经过分析,入口是:
“Showing 65,493 Results for All in Books”
-》
![](https://www.crifan.com/files/pic/uploads/2021/03/26c37eb53e6a444f82c8bfe540f4966f.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/40a614c4e6dd439f969f00cff92177c0.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/0809462fc2e44b53a777c836c664d4d5.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/619b0b38b270417b9d2f27b39fee363c.jpg)
另外的特殊的:
(1)带系列名 #N的
![](https://www.crifan.com/files/pic/uploads/2021/03/0da1d70b585442f9a09fbb3e4be74b05.jpg)
(2)只有系列名的:
![](https://www.crifan.com/files/pic/uploads/2021/03/afa7ec6775fa49eba95edf66b5b17326.jpg)
(3)注意 评级中,有些数据是 N/A 表示空的:
![](https://www.crifan.com/files/pic/uploads/2021/03/06af7af5529e4a519f1c28a322086aa9.jpg)
(4)插图作者
-》有时候比作者更出名
-》有价值,要保存:
![](https://www.crifan.com/files/pic/uploads/2021/03/ee7590c8c1504cdca2f98558306af384.jpg)
illustrator:插图作者
一个或多个
(5)西班牙语=西语
- 如何判断是西语还是英语,待内容团队确定
-》后续或许会用到:
判断文字的语言
(6)有些图片是没有的
![](https://www.crifan.com/files/pic/uploads/2021/03/eff8dea4c2da48a2a76e1a32ccb37bbb.jpg)
IMAGE NOT AVAILABLE
304304 results
All Ranges, All Categories
第二页:
-》每本书:
![](https://www.crifan.com/files/pic/uploads/2021/03/64ee8b7a2a5549d89144be45cba4a909.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/fe46b4d890444ebfb8ad1e7acf0232ca.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/e6457887b0104761b89585b22d99aeb7.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/22eec0e779f54e18be449f0462a87b20.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/cf75688bb43f4e828c4def1d6a336fab.jpg)
要爬取的字段:
- url:url地址
- title
- pages: Int数值,默认0
- 只有列表页有
- isbn13
- 可以从url中提取出来:
- https://fab.lexile.com/book/details/9780671746063/
- 中的9780671746063
- coverImgUrl:封面图片
- description:summary
- authors:字符串列表
- 1或多个
- language
- copyright
- ages:Age Range,9 to 13
- 有些没有
- lexileMeasure:Lexile Measure
- vocabularyWords:Vocabulary Words,字符串列表
- 额外属性
- seriesName:
- Series
- 假定,正常只有1个
- 如果有多个,再讨论
- 可选
- categories:字符串列表,1或多个,可选
- awards:字符串列表,1或多个,可选
- recommendations:推荐More like this
- 每个:{title, url}
额外说明:
【整理】英文难度等级评测标准:Lexile兰斯
BR的含义:
根据筛选条件是:
BR400L – 1900L
![](https://www.crifan.com/files/pic/uploads/2021/03/5e163004f1f74bc09a828db38bf084df.jpg)
-》推测是:
BR等价于:-
即:
-400L 到 +1900L
而其他几个:
AD,GN,HL,IG,NC
只是辅助性的描述
特殊情况:
(1)summary可能没有
![](https://www.crifan.com/files/pic/uploads/2021/03/68e980cd66944ad7afb6309895d9d0cd.jpg)
(2)额外属性是Categories,甚至多个的:
![](https://www.crifan.com/files/pic/uploads/2021/03/b9921efc4a3746259ede1b2eeb21ee0d.jpg)
多个的:
![](https://www.crifan.com/files/pic/uploads/2021/03/779680f111354291b38d67663257fd52.jpg)
(3)部分列表页没有pages的信息的
Additional Filters:Award winners
![](https://www.crifan.com/files/pic/uploads/2021/03/2207abdb1ac343679918f1d1b506dfa7.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/bb54525ef2214ca8951deed7615c496c.jpg)
-》
(4)封面可能没有
![](https://www.crifan.com/files/pic/uploads/2021/03/6db7a75f832c4db5bf8f22af84ed0d5a.jpg)
有两个入口:
Advanced Search -》 点击 Show Lexile® Measure
然后:
Lexile® Measure:0-1900
Interest Level:选其中1个,共选4次,即可列出所有的书
![](https://www.crifan.com/files/pic/uploads/2021/03/d3f9e12d62764fc484429fe71625fab4.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/0ef2eb922a3149469168b428a7cae07c.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/8822dfe6788a4161aaa3cdb5b224ea34.jpg)
每个页面:
要爬取的字段:
![](https://www.crifan.com/files/pic/uploads/2021/03/74971f9728c04767a83258388337fd49.jpg)
- 来源:url
- 标题
- 作者
- AR Quiz Number:201917
- 描述
- AR Quiz Availability
- Reading Practice
- 表格
- ATOS Book Level
- Interest Level
- AR Points
- Rating
- http://www.arbookfind.co.uk/bookdetail.aspx?q=201917&l=EN&slid=182080583&lm=1 中有
- http://www.arbookfind.com.au/bookdetail.aspx?q=301178&l=EN&slid=182082181&lm=1 中没有
- Fiction/Non-fiction
- Topic – Subtopic
- 出版信息
- 多行
- Publisher
- ISBN
- Year Published
- Page Count
- 特殊:
特殊:
(1)待后续数据合并时讨论如何处理:
比如:
的ISBN:
Publisher ISBN Year Published Page Count
Scholastic, Inc. 978-0-545-65138-7 2013 24
Scholastic, Inc. 0-545-65138-7 2013 24
Scholastic, Inc. 978-0-545-65522-4 2013 24
Scholastic, Inc. 0-545-65522-6 2013 24
其中:后者的:
978-0-545-65522-4
或
0-545-65522-6
是搜不到的。
而前面的:
978-0-545-65138-7
或:
0-545-65138-7
是可以搜到的,比如:
Amazon.com: 9780545651387: Books
![](https://www.crifan.com/files/pic/uploads/2021/03/fd74d39641ca4ff4b84e0f271c2ce909.jpg)
转载请注明:在路上 » 【整理】绘本查询推荐系统 数据爬取 20181031