Skip to content

Latest commit

 

History

History
27 lines (22 loc) · 447 Bytes

README.md

File metadata and controls

27 lines (22 loc) · 447 Bytes

A crawler based on Scrapy used to crawl App's information in Google Play

Results include information below:

  • Url
  • App'ID
  • Score
  • Publish Date
  • File Size
  • Number of Downloads
  • Software Version
  • Pperating Systems
  • Content Rating
  • Thumbs
  • Icon
  • Description
  • Reviews(include author, date, content and rating)
  • Permissions

Requirements:

  • MongoDB 3.4
  • Python 2.7
  • Scrapy 1.3

Usage:

shell command: scrapy crawl google