Skip to content

This script checks the Mazda website to check for new cars added to the list of user manuals.

Notifications You must be signed in to change notification settings

tcBorek2002/mazda-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

56 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Mazda-scraper

This script checks the Mazda website to check for new cars added to the list of user manuals.

To run:

Make sure to have npm installed on your pc. Go to the config.js file. Change the EmailConfig class to contain your email address, the (app specific) email password and email service. In case of using gmail: enter your email address and create an app specific password. Enter this password and use: gmail as the service. Instead of hardcoding you can also use env variables as already implemented in the code. For more information on the emailing take a look at nodemailer. Then run the following commands:

  • npm install
  • npm start

Some specifics:

After the web-scraping the script will send an email to let the user know the latest information. The email will be sent from and to the email address noted in the config file. This is to lower the chance of the emailing service blocking this service. Personally I run the script using GitHub Actions. Right now the script will check the websites: Mazda UK, DE and NL. In case the amount of cars changes on one of those lists the title of the email will show this. In case one of the lists contains the number 60 (from Mazda CX-60) the title of the email will change to indicate this.
The script makes use of the following two npm packages: nightmarejs for doing the web-scraping. Nodemailer for sending emails.

Note: older commits contained my personal gmail app specific password. Don't worry, this password is not in use anymore.

About

This script checks the Mazda website to check for new cars added to the list of user manuals.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published