Skip to content

Job Queue that fetches HTML requests from a specified url

Notifications You must be signed in to change notification settings

agrippanux/JobQueue

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

JobQueue

Job Queue that fetches HTML requests from a specified url

##Fire it up

  1. Install packages: $ npm install
  2. Run redis server using: $ src/redis-server
  3. Run express server: $ node index.js
  4. Run a cURL command to API with url to scrape(ex:google): $ curl -i -X GET 'http://localhost:3000/?url="http://www.google.com/"'
    • note the job id returned from call
  5. Run another cURL command using the job id from first call: $ curl -i -X GET 'http://localhost:3000/?id=(insert job id here)'

About

Job Queue that fetches HTML requests from a specified url

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • JavaScript 100.0%