Library to retrieve meta data (title, favicon address etc) from a url

Install

1$ npm install --save url-info-scraper

Usage

1var urlInfoScraper = require('url-info-scraper');
2
3urlInfoScraper('http://en.wikipedia.org/wiki/Wikipedia', function(error, linkInfo) {
4  var title = linkInfo.title; //'Wikipedia - Wikipedia, the free encyclopedia'
5});

The response is an object with the following properties:

1{
2  isWebResource: boolean, //true if the link is valid
3  title: string, //title of the page requested
4  mime: string, //content-type header of the page e.g. image/jpeg
5  parsable: boolean, //false if the content type is 'application'
6  tooLarge: boolean, //true if the link body is greater than 5MB
7  faviconUrl: string //the url of the favicon for the root site, null if not found
8}

Todo

• Rewrite tests to use mocked resources instead of real urls
• "Best image" support
• Store additional metadata (response time etc.)
• Screenshots
• ...?

License

MIT © Paul Cleary