Gathering detailed insights and metrics for Crawler
Gathering detailed insights and metrics for Crawler
Installations
npm install CrawlerDeveloper Guide
BETA
Typescript
No
Module System
CommonJS
Node Version
5.4.1
NPM Version
3.3.12
Score
62.1
Supply Chain
67.1
Quality
70.5
Maintenance
25
Vulnerability
96.8
License
Releases
Unable to fetch releases
Languages
1
JavaScript
JavaScript (100%)
Developer
ryu047
Download Statistics
Total Downloads
0
Last Day
0
Last Week
0
Last Month
0
Last Year
0
GitHub Statistics
MIT License
2 Stars
18 Commits
1 Watchers
1 Branches
1 Contributors
Updated on Jul 13, 2019
Maintainers
1
Package Meta Information
Latest Version
1.1.3
Package Id
Crawler@1.1.3
Size
3.07 kB
NPM Version
3.3.12
Node Version
5.4.1
Total Downloads
Cumulative downloads
Total Downloads
NaN
Last Day
0%
NaN
Compared to previous day
Last Week
0%
NaN
Compared to previous week
Last Month
0%
NaN
Compared to previous month
Last Year
0%
NaN
Compared to previous year
Weekly Downloads
Monthly Downloads
Yearly Downloads
Crawler
Search anything on Web.
Crawler is simple NodeJS based web crawler that crawls a website within seconds.
Quick start
- Clone the repo and
cd path_to_directory npm install.npm start search_term.
Installation
npm install Crawler
Usage
1var Crawler = require('Crawler'); 2var c = new Crawler({ 3 address: 'http://www.example.com', 4 term: 'example' 5}); 6c.start();
Configuration Options
To configure Crawler, provide following options to the crawler object.
- address: This is the website to be crawled.
http://www.quora.comis currently passed in default main.js in the repo. - term: Term to be searched on the website. Provided as a command line argument if using default main.js.
- maxPages: This is the maximum number of pages of the website that will be crawled. 100 is set by default.
- maxConcurrency: This is maximum number of requests can be sent at any given time. 5 is set by default.
Ouput
- All the links where search_term is found are compiled in a HTML file at the end of the crawling.
- Console outputs links as they are crawled.
No vulnerabilities found.
Reason
no binaries found in the repo
Reason
0 existing vulnerabilities detected
Reason
license file detected
Details
- Info: project has a license file: LICENSE:0
- Info: FSF or OSI recognized license: MIT License: LICENSE:0
Reason
0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0
Reason
Found 0/18 approved changesets -- score normalized to 0
Reason
no SAST tool detected
Details
- Warn: no pull requests merged into dev branch
Reason
no effort to earn an OpenSSF best practices badge detected
Reason
project is not fuzzed
Details
- Warn: no fuzzer integrations found
Reason
security policy file not detected
Details
- Warn: no security policy file detected
- Warn: no security file to analyze
- Warn: no security file to analyze
- Warn: no security file to analyze
Reason
branch protection not enabled on development/release branches
Details
- Warn: branch protection not enabled for branch 'master'
Score
3
/10
Last Scanned on 2025-07-07
The Open Source Security Foundation is a cross-industry collaboration to improve the security of open source software (OSS). The Scorecard provides security health metrics for open source projects.
Learn More