npmpackage.info

Gathering detailed insights and metrics for generate-robotstxt

Other packages similar to generate-robotstxt

robotstxt-webpack-plugin

8.0.0

A webpack plugin to output a robots.txt file

env-robotstxt

1.0.4

generate robots.txt based on env content for static websites

astro-robots-txt

1.0.0

Generate a robots.txt for Astro

eleventy-plugin-robotstxt

1.0.0

An Eleventy plugin to generate a robots.txt file for your static site

Gathering detailed insights and metrics for generate-robotstxt

generate-robotstxt - 8.0.3 | npmpackage.info

generate-robotstxt

Generator robots.txt for node js

8.0.3

MIT

JavaScript

1.7

Installations

npm install generate-robotstxt

Developer Guide

BETA

Typescript

No

Module System

CommonJS

Min. Node Version

>= 10.13.0

Node Version

10.15.2

NPM Version

6.14.5 Pull Requests

Open

16

Total

138

Closed

64

Merged

58

Issues

Open

2

Total

13

Closed

11

Releases

v8.0.3

Updated on May 12, 2020

v8.0.2

Updated on Mar 24, 2020

v8.0.1

Updated on Feb 19, 2020

v8.0.0

Updated on Nov 05, 2019

v7.1.0

Updated on Jul 03, 2019

v7.0.0

Updated on Jul 03, 2019

View All 21 releases

Languages

JavaScript

JavaScript (100%)

Developer

itgalaxy

Download Statistics

Total Downloads

Last Day

Last Week

Last Month

Last Year

GitHub Statistics

MIT License

65 Stars

173 Commits

8 Forks

5 Watchers

17 Branches

4 Contributors

Updated on Jul 01, 2025

Maintainers

View All 4 Contributors

Package Meta Information

Latest Version

8.0.3

Package Id

generate-robotstxt@8.0.3

Size

6.00 kB

NPM Version

6.14.5

Node Version

10.15.2

Published on

May 12, 2020

Total Downloads

Cumulative downloads

Total Downloads

NaN

Last Day

NaN

Compared to previous day

Last Week

NaN

Compared to previous week

Last Month

NaN

Compared to previous month

Last Year

NaN

Compared to previous year

Weekly Downloads

Monthly Downloads

Yearly Downloads

generate-robotstxt

Awesome generator robots.txt.

Installation

1npm install --save-dev generate-robotstxt

Usage

1import robotstxt from "generate-robotstxt";
2
3robotstxt({
4  policy: [
5    {
6      userAgent: "Googlebot",
7      allow: "/",
8      disallow: "/search",
9      crawlDelay: 2,
10    },
11    {
12      userAgent: "OtherBot",
13      allow: ["/allow-for-all-bots", "/allow-only-for-other-bot"],
14      disallow: ["/admin", "/login"],
15      crawlDelay: 2,
16    },
17    {
18      userAgent: "*",
19      allow: "/",
20      disallow: "/search",
21      crawlDelay: 10,
22      cleanParam: "ref /articles/",
23    },
24  ],
25  sitemap: "http://example.com/sitemap.xml",
26  host: "http://example.com",
27})
28  .then((content) => {
29    console.log(content);
30
31    return content;
32  })
33  .catch((error) => {
34    throw error;
35  });

File based configuration

robots-txt.config.js

1module.exports = {
2  policy: [
3    {
4      userAgent: "Googlebot",
5      allow: "/",
6      disallow: ["/search"],
7      crawlDelay: 2,
8    },
9    {
10      userAgent: "OtherBot",
11      allow: ["/allow-for-all-bots", "/allow-only-for-other-bot"],
12      disallow: ["/admin", "/login"],
13      crawlDelay: 2,
14    },
15    {
16      userAgent: "*",
17      allow: "/",
18      disallow: "/search",
19      crawlDelay: 10,
20      cleanParam: "ref /articles/",
21    },
22  ],
23  sitemap: "http://example.com/sitemap.xml",
24  host: "http://example.com",
25};

CLI

1Awesome generator robots.txt
2
3  Usage generate-robotstxt [options] <dest>
4
5  Options:
6     --config  Path to a specific configuration file.

Contribution

Feel free to push your code if you agree with publishing under the MIT license.

Changelog

License

No vulnerabilities found.

10

Binary-Artifacts

Determines if the project has generated executable (binary) artifacts in the source repository.

10

License

Determines if the project has defined a license.

0

Maintained

Determines if the project is "actively maintained".

0

Code-Review

Determines if the project requires human code review before pull requests (aka merge requests) are merged.

0

CII-Best-Practices

Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.

0

Security-Policy

Determines if the project has published a security policy.

0

Fuzzing

Determines if the project uses fuzzing.

0

Branch-Protection

Determines if the default and release branches are protected with GitHub's branch protection settings.

0

SAST

Determines if the project uses static code analysis.

0

Vulnerabilities

Determines if the project has open, known unfixed vulnerabilities.

Reason

45 existing vulnerabilities detected

Details

Warn: Project is vulnerable to: GHSA-968p-4wvh-cqc8
Warn: Project is vulnerable to: GHSA-67hx-6x53-jw92
Warn: Project is vulnerable to: GHSA-v88g-cgmw-v5xw
Warn: Project is vulnerable to: GHSA-93q8-gq69-wqmw
Warn: Project is vulnerable to: GHSA-v6h2-p8h4-qcjw
Warn: Project is vulnerable to: GHSA-grv7-fg5c-xmjg
Warn: Project is vulnerable to: GHSA-w8qv-6jwh-64r5
Warn: Project is vulnerable to: GHSA-3xgq-45jj-v275
Warn: Project is vulnerable to: GHSA-gxpj-cx7g-858c
Warn: Project is vulnerable to: GHSA-w573-4hg7-7wgq
Warn: Project is vulnerable to: GHSA-ff7x-qrg7-qggm
Warn: Project is vulnerable to: GHSA-ww39-953v-wcq6
Warn: Project is vulnerable to: GHSA-765h-qjxv-5f44
Warn: Project is vulnerable to: GHSA-f2jv-r9rf-7988
Warn: Project is vulnerable to: GHSA-43f8-2h32-f4cj
Warn: Project is vulnerable to: GHSA-qqgx-2p2h-9c37
Warn: Project is vulnerable to: GHSA-896r-f27r-55mw
Warn: Project is vulnerable to: GHSA-9c47-m6qq-7p4h
Warn: Project is vulnerable to: GHSA-p6mc-m468-83gw
Warn: Project is vulnerable to: GHSA-29mw-wpgm-hmr9
Warn: Project is vulnerable to: GHSA-35jh-r3h4-6jhm
Warn: Project is vulnerable to: GHSA-952p-6rrq-rcjv
Warn: Project is vulnerable to: GHSA-f8q6-p94x-37v3
Warn: Project is vulnerable to: GHSA-xvch-5gv4-984h
Warn: Project is vulnerable to: GHSA-5fw9-fq32-wv5p
Warn: Project is vulnerable to: GHSA-hj48-42vr-x3v9
Warn: Project is vulnerable to: GHSA-hrpp-h998-j3pp
Warn: Project is vulnerable to: GHSA-p8p7-x288-28g6
Warn: Project is vulnerable to: GHSA-c2qf-rxjj-qqgw
Warn: Project is vulnerable to: GHSA-44c6-4v22-4mhx
Warn: Project is vulnerable to: GHSA-4x5v-gmq8-25ch
Warn: Project is vulnerable to: GHSA-g4rg-993r-mgx7
Warn: Project is vulnerable to: GHSA-4rq4-32rv-6wp6
Warn: Project is vulnerable to: GHSA-64g7-mvw6-v9qj
Warn: Project is vulnerable to: GHSA-7xcx-6wjh-7xp2
Warn: Project is vulnerable to: GHSA-jgrx-mgxx-jf9v
Warn: Project is vulnerable to: GHSA-72xf-g2v4-qvf3
Warn: Project is vulnerable to: GHSA-w5p7-h5w8-2hfq
Warn: Project is vulnerable to: GHSA-7p7h-4mm5-852v
Warn: Project is vulnerable to: GHSA-38fc-wpqx-33j7
Warn: Project is vulnerable to: GHSA-j8xg-fqg3-53r7
Warn: Project is vulnerable to: GHSA-6fc8-4gx4-v693
Warn: Project is vulnerable to: GHSA-3h5v-q93c-6h6q
Warn: Project is vulnerable to: GHSA-c4w7-xm78-47vh
Warn: Project is vulnerable to: GHSA-p9pc-299p-vxgp

Score

1.7

/10

Last Scanned on 2025-07-07

The Open Source Security Foundation is a cross-industry collaboration to improve the security of open source software (OSS). The Scorecard provides security health metrics for open source projects.

Learn More

Other packages similar to generate-robotstxt

Other packages similar to generate-robotstxt

generate-robotstxt

Installations

Developer Guide

No

CommonJS

>= 10.13.0

10.15.2

6.14.5

Pull Requests

16

138

64

58

Issues

2

13

11

Releases

Languages

Developer

itgalaxy

Download Statistics

GitHub Statistics

Maintainers

Package Meta Information

Total Downloads

NaN

Weekly Downloads

Monthly Downloads

Yearly Downloads

Dependencies

Dev Dependencies

generate-robotstxt

Installation

Usage

File based configuration

CLI

Contribution

Changelog

License

10

10

0

0

0

0

0

0

0

0

1.7

/10