Evaluatory

Evaluatory is an open-source tool for website validation. It is mainly a wrapper around axe-core and html-validate, which test a website for accessibility and markup issues.

Evaluatory comes with some essential improvements:

• Run checks at multiple device breakpoints at the same time (e.g. mobile, tablet and desktop). Some accessibility issues appear only at a certain breakpoint.
• Emulate dark mode, disabled JavaScript, offline mode and more by using custom Playwright options.
• Return a visual HTML results page, including page screenshots.
• Support for sitemaps to check all referenced web pages at once.

This project uses a modular architecture, so in the long term it could become an alternative to tools like webhint.

Demo

Check out a demo results page at https://darekkay.com/evaluatory/demo/.

Modules

• base: Custom built-in checks.
• axe-core: Checks for accessibility issues using axe-core.
• html-validate: Validates the HTML using html-validate.
• screenshot: Takes a screenshot of the page.

Quickstart

Run evaluatory with default configuration for a single URL:

1npx evaluatory https://example.com

Installation

This tool requires Node.js version 12+.

Install globally:

1$ yarn add -g evaluatory     # Yarn
2$ npm install -g evaluatory  # Npm

Or install as a local dependency:

1$ yarn add evaluatory            # Yarn
2$ npm install --save evaluatory  # Npm

Or use without installing:

1$ npx evaluatory <url>

Usage

View program help:

1$ evaluatory --help
2Usage: evaluatory [url] [options]
3
4Arguments:
5  [url]  URL
6
7Options:
8  -c, --config       Configuration file path
9  -o, --output       Output folder
10  --color-scheme     Color scheme (light, dark, no-preference)
11  -m, --modules      Modules to execute (comma-separated)
12  --no-open-results  Don't open the results page after evaluation
13  --sitemap          Sitemap URL
14  --verbose          Verbose/debug mode
15  -h, --help         Show help
16  -v, --version      Show version number

Run default configuration for a single URL:

1$ evaluatory https://example.com

Run default configuration for all URLs within a sitemap:

1$ evaluatory --sitemap https://example.com/sitemap.xml

Provide a custom configuration:

1$ evaluatory -c config.json

Configuration

The configuration is a valid JSON5 file. See config.example.json5 for an example and config.default.js for available options (with defaults).

License

This project and its contents are open source under the MIT license.