npmpackage.info

Gathering detailed insights and metrics for evalite

Other packages similar to evalite

@evalite/core

0.6.1

@antoniel/evalite

0.8.6

Test your LLM-powered apps with a TypeScript-native, Vitest-based eval runner. No API key required.

@antoniel/evalite-core

0.6.1

evalite

Test your LLM-powered apps with TypeScript. No API key required.

0.9.1

482

TypeScript

8.68 kB

41,020

Installations

npm install evalite

Developer Guide

BETA

Typescript

Yes

Module System

ESM

Node Version

22.13.1

NPM Version

10.9.2 Score

49.9

Supply Chain

78.3

Quality

Maintenance

100

Vulnerability

97.6

License

Pull Requests

Open

2

Total

60

Closed

4

Merged

54

Issues

Open

29

Total

60

Closed

31

Releases

evalite@0.9.1

Updated on Feb 24, 2025

evalite@0.8.4

Updated on Feb 05, 2025

evalite@0.8.3

Updated on Jan 29, 2025

evalite@0.8.2

Updated on Jan 01, 2025

@evalite/core@0.6.1

Updated on Jan 01, 2025

@evalite/core@0.6.0

Updated on Dec 30, 2024

View All 43 releases

Contributors

View All 8 Contributors

Languages

TypeScript

MDX

JavaScript

CSS

HTML

TypeScript (90.08%)

MDX (7.42%)

JavaScript (1.35%)

CSS (0.89%)

HTML (0.26%)

validate.email 🚀

Verify real, reachable, and deliverable emails with instant MX records, SMTP checks, and disposable email detection.

Developer

mattpocock

Download Statistics

Total Downloads

41,020

Last Day

459

Last Week

2,091

Last Month

13,472

Last Year

41,020

GitHub Statistics

482 Stars

399 Commits

18 Forks

13 Watchers

19 Branches

8 Contributors

Updated on Mar 12, 2025

Bundle Size

29.19 kB

Minified

8.68 kB

Minified + Gzipped

Bundlephobia

Maintainers

Package Meta Information

Latest Version

0.9.1

Package Id

evalite@0.9.1

Unpacked Size

93.05 kB

Size

22.30 kB

File Count

NPM Version

10.9.2

Node Version

22.13.1

Published on

Feb 24, 2025

Total Downloads

Cumulative downloads

Total Downloads

41,020

Last Day

40.8%

459

Compared to previous day

Last Week

-14.4%

2,091

Compared to previous week

Last Month

-34.5%

13,472

Compared to previous month

Last Year

41,020

Compared to previous year

Daily Downloads

Weekly Downloads

Monthly Downloads

Yearly Downloads

Dependencies

@stricli/auto-complete @stricli/core @vitest/runner file-type table tinyrainbow @evalite/core

Dev Dependencies

@types/ws ai autoevals unstorage

Evalite: the TypeScript-native, local-first tool for testing LLM-powered apps.

What Is Evalite?

Fully open source: No API Key required.
Local-first: runs on your machine, your data never leaves your laptop.
Based on Vitest, the best TypeScript test runner around.
Terminal UI for quick prototyping.
Supports tracing and custom scorers.

How Do I Learn More?

Evalite Is Experimental

Evalite is still an experimental project. I'm actively working on it, and for now am pushing breaking changes.

If you run into any unexpected behavior:

Delete the node_modules/.evalite folder.
Update evalite to the latest version.
Rerun your evals.

If, after that, you run into unexpected behavior, report an issue.

Guides

Watch Mode

You can run Evalite in watch mode by running evalite watch:

1evalite watch

This will watch for changes to your .eval.ts files and re-run the evals when they change.

[!IMPORTANT]

I strongly recommend implementing a caching layer in your LLM calls when using watch mode. This will keep your evals running fast and avoid burning through your API credits.

Running Specific Files

You can run specific files by passing them as arguments:

1evalite my-eval.eval.ts

This also works for watch mode:

1evalite watch my-eval.eval.ts

No vulnerabilities found.

No security vulnerabilities found.