npmpackage.info

Gathering detailed insights and metrics for token-types

Other packages similar to token-types

@types/token-stream

1.0.3

TypeScript definitions for token-stream

@types/registry-auth-token

5.0.1

Stub TypeScript definitions entry for registry-auth-token, which provides its own types definitions

@tokens-studio/types

0.5.2

![NPM version badge](https://img.shields.io/npm/v/@tokens-studio/types) ![License badge](https://img.shields.io/github/license/tokens-studio/types)

@terrazzo/token-tools

0.10.0

Various utilities for token types

Gathering detailed insights and metrics for token-types

token-types - 6.0.3 | npmpackage.info

token-types

A primitive token library used to read from, and to write a node Buffer

6.0.3

MIT

TypeScript

22.64 kB

654,398,803 4.5

Installations

npm install token-types

Developer Guide

BETA

Typescript

Yes

Module System

ESM

Min. Node Version

>=14.16

Node Version

22.17.0

NPM Version

10.9.2 Score

99.4

Supply Chain

Quality

88.4

Maintenance

100

Vulnerability

100

License

Pull Requests

Open

3

Total

712

Closed

413

Merged

296

Issues

Open

0

Total

18

Closed

18

Releases

v6.0.3

Updated on Jun 29, 2025

v6.0.2

Updated on Jun 29, 2025

v6.0.1

Updated on Jun 28, 2025

v6.0.0

Updated on Jul 04, 2024

v5.0.1

Updated on Aug 02, 2022

v4.2.1

Updated on Aug 02, 2022

View All 34 releases

Languages

TypeScript

TypeScript (100%)

Developer

Borewit

Download Statistics

Total Downloads

654,398,803

Last Day

435,590

Last Week

7,895,862

Last Month

32,429,964

Last Year

272,502,351

GitHub Statistics

MIT License

11 Stars

681 Commits

9 Forks

2 Watchers

6 Branches

5 Contributors

Updated on Jun 29, 2025

Sponsor this package

https://github.com/sponsors/Borewit

Maintainers

View All 5 Contributors

Package Meta Information

Latest Version

6.0.3

Package Id

token-types@6.0.3

Unpacked Size

22.64 kB

Size

5.32 kB

File Count

NPM Version

10.9.2

Node Version

22.17.0

Published on

Jun 29, 2025

Total Downloads

Cumulative downloads

Total Downloads

654,398,803

Dependencies

@tokenizer/token ieee754

Dev Dependencies

@biomejs/biome @types/chai @types/mocha @types/node c8 chai del-cli mocha remark-cli remark-preset-lint-recommended source-map-support ts-node typescript

token-types

A primitive token library used to read and write from a Uint8Array. Although it is possible to use this module directly, it is primarily designed to be used with strtok3 tokenizer.

Compatibility

Module: version 5 migrated from CommonJS to pure ECMAScript Module (ESM). JavaScript is compliant with ECMAScript 2019 (ES10).

Installation

1npm install --save token-types

Usually in combination with strtok3:

1npm install --save strtok3

Using TypeScript you should also install @tokenizer/token as a development dependency:

1npm install --save-dev @tokenizer/token

Example

1import * as strtok3 from 'strtok3';
2import * as token from 'token-types';
3
4(async () => {
5
6  const tokenizer = await strtok3.fromFile("somefile.bin");
7  try {
8    const myNumber = await tokenizer.readToken(token.Float32_BE);
9    console.log(`My number: ${myNumber}`);
10  } finally {
11    tokenizer.close(); // Close the file
12  }
13})();

Tokens

Numeric tokens

token-types supports a wide variety of numeric tokens out of the box:

Token	Number	Bits	Endianness
`UINT8`	Unsigned integer	8	n/a
`UINT16_BE`	Unsigned integer	16	big endian
`UINT16_LE`	Unsigned integer	16	little endian
`UINT24_BE`	Unsigned integer	24	big endian
`UINT24_LE`	Unsigned integer	24	little endian
`UINT32_BE`	Unsigned integer	32	big endian
`UINT32_LE`	Unsigned integer	32	little endian
`UINT64_BE`	Unsigned integer	64	big endian
`UINT64_LE`*	Unsigned integer	64	little endian
`INT8`	Signed integer	8	n/a
`INT16_BE`	Signed integer	16	big endian
`INT16_LE`	Signed integer	16	little endian
`INT24_BE`	Signed integer	24	big endian
`INT24_LE`	Signed integer	24	little endian
`INT32_BE`	Signed integer	32	big endian
`INT32_LE`	Signed integer	32	little endian
`INT64_BE`	Signed integer	64	big endian
`INT64_LE`*	Signed integer	64	little endian
`Float16_BE`	IEEE 754 float	16	big endian
`Float16_LE`	IEEE 754 float	16	little endian
`Float32_BE`	IEEE 754 float	32	big endian
`Float32_LE`	IEEE 754 float	32	little endian
`Float64_BE`	IEEE 754 float	64	big endian
`Float64_LE`	IEEE 754 float	64	little endian
`Float80_BE`*	IEEE 754 float	80	big endian
`Float80_LE`*	IEEE 754 float	80	little endian

(*) The tokens exceed the JavaScript IEEE 754 64-bit Floating Point precision, decoding and encoding is best effort based.

String tokens

StringType decoding is implemented using TextDecoder, it has build-in support for Windows-1252 decoding.

Check out the MDN web docs for the TextDecoder for a complete list

Custom tokens

Custom tokens can be added, suitable for reading binary files or network messages:

1  ExtendedHeader = {
2    len: 10,
3
4    get: (buf, off) => {
5      return {
6        // Extended header size
7        size: Token.UINT32_BE.get(buf, off),
8        // Extended Flags
9        extendedFlags: Token.UINT16_BE.get(buf, off + 4),
10        // Size of padding
11        sizeOfPadding: Token.UINT32_BE.get(buf, off + 6),
12        // CRC data present
13        crcDataPresent: common.strtokBITSET.get(buf, off + 4, 31)
14      };
15    }
16  };

Licence

This project is licensed under the MIT License. Feel free to use, modify, and distribute as needed.

No vulnerabilities found.

10

Binary-Artifacts

Determines if the project has generated executable (binary) artifacts in the source repository.

10

Dangerous-Workflow

Determines if the project's GitHub Action workflows avoid dangerous patterns.

10

Maintained

Determines if the project is "actively maintained".

10

License

Determines if the project has defined a license.

7

SAST

Determines if the project uses static code analysis.

7

Vulnerabilities

Determines if the project has open, known unfixed vulnerabilities.

0

Code-Review

Determines if the project requires human code review before pull requests (aka merge requests) are merged.

0

Token-Permissions

Determines if the project's workflows follow the principle of least privilege.

0

Pinned-Dependencies

Determines if the project has declared and pinned the dependencies of its build process.

Reason

dependency not pinned by hash detected -- score normalized to 0

Details

Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/codeql.yml:27: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/codeql.yml/master?enable=pin
Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/codeql.yml:30: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/codeql.yml/master?enable=pin
Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/codeql.yml:36: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/codeql.yml/master?enable=pin
Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/codeql.yml:39: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/codeql.yml/master?enable=pin
Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/nodejs-ci.yml:15: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/nodejs-ci.yml/master?enable=pin
Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/nodejs-ci.yml:18: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/nodejs-ci.yml/master?enable=pin
Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/nodejs-ci.yml:35: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/nodejs-ci.yml/master?enable=pin
Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/nodejs-ci.yml:55: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/nodejs-ci.yml/master?enable=pin
Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/nodejs-ci.yml:58: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/nodejs-ci.yml/master?enable=pin
Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/nodejs-ci.yml:69: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/nodejs-ci.yml/master?enable=pin
Warn: third-party GitHubAction not pinned by hash: .github/workflows/nodejs-ci.yml:77: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/nodejs-ci.yml/master?enable=pin
Warn: third-party GitHubAction not pinned by hash: .github/workflows/nodejs-ci.yml:89: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/nodejs-ci.yml/master?enable=pin
Warn: third-party GitHubAction not pinned by hash: .github/workflows/post-dependabot-prs.yml:10: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/post-dependabot-prs.yml/master?enable=pin
Warn: third-party GitHubAction not pinned by hash: .github/workflows/post-dependabot-prs.yml:14: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/post-dependabot-prs.yml/master?enable=pin
Warn: third-party GitHubAction not pinned by hash: .github/workflows/post-dependabot-prs.yml:19: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/post-dependabot-prs.yml/master?enable=pin
Warn: third-party GitHubAction not pinned by hash: .github/workflows/release-drafter.yml:20: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/release-drafter.yml/master?enable=pin
Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/update-license.yml:14: update your workflow using https://app.stepsecurity.io/secureworkflow/Borewit/token-types/update-license.yml/master?enable=pin
Info: 0 out of 11 GitHub-owned GitHubAction dependencies pinned
Info: 0 out of 6 third-party GitHubAction dependencies pinned

0

CII-Best-Practices

Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.

0

Fuzzing

Determines if the project uses fuzzing.

0

Branch-Protection

Determines if the default and release branches are protected with GitHub's branch protection settings.

0

Security-Policy

Determines if the project has published a security policy.

Score

4.5

/10

Last Scanned on 2025-06-30

The Open Source Security Foundation is a cross-industry collaboration to improve the security of open source software (OSS). The Scorecard provides security health metrics for open source projects.

Learn More

Other packages similar to token-types

Other packages similar to token-types

token-types

Installations

Developer Guide

Yes

ESM

>=14.16

22.17.0

10.9.2

Score

Pull Requests

3

712

413

296

Issues

0

18

18

Releases

Languages

Developer

Borewit

Download Statistics

GitHub Statistics

Sponsor this package

Maintainers

Package Meta Information

Total Downloads

654,398,803

Dependencies

Dev Dependencies

token-types

Compatibility

Installation

Example

Tokens

Numeric tokens

String tokens

Custom tokens

Licence

10

10

10

10

7

7

0

0

0

0

0

0

0

4.5

/10

Weekly Downloads

Monthly Downloads

Yearly Downloads