@serdnam/pino-cloudwatch-transport

Pino v7+ transport for sending logs to AWS CloudWatch Logs, built using pino-abstract-transport and the AWS SDK for JavaScript v3.

Install

npm i @serdnam/pino-cloudwatch-transport

Configuration

This transport expects the following options:

1export interface PinoCloudwatchTransportOptions { 
2  logGroupName: string,
3  logStreamName: string,
4  awsRegion?: string,
5  awsAccessKeyId?: string,
6  awsSecretAccessKey?: string,
7  interval?: number
8}

You may optionally pass in the awsRegion, awsAccessKeyId and awsSecretAccessKey options, otherwise, the AWS SDK client will pick up those parameters from the environment (as described in the AWS SDK for Javascript documentation).

The transport, upon initialization, will create the LogGroup and LogStream with the names logGroupName and logStreamName, respectively, if they don't already exist.

After initializing the transport will start receiving logs from Pino formatting them in the format expected by CloudWatch:

1{
2    timestamp: 1645381110905
3    message: '{"level":30,"time":1645381110905,"pid":320325,"hostname":"andres-latitudee7440","msg":"Hello, CloudWatch Logs!"}'
4}

The transport will use the time property of the received log as the timestamp if it finds it, otherwise, it will use Date.now().

The transport will store received logs in a buffer, and will flush them out to CloudWatch using a PutLogEvents call when one of the following conditions is met:

• The buffer has reached the size limit described in the AWS CloudWatch documentation.

• The number of logs in the buffer has reached the size limit of 10,000 logs as described in the AWS CloudWatch documentation.

• The transport has just received a log, and the last time a log has been stored before this one was longer than interval miliseconds.

Usage

After installing, you can use the transport as follows:

1import 'dotenv/config';
2import pino from "pino";
3
4const transport = pino.transport({
5    target: '@serdnam/pino-cloudwatch-transport',
6    options: {
7        logGroupName: 'pino-cloudwatch-test',
8        logStreamName: 'pino-cloudwatch-test-stream',
9        awsRegion: process.env.AWS_REGION,
10        awsAccessKeyId: process.env.AWS_ACCESS_KEY_ID,
11        awsSecretAccessKey: process.env.AWS_SECRET_ACCESS_KEY,
12        interval: 1_000, // this is the default
13    }
14});
15
16const logger = pino(transport);
17
18logger.info('Hello, CloudWatch Logs!');
19

With Fastify:

1import Fastify from 'fastify';
2import { request } from 'undici';
3import pino from 'pino';
4
5const transport = pino.transport({
6    target: '@serdnam/pino-cloudwatch-transport',
7    options: {
8        logGroupName: 'pino-cloudwatch-test',
9        logStreamName: 'pino-cloudwatch-test-stream',
10        awsRegion: process.env.AWS_REGION,
11        awsAccessKeyId: process.env.AWS_ACCESS_KEY_ID,
12        awsSecretAccessKey: process.env.AWS_SECRET_ACCESS_KEY
13    }
14});
15
16const logger = pino(transport);
17
18const server = Fastify({ logger });
19
20server.get('/', async function(req, reply){
21    req.log.info('Hello, CloudWatch Logs!');
22    return { message: 'OK' };
23});
24
25await server.listen(8888);
26
27await request('http://localhost:8888/');
28
29await server.close();
30

License

MIT