Gathering detailed insights and metrics for aws-kinesis-agg
Gathering detailed insights and metrics for aws-kinesis-agg
Gathering detailed insights and metrics for aws-kinesis-agg
Gathering detailed insights and metrics for aws-kinesis-agg
@aws-sdk/client-kinesis
AWS SDK for JavaScript Kinesis Client for Node.js, Browser and React Native
kinesis-local
A Mock API for AWS Kinesis
@aws-sdk/client-kinesis-video
AWS SDK for JavaScript Kinesis Video Client for Node.js, Browser and React Native
@aws-sdk/client-kinesis-video-archived-media
AWS SDK for JavaScript Kinesis Video Archived Media Client for Node.js, Browser and React Native
npm install aws-kinesis-agg
54.9
Supply Chain
100
Quality
74.4
Maintenance
25
Vulnerability
99.6
License
Module System
Min. Node Version
Typescript Support
Node Version
NPM Version
378 Stars
400 Commits
153 Forks
70 Watching
6 Branches
88 Contributors
Updated on 14 Oct 2024
Minified
Minified + Gzipped
Java (53.2%)
Python (26.94%)
JavaScript (13.84%)
Go (5.91%)
Shell (0.11%)
Cumulative downloads
Total Downloads
Last day
-5.6%
3,131
Compared to previous day
Last week
11.7%
19,238
Compared to previous week
Last month
6.3%
75,622
Compared to previous month
Last year
2.4%
1,109,695
Compared to previous year
[!CAUTION] ⚠️ DO NOT use Kinesis Aggregation module for use cases where data loss of small number of messages is critical. DATA LOSS CAN OCCUR.
If you use Kinesis Aggregation module outside of Kinesis Producer Library (KPL), you should use it only for low-value messages where loss of a small number of messages is not critical. Aggregation results in messages being tagged to Shards, and in cases where the Stream is mutating during Aggregation, this can result in messages being rejected by the PutRecords API. Kinesis Deaggregation is compatible with all KPL published data and can be used safely.
The Amazon Kinesis Producer Library (KPL) gives you the ability to write data to Amazon Kinesis with a highly efficient, asyncronous delivery model that can improve performance. The KPL is extremely powerful, but is currently only available as a Java API wrapper around a C++ executable which may not be suitable for all deployment environments. Similarly, the Kinesis Client Library (KCL) provides automatic deaggregation of KPL aggregated records, but not all Kinesis consumer applications, such as those running on AWS Lambda, are currently capable of leveraging this deaggregation capability.
How the Kinesis Producer Library Publishes Data
The components in this project give you the ability to process and create KPL compatible serialised data within AWS Lambda, in Java, Node.js and Python. These components can also be used as part of the Kinesis Client Library a multi-lang KCL application. However, this project has several limitations:
One of the main advantages of the KPL is its ability to use record aggregation to increase payload size and improve throughput. While this project is not a replacement for the full KPL, it does provide you the ability to easily aggregate multiple user records into larger aggregated records that make more efficient use of available bandwidth and reduce cost. This data is encoded using Google Protocol Buffers, and returned to the calling function for subsequent use. You can then publish to Kinesis and the data is compatible with consumers using the KCL or these Deaggregation modules.
The components in this library allow you to efficiently deaggregate protocol buffer encoded aggregated records in any application, including AWS Lambda.
AWS Lambda supports Java, Node.js, Python and Go as programming languages. We have included support for those languages so that you can create and process UserRecords via standalone modules. Documentation is provided for each language:
Language | Location |
---|---|
Java | java |
Node.js Javascript | node.js |
Python | python |
Go | go |
Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
No vulnerabilities found.
Reason
license file detected
Details
Reason
security policy file detected
Details
Reason
3 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 2
Reason
Found 0/10 approved changesets -- score normalized to 0
Reason
no effort to earn an OpenSSF best practices badge detected
Reason
project is not fuzzed
Details
Reason
binaries present in source code
Details
Reason
Project has not signed or included provenance with any releases.
Details
Reason
branch protection not enabled on development/release branches
Details
Reason
SAST tool is not run on all commits -- score normalized to 0
Details
Reason
78 existing vulnerabilities detected
Details
Score
Last Scanned on 2024-11-25
The Open Source Security Foundation is a cross-industry collaboration to improve the security of open source software (OSS). The Scorecard provides security health metrics for open source projects.
Learn More