Gathering detailed insights and metrics for @amazon-codecatalyst/blueprints.gen-ai-chatbot
Gathering detailed insights and metrics for @amazon-codecatalyst/blueprints.gen-ai-chatbot
Installations
npm install @amazon-codecatalyst/blueprints.gen-ai-chatbotDeveloper Guide
BETA
Typescript
Yes
Module System
CommonJS
Node Version
18.20.5
NPM Version
6.14.13
Releases
Unable to fetch releases
Download Statistics
Total Downloads
0
Last Day
0
Last Week
0
Last Month
0
Last Year
0
Maintainers
3
Package Meta Information
Latest Version
0.4.18
Package Id
@amazon-codecatalyst/blueprints.gen-ai-chatbot@0.4.18
Unpacked Size
41.75 MB
Size
14.01 MB
File Count
856
NPM Version
6.14.13
Node Version
18.20.5
Published on
Jan 07, 2025
Total Downloads
Cumulative downloads
Total Downloads
NaN
Last Day
0%
NaN
Compared to previous day
Last Week
0%
NaN
Compared to previous week
Last Month
0%
NaN
Compared to previous month
Last Year
0%
NaN
Compared to previous year
Weekly Downloads
Monthly Downloads
Yearly Downloads
Dependencies
8
Dev Dependencies
14
@amazon-codecatalyst/blueprint-util.cli@amazon-codecatalyst/blueprint-util.projen-blueprint@types/node@typescript-eslint/eslint-plugin@typescript-eslint/parsereslinteslint-import-resolver-nodeeslint-import-resolver-typescripteslint-plugin-importnpm-check-updatesprojenstandard-versionts-nodetypescript
Bedrock GenAI chatbot
This blueprint allows you to build, customize, and manage a chatbot using Anthropic’s LLM Claude, a model provided by Amazon Bedrock for generative AI. The chatbot supports multiple languages, content formats, conversation capabilities, and ability to monitor usage. You can set necessary permissions with IAM roles for a secure and login-protected LLM playground that can be customized to your data.
Bot conversation and bot personalization
You can personalize your chatbot through custom instructions and external knowledge that can be provided through URLs or files (for example, retrieval-augmented generation (RAG)). When a chatbot is created or updated, it pulls and breaks down data into text, and uses Cohere Multilingual to find and match the text to provide responses to user questions. The customized bot can be shared among application users.
Features
With this blueprint, you can modify your chatbot capabilities using chat features, customization capabilities, personal data, and usage tracking. The features besides IP address restriction are made available by default.
Basic chat features
- Authentication (Sign-up, Sign-in)
- Creation, storage, and deletion of conversations
- Copying of chatbot replies
- Automatic subject suggestion for conversations
- Syntax highlighting for code
- Rendering of Markdown
- Streaming Response
- IP address restriction (not available by default)
- Edit message and resend
- I18n
- Model switch (Claude Instant / Claude)
Customized bot featuers
- Customized bot creation
- Customized bot sharing
Retrieval-augmented generation (RAG) features
- Web (html)
- Text data (txt, csv, markdown and etc)
- Microsoft office files (pptx, docx, xlsx)
- Youtube transcript
Admin features
- Admin console to analyze user usage
Supported languages
The following languages are supported for a custom chatbot:
- English
- Japanese (日本語)
- Korean (한국어)
- Chinese (中文)
- Français
- Deutsch
- Español
Deployment
After building your chatbot, you can also deploy it with this blueprint. Before a chatbot can be deployed with a CodeCatalyst workflow, you must enable model access.
To enable model access a chatbot
- Navigate to the AWS Management Console.
- From the region dropdown menu, choose the region where Amazon Bedrock will be called. This should be the same deployment region you choose under Additional configurations when creating a project in Amazon CodeCatalyst with the Bedrock GenAI chatbot blueprint.
- Navigate to Amazon Bedrock access.
- Choose Manage model access.
- Choose the checkboxes for
Anthropic / Claude 3 Haiku,Anthropic / Claude 3 SonnetandCohere / Embed Multilingual. - Choose Request model access.
Architecture
The architecture of this blueprint leverages AWS-managed services to minimize the need for infrastructure management. Integration of Amazon Bedrock eliminates the need to communicate with external APIs, which allows for scalable, reliable, and secure applications.
The following AWS services are integrated in the architecture:
- Amazon DynamoDB: NoSQL database for conversation history storage
- Amazon API Gateway + AWS Lambda: Backend API endpoint (AWS Lambda Web Adapter, FastAPI)
- Amazon CloudFront + S3: Frontend application delivery (React, Tailwind CSS)
- AWS WAF: IP address restriction
- Amazon Cognito: User authentication
- Amazon Bedrock: Managed service to utilize foundational models via APIs. Claude used for chat response and Cohere for vector embedding
- Amazon EventBridge Pipes: Receiving event from DynamoDB stream and launching ECS task to embed external knowledge
- Amazon Elastic Container Service: Run crawling, parsing and embedding tasks. Cohere Multilingual model used for embedding
- Amazon Aurora PostgreSQL: Scalable vector store with pgvector plugin
- Amazon Athena: Query service to analyze S3 bucket
Connections and permissions
This blueprint supports the Amazon CodeCatalyst development administrator role in IAM, which can be created from the AWS Management Console. The role can be used across multiple blueprints. An alternative option is creating a blueprint-specific IAM role by adding an existing IAM role to your CodeCatalyst space. For more information, see Adding an AWS account to a space and Adding IAM roles to account connections.
When using an existing IAM role, make sure it contains the CodeCatalyst trust policy, as well as the following permissions:
1{ 2 "Version": "2012-10-17", 3 "Statement": [ 4 { 5 "Effect": "Allow", 6 "Action": [ 7 "iam:DeleteRole", 8 "iam:GetRole", 9 "iam:TagRole", 10 "iam:CreateRole", 11 "iam:AttachRolePolicy", 12 "iam:DetachRolePolicy", 13 "iam:DeleteRolePolicy", 14 "cloudformation:*", 15 "lambda:*", 16 "apigateway:*", 17 "ecr:*", 18 "ssm:PutParameter", 19 "ssm:DeleteParameter", 20 "iam:PutRolePolicy", 21 "s3:*", 22 "ssm:GetParameter", 23 "ssm:GetParameters", 24 "bedrock:InvokeModel" 25 ], 26 "Resource": "*" 27 }, 28 { 29 "Effect": "Allow", 30 "Action": [ 31 "sts:AssumeRole" 32 ], 33 "Resource": [ 34 "arn:aws:iam::*:role/cdk-*" 35 ] 36 } 37 ] 38}
The IAM roles also require the Amazon CodeCatalyst service principals codecatalyst.amazonaws.com and codecatalyst-runner.amazonaws.com.
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "",
"Effect": "Allow",
"Principal": {
"Service": [
"codecatalyst.amazonaws.com",
"codecatalyst-runner.amazonaws.com"
]
},
"Action": "sts:AssumeRole"
}
]
}
Additional resources
See the Amazon CodeCatalyst user guide for additional information on using the features and resources of Amazon CodeCatalyst. To learn more about blueprints, see the Project blueprint reference and Working with custom blueprints in CodeCatalyst.
No vulnerabilities found.
No security vulnerabilities found.