---

multi-cloud-upload

A Node.js package that provides an easy interface to upload and manage files on both Cloudinary and AWS S3. This package supports both JavaScript and TypeScript projects, making it versatile and easy to integrate into various environments.

Table of Contents

• Installation
• Features
• Usage
  • JavaScript
  • TypeScript
• Configuration
• API Reference
  • StorageProvider
  • CloudinaryUploader
  • S3Uploader
• Contributing
• License

Installation

To install the package, use npm or yarn:

1npm install multi-cloud-upload

or

1yarn add multi-cloud-upload

Features

• Supports Cloudinary and AWS S3: Easily switch between Cloudinary and AWS S3 for file uploads and management.
• Compatible with JavaScript and TypeScript: Includes type definitions for TypeScript support.
• Simple and Extensible: Easy-to-use interface that can be extended to support additional cloud services.

Usage

JavaScript

1
2const {StorageFactory} = require ("multi-cloud-upload")
3const fs = require("fs")
4const path = require("path")
5require("dotenv").config();
6
7// Load configurations from environment variables
8const accessKeyId = process.env.AWS_ACCESS_KEY_ID || '';
9const secretAccessKey = process.env.AWS_SECRET_ACCESS_KEY || '';
10const region = process.env.AWS_REGION || '';
11const bucket = process.env.AWS_BUCKET || '';
12
13const cloudinaryConfig = {
14  cloud_name: process.env.CLOUDINARY_CLOUD_NAME || '',
15  api_key: process.env.CLOUDINARY_API_KEY || '',
16  api_secret: process.env.CLOUDINARY_API_SECRET || '',
17  // additional params can go in here.
18};
19
20
21const s3Config = {
22  accessKeyId: accessKeyId,
23  secretAccessKey: secretAccessKey,
24  region: region,
25  bucket: bucket,
26
27};
28
29const cloudinaryProvider = StorageFactory.createProvider('cloudinary', cloudinaryConfig);
30const s3Provider = StorageFactory.createProvider('s3', s3Config);
31
32// Read the actual image file into a buffer
33const filePath = path.join(__dirname, 'test.png');
34const fileBuffer = fs.readFileSync(filePath);
35
36console.log(fileBuffer, "sdfnjbfdvbfd");
37
38
39// Now you can use either provider with the same interface
40(async () => {
41    let context = {}
42    // upload
43    const example1 = await cloudinaryProvider.upload(fileBuffer, 'example.png', context);
44    const example2 = await cloudinaryProvider.download('example.png', context);
45    const example3 = await cloudinaryProvider.list(context);
46    const example4 = await cloudinaryProvider.delete('example.png', context);
47    const example5 = await cloudinaryProvider.getUrl('gccyckcnbpcy5vx8gjyd', context);
48  
49  
50    // // upload file
51    const example6 = await s3Provider.upload(fileBuffer, 'examplex.png', {ContentType: 'image/png'} );
52    // donwload file
53    const example7 = await s3Provider.download("examplex.png", context)
54    // delete object
55    const example8 = await s3Provider.delete('examplex.png',context)
56    // list objects
57    context = {MaxKeys:5, ContinuationToken: 'xyz'}
58    const example9 = await s3Provider.list(context)
59    // get single object
60    context = {expiresIn: 60 * 1}
61    const example10 = s3Provider.getUrl('examplex.png', context)
62  
63
64})()
65  

TypeScript

1
2// Usage example
3import {StorageFactory} from "multi-cloud-upload"
4import * as dotenv from 'dotenv';
5import * as fs from 'fs';
6import * as path from 'path';
7dotenv.config(); 
8
9// Load configurations from environment variables
10const accessKeyId = process.env.AWS_ACCESS_KEY_ID || '';
11const secretAccessKey = process.env.AWS_SECRET_ACCESS_KEY || '';
12const region = process.env.AWS_REGION || '';
13const bucket = process.env.AWS_BUCKET || '';
14
15const cloudinaryConfig = {
16  cloud_name: process.env.CLOUDINARY_CLOUD_NAME || '',
17  api_key: process.env.CLOUDINARY_API_KEY || '',
18  api_secret: process.env.CLOUDINARY_API_SECRET || '',
19};
20
21const s3Config = {
22    accessKeyId: accessKeyId,
23    secretAccessKey: secretAccessKey,
24    region: region,
25    bucket: bucket,
26  
27  };
28
29const cloudinaryProvider = StorageFactory.createProvider('cloudinary', cloudinaryConfig);
30const s3Provider = StorageFactory.createProvider('s3', s3Config);
31
32// Read the actual image file into a buffer
33const filePath = path.join(__dirname, 'test.png');
34const fileBuffer = fs.readFileSync(filePath);
35
36// Now you can use either provider with the same interface
37(async () => {
38    let context = {}
39    // upload
40    const example1 = await cloudinaryProvider.upload(fileBuffer, 'example.png', context);
41    const example2 = await cloudinaryProvider.download('example.png', context);
42    const example3 = await cloudinaryProvider.list(context);
43    const example4 = await cloudinaryProvider.delete('example.png', context);
44    const example5 = await cloudinaryProvider.getUrl('gccyckcnbpcy5vx8gjyd', context);
45  
46  
47    // // upload file
48    const example6 = await s3Provider.upload(fileBuffer, 'examplex.png', {ContentType: 'image/png'} );
49    // donwload file
50    const example7 = await s3Provider.download("examplex.png", context)
51    // delete object
52    const example8 = await s3Provider.delete('examplex.png',context)
53    // list objects
54    context = {MaxKeys:5, ContinuationToken: 'xyz'}
55    const example9 = await s3Provider.list(context)
56    // get single object
57    context = {expiresIn: 60 * 1}
58    const example10 = s3Provider.getUrl('examplex.png', context)
59  
60
61})()

Configuration

To use this package, you need to configure your credentials and options for Cloudinary or AWS S3 depending on your storage service of choice.

Cloudinary

Set up your Cloudinary credentials:

1
2const cloudinaryConfig = {
3  cloud_name: process.env.CLOUDINARY_CLOUD_NAME || '',
4  api_key: process.env.CLOUDINARY_API_KEY || '',
5  api_secret: process.env.CLOUDINARY_API_SECRET || '',
6  // more params can go in here
7};

AWS S3

Set up your AWS credentials and region:

1
2const s3Config = {
3  accessKeyId: accessKeyId,
4  secretAccessKey: secretAccessKey,
5  region: region,
6  bucket: bucket,
7};

API Reference

StorageProvider

The StorageProvider class provides a common interface for uploading, downloading, listing, getUrl and deleting files.

upload(file: Buffer, fileName: string, context: object={}): Promise<any>

• file: The file to be uploaded as a Buffer.
• fileName: The name to save the file under.
• options: Optional parameters for the upload.

download(fileName: string, context: object={}): Promise<any>

• fileName: The name of the file to be downloaded.
• options: Optional parameters for the download.

delete(fileName: string, context: object={}): Promise<any>

• fileName: The name of the file to be deleted.
• options: Optional parameters for the delete operation.

list(context: object={}): Promise<string[]>

• options: Optional parameters for listing files.
• Returns: A Promise that resolves to an array of file names.

getUrl(fileName: string, context: object={}): Promise<string>

• fileName: The name of the file for which to generate the URL.
• options: Optional parameters.
• Returns: A Promise that resolves to the pre-signed URL.

CloudinaryProvider

The CloudinaryProvider class implements the StorageProvider interface for Cloudinary.

upload(file: Buffer, fileName: string, context: object={}): Promise<any>

Uploads a file to Cloudinary.

download(fileName: string, context: object={}): Promise<any>

Downloads a file from Cloudinary.

delete(fileName: string, context: object={}): Promise<any>

Deletes a file from Cloudinary.

list(context: object={}): Promise<string[]>

Lists files from Cloudinary.

getUrl(fileName: string, context: object={}): Promise<string>

Generates a URL for accessing a file in Cloudinary.

S3Provider

The S3Provider class implements the StorageProvider interface for AWS S3.

upload(file: Buffer, fileName: string, context: object={}): Promise<any>

Uploads a file to an S3 bucket.

download(fileName: string, context: object={}): Promise<any>

Downloads a file from an S3 bucket.

delete(fileName: string, context: object={}): Promise<any>

Deletes a file from an S3 bucket.

list(context: object={}): Promise<string[]>

Lists files from an S3 bucket.

getUrl(fileName: string, context: object={}): Promise<string>

Generates a pre-signed URL for accessing a file in an S3 bucket.

Contributing

Contributions are welcome! Please fork the repository and create a pull request. For major changes, please open an issue first to discuss what you would like to change.

License

This project is licensed under the MIT License. See the LICENSE file for more details.

---