gcs-browser-upload

Chunked, pausable, recoverable uploading to Google Cloud Storage directly from the browser.

This package is forked from gcs-browser-upload. It adds the possibility of adding custom metadata to the uploaded object.

How does it work?

1. User selects a file
2. File + a Google Cloud Storage resumable upload URL are given to gcs-browser-upload
3. File is read in chunks
4. A checksum of each chunk is stored in localStorage once succesfully uploaded
5. If the page is closed and re-opened for some reason, the upload can be resumed by passing the same file and URL back to gcs-browser-upload. The file will be validated against the stored chunk checksums to work out if the file is the same and where to resume from.
6. Once the resume index has been found, gcs-browser-upload will continue uploading from where it left off.
7. At any time, the pause method can be called to delay uploading the remaining chunks. The current chunk will be finished. unpause can then be used to continue uploading the remaining chunks.

Example

There is a full example available at example/example-client.

1import Upload from "gcs-browser-upload";
2
3let input = document.getElementById("fileInput");
4let pause = document.getElementById("pause");
5let unpause = document.getElementById("unpause");
6let upload = null;
7
8input.addEventListener("change", async () => {
9  upload = new Upload({
10    id: "foo",
11    url: "https://www.googleapis.com/..../....",
12    file: input.files[0],
13    onChunkUpload: (info) => {
14      console.log("Chunk uploaded", info);
15    },
16  });
17
18  try {
19    await upload.start();
20    console.log("Upload complete!");
21  } catch (e) {
22    console.log("Upload failed!", e);
23  } finally {
24    upload = null;
25  }
26});
27
28pause.addEventListener("click", () => {
29  if (upload) {
30    upload.pause();
31  }
32});
33
34unpause.addEventListener("click", () => {
35  if (upload) {
36    upload.unpause();
37  }
38});

Config

1{
2  id: null, // required - a unique ID for the upload
3  url: null, // required - GCS resumable URL
4  file: null, // required - instance of File
5  chunkSize: 262144, // optional - chunk size must be a multiple of 262144
6  storage: window.localStorage, // optional - storage mechanism used to persist chunk meta data
7  contentType: 'text/plain', // optional - content type of the file being uploaded
8  onChunkUpload: () => {}, // optional - a function that will be called with progress information
9  metadata: { }, // optional - custom metadata to be added to the object
10}

Requirements

This library requires regeneratorRuntime to be available globally - it is written in ES7 and makes use of async/await, which gets compiled into generators. You can find out about regenerator-runtime here.

Handling errors

Various errors are thrown if something goes wrong during uploading. See src/errors.js for the different types. These are exported as a property on the Upload class.

Developing

1make bootstrap     // install dependencies
2make test          // run tests
3make test-watch    // continuously run tests