Node.js: fs-extra

fs-extra adds file system methods that aren't included in the native fs module. It is a drop in replacement for fs.

NOTE (2016-11-01): Node v0.12 will be unsupported on 2016-12-31.

Why?

I got tired of including mkdirp, rimraf, and ncp in most of my projects.

Installation

npm install --save fs-extra

Usage

fs-extra is a drop in replacement for native fs. All methods in fs are unmodified and attached to fs-extra.

You don't ever need to include the original fs module again:

1var fs = require('fs') // this is no longer necessary

you can now do this:

1var fs = require('fs-extra')

or if you prefer to make it clear that you're using fs-extra and not fs, you may want to name your fs variable fse like so:

1var fse = require('fs-extra')

you can also keep both, but it's redundant:

1var fs = require('fs')
2var fse = require('fs-extra')

Sync vs Async

Most methods are async by default (they take a callback with an Error as first argument).

Sync methods on the other hand will throw if an error occurs.

Example:

1var fs = require('fs-extra')
2
3fs.copy('/tmp/myfile', '/tmp/mynewfile', function (err) {
4  if (err) return console.error(err)
5  console.log("success!")
6});
7
8try {
9  fs.copySync('/tmp/myfile', '/tmp/mynewfile')
10  console.log("success!")
11} catch (err) {
12  console.error(err)
13}

Methods

• copy
• copySync
• emptyDir
• emptyDirSync
• ensureFile
• ensureFileSync
• ensureDir
• ensureDirSync
• ensureLink
• ensureLinkSync
• ensureSymlink
• ensureSymlinkSync
• mkdirs
• mkdirsSync
• move
• outputFile
• outputFileSync
• outputJson
• outputJsonSync
• readJson
• readJsonSync
• remove
• removeSync
• walk
• walkSync
• writeJson
• writeJsonSync

NOTE: You can still use the native Node.js methods. They are copied over to fs-extra.

copy()

copy(src, dest, [options], callback)

Copy a file or directory. The directory can have contents. Like cp -r.

Options:

• clobber (boolean): overwrite existing file or directory, default is true.
• dereference (boolean): dereference symlinks, default is false.
• preserveTimestamps (boolean): will set last modification and access times to the ones of the original source files, default is false.
• filter: Function to filter copied files. Return true to include, false to exclude. This can also be a RegExp, however this is deprecated (See issue #239 for background). Warning: copySync currently applies the filter only to files (see #180). This will be fixed in a future release.

Sync: copySync()

Example:

1var fs = require('fs-extra')
2
3fs.copy('/tmp/myfile', '/tmp/mynewfile', function (err) {
4  if (err) return console.error(err)
5  console.log("success!")
6}) // copies file
7
8fs.copy('/tmp/mydir', '/tmp/mynewdir', function (err) {
9  if (err) return console.error(err)
10  console.log('success!')
11}) // copies directory, even if it has subdirectories or files

emptyDir(dir, [callback])

Ensures that a directory is empty. Deletes directory contents if the directory is not empty. If the directory does not exist, it is created. The directory itself is not deleted.

Alias: emptydir()

Sync: emptyDirSync(), emptydirSync()

Example:

1var fs = require('fs-extra')
2
3// assume this directory has a lot of files and folders
4fs.emptyDir('/tmp/some/dir', function (err) {
5  if (!err) console.log('success!')
6})

ensureFile(file, callback)

Ensures that the file exists. If the file that is requested to be created is in directories that do not exist, these directories are created. If the file already exists, it is NOT MODIFIED.

Alias: createFile()

Sync: createFileSync(),ensureFileSync()

Example:

1var fs = require('fs-extra')
2
3var file = '/tmp/this/path/does/not/exist/file.txt'
4fs.ensureFile(file, function (err) {
5  console.log(err) // => null
6  // file has now been created, including the directory it is to be placed in
7})

ensureDir(dir, callback)

Ensures that the directory exists. If the directory structure does not exist, it is created.

Sync: ensureDirSync()

Example:

1var fs = require('fs-extra')
2
3var dir = '/tmp/this/path/does/not/exist'
4fs.ensureDir(dir, function (err) {
5  console.log(err) // => null
6  // dir has now been created, including the directory it is to be placed in
7})

ensureLink(srcpath, dstpath, callback)

Ensures that the link exists. If the directory structure does not exist, it is created.

Sync: ensureLinkSync()

Example:

1var fs = require('fs-extra')
2
3var srcpath = '/tmp/file.txt'
4var dstpath = '/tmp/this/path/does/not/exist/file.txt'
5fs.ensureLink(srcpath, dstpath, function (err) {
6  console.log(err) // => null
7  // link has now been created, including the directory it is to be placed in
8})

ensureSymlink(srcpath, dstpath, [type], callback)

Ensures that the symlink exists. If the directory structure does not exist, it is created.

Sync: ensureSymlinkSync()

Example:

1var fs = require('fs-extra')
2
3var srcpath = '/tmp/file.txt'
4var dstpath = '/tmp/this/path/does/not/exist/file.txt'
5fs.ensureSymlink(srcpath, dstpath, function (err) {
6  console.log(err) // => null
7  // symlink has now been created, including the directory it is to be placed in
8})

mkdirs(dir, callback)

Creates a directory. If the parent hierarchy doesn't exist, it's created. Like mkdir -p.

Alias: mkdirp()

Sync: mkdirsSync() / mkdirpSync()

Examples:

1var fs = require('fs-extra')
2
3fs.mkdirs('/tmp/some/long/path/that/prob/doesnt/exist', function (err) {
4  if (err) return console.error(err)
5  console.log("success!")
6})
7
8fs.mkdirsSync('/tmp/another/path')

move(src, dest, [options], callback)

Moves a file or directory, even across devices.

Options:

• clobber (boolean): overwrite existing file or directory
• limit (number): number of concurrent moves, see ncp for more information

Example:

1var fs = require('fs-extra')
2
3fs.move('/tmp/somefile', '/tmp/does/not/exist/yet/somefile', function (err) {
4  if (err) return console.error(err)
5  console.log("success!")
6})

outputFile(file, data, [options], callback)

Almost the same as writeFile (i.e. it overwrites), except that if the parent directory does not exist, it's created. options are what you'd pass to fs.writeFile().

Sync: outputFileSync()

Example:

1var fs = require('fs-extra')
2var file = '/tmp/this/path/does/not/exist/file.txt'
3
4fs.outputFile(file, 'hello!', function (err) {
5  console.log(err) // => null
6
7  fs.readFile(file, 'utf8', function (err, data) {
8    console.log(data) // => hello!
9  })
10})

outputJson(file, data, [options], callback)

Almost the same as writeJson, except that if the directory does not exist, it's created. options are what you'd pass to jsonFile.writeFile().

Alias: outputJSON()

Sync: outputJsonSync(), outputJSONSync()

Example:

1var fs = require('fs-extra')
2var file = '/tmp/this/path/does/not/exist/file.txt'
3
4fs.outputJson(file, {name: 'JP'}, function (err) {
5  console.log(err) // => null
6
7  fs.readJson(file, function(err, data) {
8    console.log(data.name) // => JP
9  })
10})

readJson(file, [options], callback)

Reads a JSON file and then parses it into an object. options are the same that you'd pass to jsonFile.readFile.

Alias: readJSON()

Sync: readJsonSync(), readJSONSync()

Example:

1var fs = require('fs-extra')
2
3fs.readJson('./package.json', function (err, packageObj) {
4  console.log(packageObj.version) // => 0.1.3
5})

readJsonSync() can take a throws option set to false and it won't throw if the JSON is invalid. Example:

1var fs = require('fs-extra')
2var file = path.join('/tmp/some-invalid.json')
3var data = '{not valid JSON'
4fs.writeFileSync(file, data)
5
6var obj = fs.readJsonSync(file, {throws: false})
7console.log(obj) // => null

remove(dir, callback)

Removes a file or directory. The directory can have contents. Like rm -rf.

Sync: removeSync()

Examples:

1var fs = require('fs-extra')
2
3fs.remove('/tmp/myfile', function (err) {
4  if (err) return console.error(err)
5
6  console.log('success!')
7})
8
9fs.removeSync('/home/jprichardson') //I just deleted my entire HOME directory.

walk()

walk(dir, [streamOptions])

The function walk() from the module klaw.

Returns a Readable stream that iterates through every file and directory starting with dir as the root. Every read() or data event returns an object with two properties: path and stats. path is the full path of the file and stats is an instance of fs.Stats.

Streams 1 (push) example:

1var fs = require('fs-extra')
2var items = [] // files, directories, symlinks, etc
3fs.walk(TEST_DIR)
4  .on('data', function (item) {
5    items.push(item.path)
6  })
7  .on('end', function () {
8    console.dir(items) // => [ ... array of files]
9  })

Streams 2 & 3 (pull) example:

1var items = [] // files, directories, symlinks, etc
2var fs = require('fs-extra')
3fs.walk(TEST_DIR)
4  .on('readable', function () {
5    var item
6    while ((item = this.read())) {
7      items.push(item.path)
8    }
9  })
10  .on('end', function () {
11    console.dir(items) // => [ ... array of files]
12  })

If you're not sure of the differences on Node.js streams 1, 2, 3 then I'd recommend this resource as a good starting point: https://strongloop.com/strongblog/whats-new-io-js-beta-streams3/.

See klaw documentation for more detailed usage.

walkSync(dir)

Lists all files inside a directory recursively

Examples:

1var fs = require('fs-extra')
2
3var files = fs.walkSync('/home/jprichardson')
4// files = ['/home/jprichardson/file1', '/home/jprichardson/dir1/file2']

writeJson(file, object, [options], callback)

Writes an object to a JSON file. options are the same that you'd pass to jsonFile.writeFile().

Alias: writeJSON()

Sync: writeJsonSync(), writeJSONSync()

Example:

1var fs = require('fs-extra')
2fs.writeJson('./package.json', {name: 'fs-extra'}, function (err) {
3  console.log(err)
4})

Third Party

Promises

Use Bluebird. See https://github.com/petkaantonov/bluebird/blob/master/API.md#promisification. fs-extra is explicitly listed as supported.

1var Promise = require('bluebird')
2var fs = Promise.promisifyAll(require('fs-extra'))

Or you can use the package fs-extra-promise that marries the two together.

TypeScript

If you like TypeScript, you can use fs-extra with it: https://github.com/borisyankov/DefinitelyTyped/tree/master/fs-extra

File / Directory Watching

If you want to watch for changes to files or directories, then you should use chokidar.

Misc.

• mfs - Monitor your fs-extra calls.

Hacking on fs-extra

Wanna hack on fs-extra? Great! Your help is needed! fs-extra is one of the most depended upon Node.js packages. This project uses JavaScript Standard Style - if the name or style choices bother you, you're gonna have to get over it :) If standard is good enough for npm, it's good enough for fs-extra.

What's needed?

• First, take a look at existing issues. Those are probably going to be where the priority lies.
• More tests for edge cases. Specifically on different platforms. There can never be enough tests.
• Improve test coverage. See coveralls output for more info.
• After the directory walker is integrated, any function that needs to traverse directories like copy, remove, or mkdirs should be built on top of it.

Note: If you make any big changes, you should definitely file an issue for discussion first.

Running the Test Suite

fs-extra contains hundreds of tests.

• npm run lint: runs the linter (standard)
• npm run unit: runs the unit tests
• npm test: runs both the linter and the tests

Windows

If you run the tests on the Windows and receive a lot of symbolic link EPERM permission errors, it's because on Windows you need elevated privilege to create symbolic links. You can add this to your Windows's account by following the instructions here: http://superuser.com/questions/104845/permission-to-make-symbolic-links-in-windows-7 However, I didn't have much luck doing this.

Since I develop on Mac OS X, I use VMWare Fusion for Windows testing. I create a shared folder that I map to a drive on Windows. I open the Node.js command prompt and run as Administrator. I then map the network drive running the following command:

net use z: "\\vmware-host\Shared Folders"

I can then navigate to my fs-extra directory and run the tests.

Naming

I put a lot of thought into the naming of these functions. Inspired by @coolaj86's request. So he deserves much of the credit for raising the issue. See discussion(s) here:

• https://github.com/jprichardson/node-fs-extra/issues/2
• https://github.com/flatiron/utile/issues/11
• https://github.com/ryanmcgrath/wrench-js/issues/29
• https://github.com/substack/node-mkdirp/issues/17

First, I believe that in as many cases as possible, the Node.js naming schemes should be chosen. However, there are problems with the Node.js own naming schemes.

For example, fs.readFile() and fs.readdir(): the F is capitalized in File and the d is not capitalized in dir. Perhaps a bit pedantic, but they should still be consistent. Also, Node.js has chosen a lot of POSIX naming schemes, which I believe is great. See: fs.mkdir(), fs.rmdir(), fs.chown(), etc.

We have a dilemma though. How do you consistently name methods that perform the following POSIX commands: cp, cp -r, mkdir -p, and rm -rf?

My perspective: when in doubt, err on the side of simplicity. A directory is just a hierarchical grouping of directories and files. Consider that for a moment. So when you want to copy it or remove it, in most cases you'll want to copy or remove all of its contents. When you want to create a directory, if the directory that it's suppose to be contained in does not exist, then in most cases you'll want to create that too.

So, if you want to remove a file or a directory regardless of whether it has contents, just call fs.remove(path). If you want to copy a file or a directory whether it has contents, just call fs.copy(source, destination). If you want to create a directory regardless of whether its parent directories exist, just call fs.mkdirs(path) or fs.mkdirp(path).

Credit

fs-extra wouldn't be possible without using the modules from the following authors:

• Isaac Shlueter
• Charlie McConnel
• James Halliday
• Andrew Kelley

License

Licensed under MIT

Copyright (c) 2011-2016 JP Richardson