parse-csv-stream

Parse csv files via stream or parse any csv stream from various sources in Node.js for different usecases like batch processing, database insertion, logging, file creation & data transformations etc. Support for large csv files added.

Example:

1const parse_csv = require('parse-csv-stream');
2const fs = require('fs');
3
4const readStream = fs.createReadStream('./test.csv', 'utf8');
5const writeStream = fs.createWriteStream('./test.json');
6
7//default option.
8const options = {
9    // delimiter: ',',
10    // wrapper: '"',
11    // newlineSeperator: '\r\n'
12};
13
14const parser = new parse_csv(options);
15const events = parser.events;
16
17/*
18There are 2 approaches you can take : 
19[A.] events. 
20[B.] streams.
21
22There are 3 ways to handle data : 
23[1.] Process each row seperately via events.
24[2.] Process resultset (array of rows).
25[3.] Pipe parsed stream.
26 
27 choose any one.
28*/
29
30// [A.] working with events.
31events.on('data', (row) => {
32    console.log(row); //process each row seperately.
33})
34
35readStream.on('data', (chunk) => {
36   let resultset =  parser.parse(chunk); //process resultset (array of rows).
37});
38
39//[B.] Working with streams.
40readStream.pipe(parser).pipe(writeStream); //pipe parsed stream.

Built With

• Native Node.js modules
• No external dependencies.

Authors

• Ayush Pratap - Initial work - AyushPratap

License

[MIT License] © Ayush Pratap