On Sat, Mar 28, 2015 at 3:56 PM, Matthew Lai <m@matthewlai.ca> wrote:
Just wondering if there is an option to divide things up in blocks of lines?
For example, if there is a file with a million lines, is there a way to run
4 processes, with 250k lines input each?
I have a large file I want to process in parallel, but the command has high
startup overhead.
Before I answer that, please tell me whether you have:
* watched the intro videos (http://pi.dk/1)
* walked through the tutorial (man parallel_tutorial)
* read the examples in the man page (LESS=+/EXAMPLE: man parallel)
/Ole