Wednesday, June 18, 2014

Wednesday: 8 = 8

One of the things for the stupid supercomputer project is supposed to break data transfer in a set of threads, and then iterate over a file list to assign files to each thread.  This way, we can saturate the network connection better than a single thread can.  I chose to use eight threads, assuming this would be fine.

Except if the files come in sets of eight, and some files are significantly larger than other files.  Then you assign all the hard stuff to one thread, and ruin that saturation concept.  Fuckity fuck fuck.



No comments:

Post a Comment