[Vagnekman-users] Vagn: slow access to SMHI/Accumulus file systems

Mats Kronberg kronberg at nsc.liu.se
Thu Jan 12 14:22:22 CET 2012


We have now upgraded the Vagn-Accumulus network link. Please let me know if
you still see performance problems on the Accumulus file systems.

Please note that the /nobackup/vagn1 and /nobackup/vagn2 file systems in
most cases should be significantly faster than /nobackup/rossby*,
/nobackup/misu*, /nobackup/fou* and /nobackup/smhi*! They use different
hardware and have a faster connection to the analysis nodes than the
Accumulus storage has.

As an example, I get around 70 MB/s when writing large files from Vagn to
rossby10, but 230 MB/s when writing to vagn2.

If you have data on Accumulus that will be read on Vagn multiple times, you
might benefit from copying the data to vagn1 or vagn2 before analyzing it.
However, performance on the Accumulus file systems is still fairly high, so
if the files will only be read a few times, it is probably not worth
copying them.

-- 
Mats Kronberg, NSC Support <support at nsc.liu.se>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://lists.nsc.liu.se/mailman/public/vagnekman-users/attachments/20120112/370c09ff/attachment.html 


More information about the Vagnekman-users mailing list