[Vagnekman-users] Important news regarding the cluster filesystem on Ekman

[Mattias Claesson]

Dear Ekman users

> Forthcoming enforcement of space allocation
<snip>
> c. The file system will be divided into two branches - one called nobackup
> and one called scratch each of which will have the following purposes:
>
>     nobackup: Use for files that - while needed by jobs frequently running
> on ekman - is not of a transient nature. Examples of this could be large
> in-data sets that are used by several jobs running over several months. The
> current plan is that this file system will be manually cleaned if need
> arises.
>
>     scratch: Use for files that are used by jobs on ekman but does not fall
> into the nobackup-category. The current plan is that this file system will
> be automatically cleaned by removing file older than a certain time. This
> time will be tuned so that:
>        a) The files are available while a job is running on the cluster
>        b) After the job has run there is a reasonable chance to move the
> files to e.g. vagn.
>        c) There is a low likelihood of jobs failing due to a full file
> system.
>
>    and please note: NONE OF THESE FILES ARE BACKED UP.

There is now also a parallel directory structure similar to the scratch one
available to all users called /cfs/ekman/nobackup . There is no automatic
cleaning of scratch yet, but all users should move their files according to
the above criteria in preparation of its activation. The current plan is to
activate the cleaning in mid January. More information about its
implementation will be sent out before that.

Mattias
PDC-staff