User Tools

Site Tools


gpfs:gpfs_ilm

Life Cycle Management ILM

Using Spectrum Scale (GPFS), you can move data, compress, delete based on policies

Here scripts to automate ILM https://github.com/IBM/spectrum-scale-policy-scripts

Examples of policies:

/* fileset placement project1 to new 10TB NL-SAS pool */
RULE 'project1' SET POOL 'NLSAS10TB' FOR FILESET ('project1')

/* fileset placement project2 to new 10TB NL-SAS pool */
RULE 'project2' SET POOL 'NLSAS10TB' FOR FILESET ('project2')

/* default placement to pool NLSAS4TB, must be the last line */
RULE 'default' SET POOL 'NLSAS4TB'
/* Extension of the placement policy by the threshold */
RULE 'migrate_SSD2NLSAS_60' MIGRATE FROM POOL 'ssddata' THRESHOLD(60,50) 
WEIGHT(KB_ALLOCATED) TO POOL 'data'
WHERE ((CURRENT_TIMESTAMP - MODIFICATION_TIME) > INTERVAL '5' MINUTES)

/* Daily migration policy started by cron on the file system manager, with QoS */
RULE 'migrate_SSD2NLSAS_128M' MIGRATE FROM POOL 'ssddata' TO POOL 'data' WHERE KB_ALLOCATED > 
131072 AND ((CURRENT_TIMESTAMP - MODIFICATION_TIME) > INTERVAL '5' MINUTES)

Add the callback to trigger the threshold migration on “lowDiskSpace”, without QoS

# mmchconfig enableLowspaceEvents=yes
# /usr/lpp/mmfs/bin/mmaddcallback MIGRATION --command /usr/lpp/mmfs/bin/mmstartpolicy --event lowDiskSpace --parms "%eventName %fsName -g /cfs/.policywdir/global -s /cfs/.policywdir/local -N nsdsrv --single-instance --qos other"
gpfs/gpfs_ilm.txt · Last modified: 2021/11/01 23:35 by manu