Using Spectrum Scale (GPFS), you can move data, compress, delete based on policies
Here scripts to automate ILM https://github.com/IBM/spectrum-scale-policy-scripts
Examples of policies:
/* fileset placement project1 to new 10TB NL-SAS pool */ RULE 'project1' SET POOL 'NLSAS10TB' FOR FILESET ('project1') /* fileset placement project2 to new 10TB NL-SAS pool */ RULE 'project2' SET POOL 'NLSAS10TB' FOR FILESET ('project2') /* default placement to pool NLSAS4TB, must be the last line */ RULE 'default' SET POOL 'NLSAS4TB'
/* Extension of the placement policy by the threshold */ RULE 'migrate_SSD2NLSAS_60' MIGRATE FROM POOL 'ssddata' THRESHOLD(60,50) WEIGHT(KB_ALLOCATED) TO POOL 'data' WHERE ((CURRENT_TIMESTAMP - MODIFICATION_TIME) > INTERVAL '5' MINUTES) /* Daily migration policy started by cron on the file system manager, with QoS */ RULE 'migrate_SSD2NLSAS_128M' MIGRATE FROM POOL 'ssddata' TO POOL 'data' WHERE KB_ALLOCATED > 131072 AND ((CURRENT_TIMESTAMP - MODIFICATION_TIME) > INTERVAL '5' MINUTES)
Add the callback to trigger the threshold migration on “lowDiskSpace”, without QoS
# mmchconfig enableLowspaceEvents=yes # /usr/lpp/mmfs/bin/mmaddcallback MIGRATION --command /usr/lpp/mmfs/bin/mmstartpolicy --event lowDiskSpace --parms "%eventName %fsName -g /cfs/.policywdir/global -s /cfs/.policywdir/local -N nsdsrv --single-instance --qos other"