gpfs:gpfs_sizing
This is an old revision of the document!
Spectrum Scale sizing
Filesystem Block size, best practice
Depending on usage, you can have different block size
| IO Type | Application Examples | Blocksize |
|---|---|---|
| Large Sequential IO | Scientific Computing, Digital Media,File based Analytics | 1MB to 16MB |
| Relational Database | DB2, Oracle, Small Files on ESS | 512KiB |
| Small I/O Sequential | General File Service ,Email, Web Applications | 256KiB |
| Special* | Special | 16KB-64KiB |
| *Since GPFS 3.3 there are very few workloads that benefit from a file system blocksize of 16KiB or 64KiB. | ||
| Workload | Configuration Type | Blocksize |
|---|---|---|
| SAP HANA | ESS GL | 16MiB for Data |
| SAP HANA | FPO | 1MiB for single pool |
| Or | ||
| 256KiB for metadataOnly | ||
| 2MiB for dataOnly | ||
| Hadoop | ESS GL | 1MiB for metadataOnly |
| 8MiB for dataOnly | ||
| Hadoop | FPO | 256KiB for metadataOnly |
| 2MiB for dataonly | ||
| Spark | FPO | 256KiB for metadataOnly |
| 2MiB for dataOnly | ||
| SAP Sybase IQ | ESS GL | 256KiB-1MiB for metadataOnly |
| 16MiB for dataOnly | ||
| Healthcare (Medical Imaging) | ESS | 256KiB for metadataOnly |
| 1MiB for dataOnly | ||
| Healthcare (Medical Imaging) | Other Storage | 256KiB Metadata and data |
| Archive | Other Storage | Depends on storage and performance requirements |
| ECM | Other Storage | 256KiB Unless the content is very large files (Videos for example). |
| Oracle | Other Storage | 256KiB |
| Technical Computing | ESS GL | 1MIB Metadata |
| 4MiB - 16MiB Data depending on importance of peak sequential performance. | ||
| SAS | ESS | 1MiB MetadataOnly |
| 8MiB or 16MiB depending on the SASBUF size (128KiB or 256 KiB) | ||
| Enterprise File (Misc Projects, data sharing) | Other Storage | 256KiB metadata and data |
gpfs/gpfs_sizing.1609532696.txt.gz · Last modified: 2021/01/01 21:24 by 127.0.0.1
Except where otherwise noted, content on this wiki is licensed under the following license: GNU Free Documentation License 1.3
