Ensure that your Amazon Elasticsearch (ES) clusters are using General Purpose SSD (gp2) data nodes instead of Provisioned IOPS SSD (io1) nodes for cost-effective storage that fits a broad range of workloads. Cloud Conformity recommends converting your io1 ES EBS nodes to gp2-type nodes in order to lower the cost of your monthly AWS bill while maintaining the I/O performance at the same level. For example, if your Elasticsearch application requirements are 150GB storage and 1000 IOPS (input/output operations per second) you can save roughly $68 per month using gp2 nodes instead of io1 nodes as an io1-type EBS data node with 1000 IOPS and 150GB storage costs $113.35/month while a gp2 node with 1000 IOPS and 335GB storage costs only $45.25/month (as of November 2016).
This rule can help you work with the AWS Well-Architected Framework
This rule resolution is part of the Cloud Conformity Security & Compliance tool for AWS
optimisation
Using General Purpose SSD (gp2) data nodes instead of Provisioned IOPS SSD (io1) nodes represents a good strategy to cut down on Elasticsearch service storage costs because for gp2-type nodes you only pay for the storage compared to io1 nodes where you pay for both storage and I/O operations. Converting existing io1 resources to gp2 is often possible by configuring larger storage which gives higher baseline performance of IOPS for a lower cost.
Note: The storage settings outlined in this conformity rule do not apply to dedicated master nodes provisioned within your AWS Elasticsearch clusters.
Audit
To determine the type of your existing Elasticsearch (ES) data nodes, perform the following:
Remediation / Resolution
To convert your AWS Elasticsearch Provisioned IOPS SSD (io1) nodes to General Purpose SSD (gp2) nodes, perform the following:
References
- AWS Documentation
- Amazon Elasticsearch Service Pricing
- Amazon EBS Volume Types
- Managing Amazon Elasticsearch Service Domains
- AWS Command Line Interface (CLI) Documentation
- es
- list-domain-names
- describe-elasticsearch-domain
- update-elasticsearch-domain-config
Unlock the Remediation Steps
Gain free unlimited access
to our full Knowledge Base
Over 750 rules & best practices
for and
Get started for FREE
You are auditing:
Elasticsearch General Purpose SSD
Risk level: Medium