Jump to content

AWS Graviton: Difference between revisions

From Wikipedia, the free encyclopedia
Content deleted Content added
m v2.05b - Bot T20 CW#61 - Fix errors for CW project (Reference before punctuation)
Njahnke (talk | contribs)
typo and -> an
Line 28: Line 28:
==Reason behind creating==
==Reason behind creating==


David Brown, VP of EC2 at AWS in 2020 said, that some customers were not using their EC2 instances at full capacity. After listening to customers such as [[SmugMug]] and [[Flickr]], AWS added to their [[X86-64]] family of processors and Arm based option for their servers for several reasons: <ref>{{Cite web|url=https://www.cloudzero.com/blog/aws-graviton|title=What Is AWS Graviton? Here's When To Use It|date=2021-05-28|website=cloudzero|language=en-US}}</ref>
David Brown, VP of EC2 at AWS in 2020 said, that some customers were not using their EC2 instances at full capacity. After listening to customers such as [[SmugMug]] and [[Flickr]], AWS added to their [[X86-64]] family of processors an Arm based option for their servers for several reasons: <ref>{{Cite web|url=https://www.cloudzero.com/blog/aws-graviton|title=What Is AWS Graviton? Here's When To Use It|date=2021-05-28|website=cloudzero|language=en-US}}</ref>


* Offer more choice in terms of selection of EC2 instances for customers
* Offer more choice in terms of selection of EC2 instances for customers

Revision as of 14:19, 22 January 2023

AWS Graviton is a 64-bit ARM-based CPU designed by AWS, an Amazon subsidiary. The first version was launched at AWS's customer event, re:Invent 2018. The second generation, AWS Graviton2, was launched in December 2019. AWS states that Graviton2 delivers up to 40% improved price/performance over the same generation M5, C5, and R5 instances[1] and an average of 72% reduction in power consumption.[2]

Graviton

The first Graviton CPU has 16 Cortex A72 cores, with ARMv8-A ISA including Neon, crc, crypto. The vCPUs are physical cores in a single NUMA domain, running at 2.3 GHz. It also includes hardware acceleration for floating-point math, SIMD, plus AES, SHA-1, SHA-256, GCM, and CRC-32 algorithms.[3]

One EC2 instance uses the original Graviton CPU: A1.[4]

Graviton2

The Graviton2 CPU has 64 Neoverse-N1 cores, with ARMv8.2-A ISA including 2x128 bit Neon, LSE, fp16, rcpc, dotprod, crypto. The vCPUs are physical cores in a single NUMA domain, running at 2.5 GHz.[5]

EC2 products that include Graviton2: M6g, M6gd, C6g, C6gd, C6gn, R6g, R6gd, T4g, X2gd, G5g, Im4gn, Is4gen. One or more of these instances are available in 28 AWS regions.

Graviton3

The Graviton3 CPU has 64 Neoverse-V1 cores, with ARMv8.4-A ISA including 4x128 bit Neon, LSE, 2x256 bit SVE, rng, bf16, int8, crypto. Organized in a single NUMA domain, all vCPUs are physical cores running at 2.6 GHz.[5]

EC2 products that include Graviton3: C7g, C7gn, HPC7g.

Graviton3 provides up to 25% better compute performance, up to 2x higher floating-point performance, up to 2x faster cryptographic workload performance, up to 3x better performance for ML workloads including support for bfloat16, and 50% more memory bandwidth compared to AWS Graviton2 processors. Graviton3-based instances use up to 60% less energy for the same performance than comparable EC2 instances. [6]

Graviton3E is a higher power version of Graviton3. [7]

Reason behind creating

David Brown, VP of EC2 at AWS in 2020 said, that some customers were not using their EC2 instances at full capacity. After listening to customers such as SmugMug and Flickr, AWS added to their X86-64 family of processors an Arm based option for their servers for several reasons: [8]

  • Offer more choice in terms of selection of EC2 instances for customers
  • Target Arm-based applications
  • Provide high availability and security, while reducing virtualization costs
  • Offer decent server performance with lower prices for customers

Graviton1 reached these goals. Graviton2 now offers better performance compared to X86: 35% faster running Redis,[9] 30% faster running Apache Cassandra,[10] and up to 117% higher throughput for MongoDB.[11] In addition to higher performance, Graviton offers 70% lower power consumption [12] and 20% lower price.[13]

See also

References

  1. ^ "Announcing New Amazon EC2 M6g, C6g, and R6g Instances Powered by Next-Generation Arm-based AWS Graviton2 Processors". Amazon Web Services. 2019-12-03. Retrieved 2019-12-03.
  2. ^ "NTT DOCOMO and NEC Reduce Power Consumption for 5G SA Core by an Average of 72% using AWS Graviton2, followed by a Successful Onboarding of 5G SA Core on Hybrid Cloud". Amazon Web Services. 2022-09-29. Retrieved 2022-10-11.
  3. ^ "Amazon's homegrown 2.3GHz 64-bit Graviton processor was very nearly an AMD Arm CPU". theregister. 2018-11-27.
  4. ^ "Amazon EC2 A1 Instances". Amazon Web Services. 2018-11-26. Retrieved 2022-10-11.
  5. ^ a b "Building for Graviton2 and Graviton3". Amazon Web Services. 2022-09-22. Retrieved 2022-10-10.
  6. ^ "Amazon 2021 Letter to Shareholders". AboutAmazon. 2022-04-14. Retrieved 2022-11-16.
  7. ^ "New Amazon EC2 Instance Types In the Works". AWS News Blog. 2022-11-28. Retrieved 2022-11-29.
  8. ^ "What Is AWS Graviton? Here's When To Use It". cloudzero. 2021-05-28.
  9. ^ "Gain up to 35% performance benefits for deploying Redis on AWS Graviton2". arm. 2021-07-20.
  10. ^ "Increase performance by up to 30% by deploying Apache Cassandra on AWS Graviton2". arm. 2021-08-18.
  11. ^ "MongoDB performance on Arm Neoverse based AWS Graviton2 processors". arm. 2021-06-09.
  12. ^ "NTT DOCOMO and NEC Reduce Power Consumption for 5G SA Core by an Average of 72% using AWS Graviton2, followed by a Successful Onboarding of 5G SA Core on Hybrid Cloud". nec. 2022-11-29.
  13. ^ "20% lower cost and up to 40% higher performance for M6g, C6g, and R6g instances over M5, C5, and R5 instances respectively". amazon. 2022-03-03.