Engineering:AWS Graviton

From HandWiki
Short description: CPU family designed by and for Amazon Web Services

AWS Graviton is a family of 64-bit ARM-based CPUs designed by the Amazon Web Services (AWS) subsidiary Annapurna Labs. The processor family is distinguished by its lower energy use relative to x86-64, static clock rates, and omission of simultaneous multithreading. It was designed to be tightly integrated with AWS servers and datacenters, and is not sold outside Amazon.[1]

In 2018, AWS released the first version of Graviton suitable for open-source and non-performance-critical scripting workloads as part of its A1 instance family.[2] The second generation, AWS Graviton2, was announced in December 2019 as the first of its sixth generation instances, with AWS promising 40% improved price/performance over fifth generation Intel and AMD instances[3] and an average of 72% reduction in power consumption.[4] In May 2022, AWS made available Graviton3 processors as part of its seventh generation EC2 instances, offering a further 25% better compute performance over Graviton2.[5]

Origin

The first Annapurna Labs silicon product launched under the AWS umbrella was the AWS Nitro hardware and supporting hypervisor in November 2017.[6] Following on from Nitro, Annapurna began to develop general-purpose CPUs using its expertise.

The benefits AWS anticipated included:

  • Offering more choice in terms of selection of EC2 instances for customers
  • Targeting Arm-based applications
  • Providing high availability and security, while reducing virtualization costs
  • Offering decent server performance with lower prices for customers

The first Graviton processor reached these goals. Graviton2 now offers better performance compared to X86-64: 35% faster running Redis,[7] 30% faster running Apache Cassandra,[8] and up to 117% higher throughput for MongoDB.[9] In addition to higher performance, Graviton offers 70% lower power consumption [10] and 20% lower price.[11]

Graviton

Graviton
General Info
LaunchedNovember 26, 2018; 5 years ago (November 26, 2018)
Performance
Max. CPU clock rate2.3 GHz
Cache
L1 cache80 KB per core (48 instructions + 32 data)
L2 cache8 MB total
Architecture and classification
Min. feature size16 nm
Instruction setAArch64
InstructionsAArch64
Extensions
Physical specifications
Cores
History
SuccessorGraviton2

The first Graviton CPU has 16 Cortex A72 cores, with ARMv8-A ISA including Neon, crc, crypto. The vCPUs are physical cores in a single NUMA domain, running at 2.3 GHz. It also includes hardware acceleration for floating-point math, SIMD, plus AES, SHA-1, SHA-256, GCM, and CRC-32 algorithms.[12]

Only the A1 EC2 instance contains the first version of Graviton.[13]

Graviton2

The Graviton2 CPU has 64 Neoverse N1 cores, with ARMv8.2-A ISA including 2×128 bit Neon, LSE, fp16, rcpc, dotprod, crypto. The vCPUs are physical cores in a single NUMA domain, running at 2.5 GHz.[14]

EC2 instances with Graviton2 CPU: M6g, M6gd, C6g, C6gd, C6gn, R6g, R6gd, T4g, X2gd, G5g, Im4gn, Is4gen, I4g. One or more of these instances are available in 28 AWS regions.

Graviton3

The Graviton3 CPU has 64 Neoverse V1 cores, with ARMv8.4-A ISA including 4x128 bit Neon, 2×256 bit SVE, LSE, rng, bf16, int8, crypto. Organized in a single NUMA domain, all vCPUs are physical cores running at 2.6 GHz.[14] Graviton3 has 8 DDR5-4800 memory channels.

Graviton3 provides up to 25% better compute performance, up to 2x higher floating-point performance, up to 2× faster cryptographic workload performance, up to 3× better performance for machine learning workloads including support for bfloat16, and 50% more memory bandwidth compared to AWS Graviton2 processors. Graviton3-based instances use up to 60% less energy for the same performance than comparable EC2 instances. [15]

Graviton3E is a higher power version of Graviton3.[16]

EC2 instances with Graviton3 CPU: C7g, M7g, R7g; with local disk: C7gd, M7gd, R7gd.

EC2 instances with Graviton3E CPU: C7gn, HPC7g.

Graviton4

The Graviton4 CPU has 96 Neoverse V2 cores, with ARMv9.0-A ISA.[17] It has 2 MB of L2 cache per core (192 MB total), and 12 DDR5-5600 memory channels. Graviton4 supports Arm's Branch Target Identification (BTI).

Amazon claims that Graviton4 is up to 40% faster for databases, 30% faster for web applications, and 45% faster for large Java applications than the Graviton3.

EC2 instances with Graviton4 CPU: R8g.

See also

External links

References

  1. ↑ Simonite, Tom (2018-11-27). "New at Amazon: Its Own Chips for Cloud Computing" (in en-US). Wired. ISSN 1059-1028. https://www.wired.com/story/new-amazon-chips-cloud-computing/. Retrieved 2023-08-09. 
  2. ↑ Sanders, James (29 November 2018). "FAQ: What Arm servers on AWS mean for your cloud and data center strategy". TechRepublic. https://www.techrepublic.com/article/faq-what-arm-servers-on-aws-mean-for-your-cloud-and-data-center-strategy/. 
  3. ↑ "Announcing New Amazon EC2 M6g, C6g, and R6g Instances Powered by Next-Generation Arm-based AWS Graviton2 Processors" (in en-US). 2019-12-03. https://aws.amazon.com/about-aws/whats-new/2019/12/announcing-new-amazon-ec2-m6g-c6g-and-r6g-instances-powered-by-next-generation-arm-based-aws-graviton2-processors/. 
  4. ↑ "NTT DOCOMO and NEC Reduce Power Consumption for 5G SA Core by an Average of 72% using AWS Graviton2, followed by a Successful Onboarding of 5G SA Core on Hybrid Cloud" (in en-US). 2022-09-29. https://www.nec.com/en/press/202209/global_20220929_03.html. 
  5. ↑ "New – Amazon EC2 C7g Instances, Powered by AWS Graviton3 Processors | AWS News Blog". 23 May 2022. https://aws.amazon.com/blogs/aws/new-amazon-ec2-c7g-instances-powered-by-aws-graviton3-processors/. 
  6. ↑ Liguori, A (2018). "The Nitro Project–Next Generation AWS Infrastructure". Hot Chips: A Symposium on High Performance Chips (Institute of Electrical and Electronics Engineers (IEEE)). https://old.hotchips.org/hc31/HC31_T1_AWS_Nitro_Hot_Chips_20190818-2.pdf. Retrieved 13 October 2023. 
  7. ↑ "Gain up to 35% performance benefits for deploying Redis on AWS Graviton2" (in en-US). 2021-07-20. https://community.arm.com/arm-community-blogs/b/infrastructure-solutions-blog/posts/redis-on-aws-graviton2. 
  8. ↑ "Increase performance by up to 30% by deploying Apache Cassandra on AWS Graviton2" (in en-US). 2021-08-18. https://community.arm.com/arm-community-blogs/b/tools-software-ides-blog/posts/increase-price_2d00_performance-by-deploying-cassandra-on-aws-graviton2. 
  9. ↑ "MongoDB performance on Arm Neoverse based AWS Graviton2 processors" (in en-US). 2021-06-09. https://community.arm.com/arm-community-blogs/b/operating-systems-blog/posts/mongodb-performance-on-aws-with-the-arm-graviton2. 
  10. ↑ "NTT DOCOMO and NEC Reduce Power Consumption for 5G SA Core by an Average of 72% using AWS Graviton2, followed by a Successful Onboarding of 5G SA Core on Hybrid Cloud" (in en-US). 2022-11-29. https://www.nec.com/en/press/202209/global_20220929_03.html. 
  11. ↑ "20% lower cost and up to 40% higher performance for M6g, C6g, and R6g instances over M5, C5, and R5 instances respectively" (in en-US). 2022-03-03. https://aws.amazon.com/ec2/graviton/. 
  12. ↑ "Amazon's homegrown 2.3GHz 64-bit Graviton processor was very nearly an AMD Arm CPU" (in en-US). 2018-11-27. https://www.theregister.com/2018/11/27/amazon_aws_graviton_specs. 
  13. ↑ "Amazon EC2 A1 Instances" (in en-US). 2018-11-26. https://aws.amazon.com/ec2/instance-types/a1/. 
  14. ↑ 14.0 14.1 "Building for Graviton2 and Graviton3" (in en-US). 2022-09-22. https://github.com/aws/aws-graviton-getting-started/blob/main/README.md. 
  15. ↑ "Amazon 2021 Letter to Shareholders" (in en-US). 2022-04-14. https://www.aboutamazon.com/news/company-news/2021-letter-to-shareholders. 
  16. ↑ "New Amazon EC2 Instance Types In the Works" (in en-US). 2022-11-28. https://aws.amazon.com/blogs/aws/new-amazon-ec2-instance-types-in-the-works-c7gn-r7iz-and-hpc7g/. 
  17. ↑ "Join the preview for new memory-optimized, AWS Graviton4-powered Amazon EC2 instances (R8g)" (in en-US). 2023-11-28. https://aws.amazon.com/blogs/aws/join-the-preview-for-new-memory-optimized-aws-graviton4-powered-amazon-ec2-instances-r8g/. 




Retrieved from "https://handwiki.org/wiki/index.php?title=Engineering:AWS_Graviton&oldid=3262271"