Performance Unlocked: Introducing the Ampere Performance Toolkit (APT)

As you pursue optimal efficiency and performance for your software, you understand that squeezing the most out of modern processors requires insight into the underlying hardware. At Ampere®, we recognize that the path to true optimization demands instilling a performance discipline, a consistent, predictable performance evaluation, and using the appropriate tools and methods to identify and root cause issues.

That is why we created the Ampere Performance Toolkit (APT). The fundamental intent of the toolkit is to help you follow a disciplined methodology: establish a consistent, predictable benchmarking approach, eliminate system-level bottlenecks, analyze application bottlenecks, and finally perform microarchitectural analysis. This allows for more effective test and optimize cycles.

We’ve expanded the original APT beyond a single tool, now to include four powerful, specialized tools designed to offer comprehensive insights into your hardware and software performance. This is an open-source solution designed to enable customers and developers to take a systematic approach to performance analysis and optimization.

• The Ampere Porting Advisor (APA) centers around advising on the transition or optimization of software to Arm64 architecture. This tool can save time and effort in the porting and migration process. By analyzing the make environment and source code for known code patterns and dependency libraries it provides detailed reports with incompatibilities and recommendations. This guidance enables developers to navigate the intricacies of transitioning between architectures more efficiently, accelerating the overall migration process.
• The Ampere System Profiler (ASP) provides profiling capabilities that can be used for workload characterization at a system level, a first step for root-causing performance issues. ASP can be used to study OS-level metrics, including CPU utilization, CPU Power, networking , I/O and NUMA effects, helping you resolve system-level bottlenecks before digging deeper into code and microarchitecture-level optimizations.
• The Ampere PMU Profiler (APP) focuses on deep, microarchitecture-level efficiency metrics by collecting Performance Monitoring Unit (PMU) events such as Instructions Per Cycle, Cache Miss Rate and Branch Prediction Analysis. Once system-level optimizations are completed, APP is critical to tying software code execution to hardware effects.
• The Ampere Performance Kit for Benchmarking (APKB) provides a standardized and automated way to run and benchmark applications. This framework makes it easier and faster to set up and run performance tests in a repeatable manner across bare metal, virtualized, and cloud environments using a mature, automated framework with best known configurations. The APKB project includes numerous benchmarks and workloads – from common benchmarks like multi-chase (memory latency/bandwidth), FIO (I/O characteristics), Netperf (network) and SPECCPU Integer to applications like Cassandra, MySQL, Redis, NGINX, and finally, AI inference using large language models LLaMA and Qwen.

The Ampere Performance Toolkit acts like a sophisticated compass and microscope for developers: APA and APKB are like a compass, ensuring you are pointed in the right direction to port and run applications in a repeatable manner while ASP and APP are like microscopes, allowing you to home in on and zoom into problem areas to resolve performance problems.

The Ampere Performance Toolkit represents a significant advancement in simplifying software porting, benchmarking, and optimization. By streamlining the migration process, reducing development costs, and enabling access to a wider ecosystem, the toolkit empowers developers to embrace the benefits of the AArch64 architecture more quickly and effectively.

We invite you to download and try the Ampere Performance Toolkit from the Ampere Performance Toolkit Repository. To learn more about our developer efforts and find best practices, visit Ampere’s Developer Center and join the conversation in the Ampere Developer Community.

Check out the full Ampere article collection here.