Main Page

From Perf Wiki
(Difference between revisions)
Jump to: navigation, search
(References/Useful links: Added link to Chandler's talk at CppCon2015 where he uses perf a lot!)
(14 intermediate revisions by 8 users not shown)
Line 1: Line 1:
<big>'''Performance Counters for Linux Wiki'''</big>
+
== <tt>perf:</tt> Linux profiling with performance counters ==
 +
''...More than just counters...''
  
This is the wiki page for the perfcounters subsystem in Linux.
+
=== Introduction ===
  
Performance counters are special hardware registers available on most modern
+
This is the wiki page for the Linux <tt>perf</tt> command, also called perf_events. <tt>perf</tt> is powerful: it can instrument CPU performance counters, tracepoints, kprobes, and uprobes (dynamic tracing). It is capable of lightweight profiling. It is also included in the Linux kernel, under tools/perf, and is frequently updated and enhanced.
CPUs. These registers count the number of certain types of hw events: such
+
as instructions executed, cache-misses suffered, or branches mispredicted -
+
without slowing down the kernel or applications. These registers can also  
+
trigger interrupts when a threshold number of events have passed - and can
+
thus be used to profile the code that runs on that CPU.
+
+
The Linux Performance Counter subsystem provides rich abstractions over these
+
hardware capabilities. It provides per task, per CPU and per-workload counters,
+
counter groups, and it provides sampling capabilities on top of those - and more.
+
  
It also provides abstraction for 'software events' - such as minor/major page faults, task migrations, task context-switches and tracepoints.
+
<tt>perf</tt> began as a tool for using the performance counters subsystem in Linux, and has had various enhancements to add tracing capabilities.
  
There is a new tool ('perf') that makes full use of this new kernel subsystem. It can be used to optimize, validate and measure applications, workloads or the full system.
+
Performance counters are CPU hardware registers that count hardware events such as instructions executed, cache-misses suffered, or branches mispredicted. They form a basis for profiling applications to trace dynamic control flow and identify hotspots. <tt>perf</tt> provides rich generalized abstractions over hardware specific capabilities. Among others, it provides per task, per CPU and per-workload counters, sampling on top of these and source code event annotation.
  
'perf' is hosted in the upstream kernel repository and can be found under: tools/perf/
+
Tracepoints are instrumentation points placed at logical locations in code, such as for system calls, TCP/IP events, file system operations, etc. These have negligible overhead when not in use, and can be enabled by the <tt>perf</tt> command to collect information including timestamps and stack traces. <tt>perf</tt> can also dynamically create tracepoints using the kprobes and uprobes frameworks, for kernel and userspace dynamic tracing. The possibilities with these are endless.
  
== Getting Started ==
+
The userspace <tt>perf</tt> command present a simple to use interface with commands like:
  
Once you have installed 'perf' on your system, the simplest way to start profiling an userspace program is to use the "perf record" and "perf report" command as follows:
+
* <tt>[[Tutorial#Counting_with_perf_stat| perf stat</tt>]]: obtain event counts
 +
* <tt>[[Tutorial#Sampling_with_perf_record | perf record</tt>]]: record events for later reporting
 +
* <tt>[[Tutorial#Sample_analysis_with_perf_report | perf report</tt>]]: break down events by process, function, etc.
 +
* <tt>[[Tutorial#Source_level_analysis_with_perf_annotate | perf annotate</tt>]]: annotate assembly or source code with event counts
 +
* <tt>[[Tutorial#Live_analysis_with_perf_top | perf top</tt>]]: see live event count
 +
* <tt>[[Tutorial#Benchmarking_with_perf_bench | perf bench</tt>]]: run different kernel microbenchmarks
  
$ <b>perf record -f -- git gc</b>
+
To learn more, see the examples in the [[Tutorial]].
&nbsp;
+
Counting objects: 1283571, done.
+
Compressing objects: 100% (206724/206724), done.
+
Writing objects: 100% (1283571/1283571), done.
+
Total 1283571 (delta 1070675), reused 1281443 (delta 1068566)
+
[ perf record: Captured and wrote 31.054 MB perf.data (~1356768 samples) ]
+
&nbsp;
+
$ <b>perf report --sort comm,dso,symbol</b> | head -10
+
# Samples: 1355726
+
#
+
# Overhead          Command                            Shared Object  Symbol
+
# ........  ...............  .......................................  ......
+
#
+
    31.53%              git  /usr/bin/git                            [.] 0x0000000009804f
+
    13.41%        git-prune  /usr/bin/git-prune                      [.] 0x000000000ad06d
+
    10.05%              git  /lib/tls/i686/cmov/libc-2.8.90.so        [.] _nl_make_l10nflist
+
      5.36%        git-prune  /usr/lib/libz.so.1.2.3.3                [.] 0x00000000009d51
+
      4.48%              git  /lib/tls/i686/cmov/libc-2.8.90.so        [.] memcpy
+
  
For more examples of how 'perf' can be used see [[perf examples]].
+
=== Wiki Contents  ===
  
== TODO list ==
+
* [[Tutorial]]
 +
* [[Todo]]
 +
* [[HardwareReference]]
 +
* [[perf_events kernel ABI]]
  
=== Perf tools ===
+
=== References/Useful links ===
 
+
* [http://indico.cern.ch/materialDisplay.py?contribId=20&sessionId=4&materialId=slides&confId=141309 Roberto Vitillo's presentation on Perf events]
* Factorize the multidimensional sorting between perf report and annotate (will be used by perf trace)
+
* [http://www.brendangregg.com/perf.html Brendan Gregg's perf examples]
* Implement a perf cmp (profile comparison between two perf.data)
+
* [https://youtu.be/nXaxk27zwlk CppCon 2015: Chandler Carruth "Tuning C++: Benchmarks, and CPUs, and Compilers! Oh My!"]
* Implement a perf view (GUI)
+
* Enhance perf trace:
+
** Handle the cpu field
+
** Handle the timestamp
+
** Use the in-perf ip -> symbol resolving
+
** Use the in-perf pid -> cmdline resolving
+
** Implement multidimensional sorting by field name
+

Revision as of 14:33, 28 September 2015

Contents

perf: Linux profiling with performance counters

...More than just counters...

Introduction

This is the wiki page for the Linux perf command, also called perf_events. perf is powerful: it can instrument CPU performance counters, tracepoints, kprobes, and uprobes (dynamic tracing). It is capable of lightweight profiling. It is also included in the Linux kernel, under tools/perf, and is frequently updated and enhanced.

perf began as a tool for using the performance counters subsystem in Linux, and has had various enhancements to add tracing capabilities.

Performance counters are CPU hardware registers that count hardware events such as instructions executed, cache-misses suffered, or branches mispredicted. They form a basis for profiling applications to trace dynamic control flow and identify hotspots. perf provides rich generalized abstractions over hardware specific capabilities. Among others, it provides per task, per CPU and per-workload counters, sampling on top of these and source code event annotation.

Tracepoints are instrumentation points placed at logical locations in code, such as for system calls, TCP/IP events, file system operations, etc. These have negligible overhead when not in use, and can be enabled by the perf command to collect information including timestamps and stack traces. perf can also dynamically create tracepoints using the kprobes and uprobes frameworks, for kernel and userspace dynamic tracing. The possibilities with these are endless.

The userspace perf command present a simple to use interface with commands like:

To learn more, see the examples in the Tutorial.

Wiki Contents

References/Useful links

Personal tools