linux/arch/x86/events/intel
Dapeng Mi a56c03a397 perf/x86/intel: Prevent drain_pebs() reentry
The PEBS buffer is shared by all events on a CPU, so drain_pebs() must
not be reentered. If so, one instance may observe stale buffer state and
potentially access out-of-bound memory.

Most invocations happen in NMI context, which naturally prevents reentry.
However, drain_pebs() is also reachable from process context via
intel_pmu_drain_pebs_buffer().

In those paths, the PMU is often already disabled, but not guaranteed.
For example, __intel_pmu_pebs_disable() only disables the target counter,
so other active counters can still raise a PMI and interrupt an in-flight
drain_pebs(). Here is an example,

__perf_addr_filters_adjust()
  perf_event_stop()
    __perf_event_stop()
      x86_pmu_stop() (event->pmu->stop)
        intel_pmu_disable_event()
          intel_pmu_pebs_disable()
            __intel_pmu_pebs_disable()
              intel_pmu_drain_large_pebs()
                intel_pmu_drain_pebs_buffer()

Introduce __intel_pmu_quiesce() and __intel_pmu_resume() helpers and
use them in intel_pmu_drain_large_pebs() to disable the full PMU
around the intel_pmu_drain_pebs_buffer() call, preventing reentry.

Also add a warning in intel_pmu_drain_pebs_buffer() when the full PMU is
not disabled.

Fixes: b752ea0c28 ("perf/x86/intel/ds: Flush PEBS DS when changing PEBS_DATA_CFG")
Signed-off-by: Dapeng Mi <dapeng1.mi@linux.intel.com>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Link: https://patch.msgid.link/20260813064346.335458-1-dapeng1.mi@linux.intel.com
2026-09-10 10:22:50 +02:00
..
bts.c perf/x86/intel: Use early_initcall() to hook bts_init() 2025-08-21 20:09:26 +02:00
core.c perf/x86/intel: Prevent drain_pebs() reentry 2026-09-10 10:22:50 +02:00
cstate.c perf/x86/cstate: Add Airmont NP 2025-12-17 13:31:09 +01:00
ds.c perf/x86/intel: Prevent drain_pebs() reentry 2026-09-10 10:22:50 +02:00
knc.c x86/irq: Make irqstats array based 2026-05-26 16:21:12 +02:00
lbr.c - Get rid of static_cpu_has() - one less API to care about testing CPU 2026-08-18 19:09:42 -07:00
Makefile perf/x86/intel/uncore: Parse uncore discovery tables 2021-04-02 10:04:54 +02:00
p4.c x86/irq: Make irqstats array based 2026-05-26 16:21:12 +02:00
p6.c perf/x86: Use macros to replace magic numbers in attr_rdpmc 2026-01-15 10:04:27 +01:00
pt.c perf/x86/intel/pt: Fix stop/start with no update 2026-08-07 18:27:06 +02:00
pt.h perf/x86/intel/pt: Drop kernel-doc for deleted struct members 2026-07-31 11:44:23 +02:00
uncore_discovery.c perf/x86/intel/uncore: Let init_box() callback report failures 2026-06-30 10:57:03 +02:00
uncore_discovery.h perf/x86/intel/uncore: Let init_box() callback report failures 2026-06-30 10:57:03 +02:00
uncore_nhmex.c perf/x86/intel/uncore: Let init_box() callback report failures 2026-06-30 10:57:03 +02:00
uncore_snb.c perf/x86/intel/uncore: Introduce PMU flags and broken state 2026-06-30 10:57:04 +02:00
uncore_snbep.c perf/x86/intel/uncore: Let init_box() callback report failures 2026-06-30 10:57:03 +02:00
uncore.c bitmap updates for v7.3 2026-08-20 11:41:46 -07:00
uncore.h perf/x86/intel/uncore: Implement lazy setup for MSR/MMIO PMUs 2026-06-30 10:57:05 +02:00