virt: Introduce steal governor driver

Introduce a new driver in virt named steal_governor. This driver
will compute the steal time and drive the policy decisions regarding the
preferred CPU state.

Note that this driver is strictly intended for actual guests. Hence
block it on Xen dom0.
More details can be found in Documentation/driver-api/steal-governor.rst.

A new kconfig called STEAL_GOVERNOR is introduced in subsequent patches,
which enables this driver. This driver will select CONFIG_PREFERRED_CPU.
This makes configs driven by user preference/configuration.
When the driver is disabled, preferred CPUs remain the same as active CPUs.

The file layout of the driver is kept simple for now. The code is in
drivers/virt/steal_governor.c, and the configs are part of
drivers/virt/Kconfig.

The main structure of the steal governor contains:
- work, delay: Deferred periodic work function variables.
- steal, time: Used to calculate deltas during periodic work.
- interval_ms, high_threshold, low_threshold: Tuning knobs for the
  steal governor.

While there, add MAINTAINERS entry for this new driver.

Suggested-by: Yury Norov <yury.norov@gmail.com>
Suggested-by: K Prateek Nayak <kprateek.nayak@amd.com>
Signed-off-by: Shrikanth Hegde <sshegde@linux.ibm.com>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Link: https://patch.msgid.link/20260928053728.797539-11-sshegde@linux.ibm.com
This commit is contained in:
Shrikanth Hegde 2026-09-28 11:07:25 +05:30 committed by Peter Zijlstra
parent 68957caaa9
commit 9a8e740ee9
4 changed files with 239 additions and 0 deletions

View File

@ -139,6 +139,7 @@ Subsystem-specific APIs
sm501
soundwire/index
spi
steal-governor
surface_aggregator/index
switchtec
sync_file

View File

@ -0,0 +1,151 @@
.. SPDX-License-Identifier: GPL-2.0
Steal Governor
==============
:Author: Shrikanth Hegde <sshegde@linux.ibm.com>
Introduction
============
The steal governor is aimed at mitigating the Noisy Neighbour problem
which occurs in paravirtualized environments with CPU overcommit.
The performance of a workload running in one VM gets degraded by
the activity of other VMs on the same host. As a result, all VMs
collectively make slower forward progress.
In such systems, high utilization in all VMs causes the hypervisor to
frequently preempt vCPUs. This vCPU preemption is expensive.
To mitigate this, the kernel aims to restrict workloads to a subset of
Preferred CPUs to reduce physical CPU contention.
A detailed explanation of Preferred CPUs is available in
``Documentation/scheduler/sched-paravirt.rst``.
The steal governor selects ``CONFIG_PREFERRED_CPU=y`` which enables the
scheduler core infrastructure to move the tasks to Preferred CPUs where
possible. The driver controls the policy decisions regarding the state of
preferred CPUs. That is, this driver decides which CPUs are preferred
and which CPUs are non-preferred.
The driver code is available at ``drivers/virt/steal_governor.c``.
Core idea
=========
steal time is an indication available today in Guest which shows contention
for underlying physical CPU. Use it as a hint in the guest to fold the
workload to a reduced set of vCPUs. When there is contention, steal time
will show up in all the guests. When each guest honors the hint and folds
the workload to a smaller set of vCPUs (Preferred CPUs), it reduces the
contention and thereby reduces vCPU preemption.
This is achieved without any cross-guest communication.
Steal governor driver effectively does:
1. Periodically computes the steal ratio using accumulated steal time
across possible CPUs, normalized by the number of active CPUs.
2. If steal ratio is greater than high threshold, reduce the number of
preferred CPUs by 1 core. Ensure at least one core is left always.
Skip changing the state of offline CPUs in that core.
3. If steal ratio is less than or equal to low threshold, increase the
number of preferred CPUs by 1 core. If preferred is same as active,
nothing to be done. Skip changing the state of offline CPUs.
This helps to handle cases where few CPUs are offline in a core and
those offline CPUs will not be marked as preferred.
4. Ensure preferred CPUs is always subset of active CPUs.
On feature disable it is same as active CPUs.
This feature works best only when all the VMs enable the feature as
it is a co-operative scheme. If a specific VM doesn't enable this feature
it may end up with more CPUs than others, still should lead to better
performance when seen from system view. Those who enable this driver must
ensure it is enabled in all VMs.
Note that this driver is strictly intended for actual guests; for example,
loading this module in a privileged VM like Xen Dom0 is blocked.
Workload considerations
=======================
The steal governor is useful for workloads where vCPU preemption has
costs beyond the lost CPU time, such as lock-holder preemption, critical
sections, communicating threads, and cache or TLB disruption.
Pure CPU-time workloads with independent workers may not benefit and
could see a small regression due to additional guest scheduling overhead.
Module Parameters
=================
interval_ms
-----------
How often steal governor checks for steal time.
Default: 1000 i.e. 1 second. Value should be in between 100ms to 100sec.
This controls how fast steal governor driver reacts to changes to the
contention of physical CPUs. Since it does a fair amount of work, setting
too low may have overhead. Setting it too high might render it ineffective.
low_threshold
-------------
lower threshold value in percentage * 100.
Default: 200, i.e. 2% steal is considered as low threshold.
Can't be higher than high_threshold.
This determines what values should be considered as nil/no steal values.
When steal governor sees steal ratio is less than or equal to this value,
it will increase the preferred CPUs by 1 core.
Using zero might cause oscillations.
high_threshold
--------------
higher threshold value in percentage * 100
Default: 500, i.e. 5% steal is considered as high threshold.
Can't be lower than low_threshold. Must be less than 10000.
This determines what values should be considered as high steal values.
When steal governor sees steal ratio is higher than this value, it will
reduce the preferred CPUs by 1 core.
Limitations of default values
-----------------------------
Because of the vast diversity in VM configurations and different
architectures, the default thresholds may not be optimal for all systems.
Users may need to tune these parameters based on the system under
test to achieve the best results.
The governor sums the steal time across all possible CPUs, which ensures
the accumulated steal time remains a monotonically increasing value.
However, to calculate the effective steal ratio, it divides this sum
by the number of active CPUs. Because only active CPUs contribute to
the steal time delta, this prevents threshold dilution on sparsely
populated systems.
The driver reduces/increases preferred CPUs by core-level. This could provide
faster convergence for hypervisors such as powerVM. But on KVM and Xen
convergence could be slower depending on the configuration.
Using a smaller interval_ms could help one to expedite it.
Reasons for CONFIG_STEAL_GOVERNOR=m
===================================
Selecting this driver makes CONFIG_PREFERRED_CPU=y. That makes configs
driven by user preference. Though one can have CONFIG_STEAL_GOVERNOR=y,
It is recommended to build CONFIG_STEAL_GOVERNOR=m due to below reasons:
1. Doing periodic work has additional overheads. Enabling this driver
in systems where steal time cannot happen is of no use. There is no
benefit with additional overheads in such systems.
2. This works well when all VMs work in a co-operative manner. When an
administrative user enables it in one VM, he/she will likely enable
it in all VMs.
3. User can tweak the module parameters by reloading the module.

View File

@ -26223,6 +26223,15 @@ F: rust/helpers/jump_label.c
F: rust/kernel/generated_arch_static_branch_asm.rs.S
F: rust/kernel/jump_label.rs
STEAL GOVERNOR DRIVER
M: Shrikanth Hegde <sshegde@linux.ibm.com>
R: Yury Norov <yury.norov@gmail.com>
L: linux-kernel@vger.kernel.org
S: Maintained
T: git git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git sched/core
F: Documentation/driver-api/steal-governor.rst
F: drivers/virt/steal_governor.c
STI AUDIO (ASoC) DRIVERS
M: Arnaud Pouliquen <arnaud.pouliquen@foss.st.com>
L: linux-sound@vger.kernel.org

View File

@ -0,0 +1,78 @@
// SPDX-License-Identifier: GPL-2.0-only
/*
* Steal time governor driver periodically computes steal time.
* Based on the thresholds it either reduce/increase the preferred
* CPUs which can be used by the workload to avoid vCPU preemption
* to an extent possible in paravirtualized environment.
*
* Available with CONFIG_STEAL_GOVERNOR
*
* Copyright (C) 2026 IBM
* Author: Shrikanth Hegde <sshegde@linux.ibm.com>
*/
#define pr_fmt(fmt) KBUILD_MODNAME ": " fmt
#include <linux/cpuhplock.h>
#include <linux/cpumask.h>
#include <linux/init.h>
#include <linux/kernel.h>
#include <linux/kconfig.h>
#include <linux/ktime.h>
#include <linux/module.h>
#include <linux/types.h>
#include <linux/workqueue.h>
#ifdef CONFIG_XEN
#include <xen/xen.h>
#endif
#if !IS_ENABLED(CONFIG_PREFERRED_CPU)
#error "Steal Governor requires CONFIG_PREFERRED_CPU"
#endif
struct steal_governor {
ktime_t time;
u64 steal;
unsigned long delay;
unsigned int interval_ms;
unsigned int high_threshold;
unsigned int low_threshold;
struct delayed_work work;
};
static struct steal_governor sg_ctx;
static void restore_preferred_to_active(void)
{
int cpu;
guard(cpus_read_lock)();
for_each_cpu(cpu, cpu_active_mask)
set_cpu_preferred(cpu, true);
}
static int __init steal_governor_init(void)
{
#ifdef CONFIG_XEN
if (xen_initial_domain()) {
pr_err("Cannot load in Xen Dom0 (Host OS). Driver is for guests only.\n");
return -ENODEV;
}
#endif
pr_info("enabled\n");
return 0;
}
static void __exit steal_governor_exit(void)
{
restore_preferred_to_active();
pr_info("disabled\n");
}
module_init(steal_governor_init);
module_exit(steal_governor_exit);
MODULE_LICENSE("GPL");
MODULE_AUTHOR("IBM Corporation");
MODULE_DESCRIPTION("Virtualization Steal Time Governor");