linux/kernel/rcu
Paul E. McKenney 448b66a7aa refscale: Add non-atomic per-CPU increment readers
This commit adds refscale readers based on READ_ONCE() and WRITE_ONCE()
that are unprotected (can lose counts, "refscale.scale_type=incpercpu"),
preempt-disabled ("refscale.scale_type=incpercpupreempt"),
bh-disabled ("refscale.scale_type=incpercpubh"), and irq-disabled
("refscale.scale_type=incpercpuirqsave").  On my x86 laptop, these are
about 4.3ns, 3.8ns, and 7.3ns per pair, respectively.

Signed-off-by: Paul E. McKenney <paulmck@kernel.org>
Signed-off-by: Frederic Weisbecker <frederic@kernel.org>
2025-11-07 14:37:17 +01:00
..
Kconfig srcu: Make FORCE_NEED_SRCU_NMI_SAFE depend on RCU_EXPERT 2025-03-28 21:19:17 -07:00
Kconfig.debug rcutorture: Move RCU_TORTURE_TEST_{CHK_RDR_STATE,LOG_CPU} to bool 2025-02-05 07:14:40 -08:00
Makefile
rcu_segcblist.c rcu/nocb: Simplify (de-)offloading state machine 2024-09-09 00:03:55 +05:30
rcu_segcblist.h rcu: Remove unused declaration rcu_segcblist_offload() 2024-10-22 15:36:56 +02:00
rcu.h Merge branches 'rcu/misc-for-6.16', 'rcu/seq-counters-for-6.16' and 'rcu/torture-for-6.16' into rcu/for-next 2025-05-16 11:18:16 -04:00
rcuscale.c mm: replace (20 - PAGE_SHIFT) with common macros for pages<->MB conversion 2025-09-13 16:54:42 -07:00
rcutorture.c rcutorture: Use kcalloc() instead of kzalloc() 2025-08-22 06:26:22 -07:00
refscale.c refscale: Add non-atomic per-CPU increment readers 2025-11-07 14:37:17 +01:00
srcutiny.c srcu/tiny: Remove preempt_disable/enable() in srcu_gp_start_if_needed() 2025-09-15 05:16:28 -07:00
srcutree.c srcu: Document srcu_flip() memory-barrier D relation to SRCU-fast 2025-09-15 05:16:28 -07:00
sync.c rcu: Eliminate lockless accesses to rcu_sync->gp_count 2024-07-04 13:48:57 -07:00
tasks.h rcu: replace use of system_wq with system_percpu_wq 2025-09-23 02:01:18 -07:00
tiny.c RCU pull request for v6.15 2025-03-24 19:41:37 -07:00
tree_exp.h rcu/exp: Remove needless CPU up quiescent state report 2025-07-08 23:21:13 +05:30
tree_nocb.h rcu: Fix delayed execution of hurry callbacks 2025-07-18 09:25:34 +05:30
tree_plugin.h rcu: Remove local_irq_save/restore() in rcu_preempt_deferred_qs_handler() 2025-08-14 15:25:15 -07:00
tree_stall.h sched_ext: Changes for v6.17 2025-07-31 16:29:46 -07:00
tree.c hyperv-next for v6.18 2025-10-07 08:40:15 -07:00
tree.h rcu: Fix racy re-initialization of irq_work causing hangs 2025-08-11 08:43:49 +05:30
update.c torture: Add dowarn argument to torture_sched_setaffinity() 2024-12-14 16:38:23 +01:00