Kumar Kartikeya Dwivedi f2ac0e5d1c bpf: Convert percpu_freelist.c to rqspinlock ... Convert the percpu_freelist.c code to use rqspinlock, and remove the extralist fallback and trylock-based acquisitions to avoid deadlocks. Key thing to note is the retained while (true) loop to search through other CPUs when failing to push a node due to locking errors. This retains the behavior of the old code, where it would keep trying until it would be able to successfully push the node back into the freelist of a CPU. Technically, we should start iteration for this loop from raw_smp_processor_id() + 1, but to avoid hitting the edge of nr_cpus, we skip execution in the loop body instead. Closes: https://lore.kernel.org/bpf/CAPPBnEa1_pZ6W24+WwtcNFvTUHTHO7KUmzEbOcMqxp+m2o15qQ@mail.gmail.com Closes: https://lore.kernel.org/bpf/CAPPBnEYm+9zduStsZaDnq93q1jPLqO-PiKX9jy0MuL8LCXmCrQ@mail.gmail.com Signed-off-by: Kumar Kartikeya Dwivedi <memxor@gmail.com> Link: https://lore.kernel.org/r/20250316040541.108729-21-memxor@gmail.com Signed-off-by: Alexei Starovoitov <ast@kernel.org>		2025-03-19 08:03:05 -07:00
..
preload	bpf: preload: Add MODULE_DESCRIPTION	2025-03-15 11:48:58 -07:00
arena.c	Merge git://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf bpf-6.14-rc4	2025-02-20 18:13:57 -08:00
arraymap.c	bpf: Remove migrate_{disable|enable} in ->map_for_each_callback	2025-01-08 18:06:35 -08:00
bloom_filter.c	bpf: Check bloom filter map value size	2024-03-27 09:56:17 -07:00
bpf_cgrp_storage.c	bpf: Fix deadlock when freeing cgroup storage	2025-01-29 18:38:19 -08:00
bpf_inode_storage.c	bpf: Disable migration when destroying inode storage	2025-01-08 18:06:36 -08:00
bpf_iter.c	bpf: Make every prog keep a copy of ctx_arg_info	2025-02-17 18:47:27 -08:00
bpf_local_storage.c	bpf: Remove migrate_{disable|enable} from bpf_selem_free()	2025-01-08 18:06:37 -08:00
bpf_lru_list.c
bpf_lru_list.h
bpf_lsm.c	bpf: lsm: Add two more sleepable hooks	2025-02-13 19:35:31 -08:00
bpf_struct_ops.c	bpf: Allow struct_ops prog to return referenced kptr	2025-02-17 18:47:27 -08:00
bpf_task_storage.c	bpf: Remove migrate_{disable|enable} from bpf_task_storage_lock helpers	2025-01-08 18:06:36 -08:00
btf_iter.c	bpf: Remove custom build rule	2024-08-30 08:55:26 -07:00
btf_relocate.c	bpf: Remove custom build rule	2024-08-30 08:55:26 -07:00
btf.c	selftests/bpf: Test gen_pro/epilogue that generate kfuncs	2025-02-25 19:04:43 -08:00
cgroup_iter.c
cgroup.c	bpf: Allow pre-ordering for bpf cgroup progs	2025-03-15 11:48:25 -07:00
core.c	bpf: Make perf_event_read_output accessible in all program types.	2025-03-18 10:21:59 -07:00
cpumap.c	xdp: get rid of xdp_frame::mem.id	2024-12-12 18:22:52 -08:00
cpumask.c	bpf: fix missing kdoc string fields in cpumask.c	2025-03-15 11:48:57 -07:00
crypto.c	bpf: crypto: make state and IV dynptr nullable	2024-06-13 16:33:04 -07:00
devmap.c	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2024-12-12 14:19:05 -08:00
disasm.c	bpftool: Using the right format specifiers	2025-03-17 13:50:56 -07:00
disasm.h
dispatcher.c	bpf: Add kernel symbol for struct_ops trampoline	2024-11-12 17:13:46 -08:00
hashtab.c	bpf: Convert hashtab.c to rqspinlock	2025-03-19 08:03:05 -07:00
helpers.c	bpf: Make perf_event_read_output accessible in all program types.	2025-03-18 10:21:59 -07:00
inode.c	bpf: Preserve param->string when parsing mount options	2024-10-22 12:56:38 -07:00
Kconfig	bpf: remove CONFIG_BPF_JIT dependency on CONFIG_MODULES of	2024-05-14 00:36:29 -07:00
kmem_cache_iter.c	bpf: Add open coded version of kmem_cache iterator	2024-11-01 11:08:32 -07:00
link_iter.c
local_storage.c	bpf: Replace 8 seq_puts() calls by seq_putc() calls	2024-07-29 12:53:00 -07:00
log.c	bpf: Introduce support for bpf_local_irq_{save,restore}	2024-12-04 08:38:29 -08:00
lpm_trie.c	bpf: Remove migrate_{disable|enable} from LPM trie	2025-01-08 18:06:35 -08:00
Makefile	rqspinlock: Add entry to Makefile, MAINTAINERS	2025-03-19 08:03:05 -07:00
map_in_map.c	bpf: switch maps to CLASS(fd, ...)	2024-08-13 15:58:17 -07:00
map_in_map.h	bpf: Add map and need_defer parameters to .map_fd_put_ptr()	2023-12-04 17:50:26 -08:00
map_iter.c	bpf: treewide: Annotate BPF kfuncs in BTF	2024-01-31 20:40:56 -08:00
memalloc.c	Merge git://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf	2024-11-13 12:52:51 -08:00
mmap_unlock_work.h
mprog.c
net_namespace.c
offload.c
percpu_freelist.c	bpf: Convert percpu_freelist.c to rqspinlock	2025-03-19 08:03:05 -07:00
percpu_freelist.h	bpf: Convert percpu_freelist.c to rqspinlock	2025-03-19 08:03:05 -07:00
prog_iter.c
queue_stack_maps.c
range_tree.c	bpf: Disable migration before calling ops->map_free()	2025-01-08 18:06:36 -08:00
range_tree.h	bpf: Introduce range_tree data structure and use it in bpf arena	2024-11-13 13:52:45 -08:00
relo_core.c	bpf: Remove custom build rule	2024-08-30 08:55:26 -07:00
reuseport_array.c	bpf: Use sockfd_put() helper	2024-08-30 08:57:47 -07:00
ringbuf.c	bpf: unify VM_WRITE vs VM_MAYWRITE use in BPF map mmaping logic	2025-01-29 09:49:50 -08:00
rqspinlock.c	rqspinlock: Add basic support for CONFIG_PARAVIRT	2025-03-19 08:03:05 -07:00
rqspinlock.h	rqspinlock: Protect waiters in queue from stalls	2025-03-19 08:03:05 -07:00
stackmap.c	bpf: wire up sleepable bpf_get_stack() and bpf_get_task_stack() helpers	2024-09-11 09:58:31 -07:00
syscall.c	bpf: Return prog btf_id without capable check	2025-03-17 13:45:12 -07:00
sysfs_btf.c	btf: Switch vmlinux BTF attribute to sysfs_bin_attr_simple_read()	2025-01-09 10:44:06 +01:00
task_iter.c	vfs-6.13.file	2024-11-18 10:30:29 -08:00
tcx.c
tnum.c	bpf: simplify tnum output if a fully known constant	2023-12-02 11:36:51 -08:00
token.c	remove pointless includes of <linux/fdtable.h>	2024-10-07 13:34:41 -04:00
trampoline.c	bpf: Add kernel symbol for struct_ops trampoline	2024-11-12 17:13:46 -08:00
verifier.c	bpf: correct use/def for may_goto instruction	2025-03-15 11:48:30 -07:00