linux/include
Andrey Konovalov ef8fe2476d FROMGIT: kasan, mm: don't save alloc stacks twice
Patch series "kasan: optimizations and fixes for HW_TAGS", v4.

This patchset makes the HW_TAGS mode more efficient, mostly by reworking
poisoning approaches and simplifying/inlining some internal helpers.

With this change, the overhead of HW_TAGS annotations excluding setting
and checking memory tags is ~3%.  The performance impact caused by tags
will be unknown until we have hardware that supports MTE.

As a side-effect, this patchset speeds up generic KASAN by ~15%.

This patch (of 13):

Currently KASAN saves allocation stacks in both kasan_slab_alloc() and
kasan_kmalloc() annotations.  This patch changes KASAN to save allocation
stacks for slab objects from kmalloc caches in kasan_kmalloc() only, and
stacks for other slab objects in kasan_slab_alloc() only.

This change requires ____kasan_kmalloc() knowing whether the object
belongs to a kmalloc cache.  This is implemented by adding a flag field to
the kasan_info structure.  That flag is only set for kmalloc caches via a
new kasan_cache_create_kmalloc() annotation.

Link: https://lkml.kernel.org/r/cover.1612546384.git.andreyknvl@google.com
Link: https://lkml.kernel.org/r/7c673ebca8d00f40a7ad6f04ab9a2bddeeae2097.1612546384.git.andreyknvl@google.com
Signed-off-by: Andrey Konovalov <andreyknvl@google.com>
Reviewed-by: Marco Elver <elver@google.com>
Cc: Catalin Marinas <catalin.marinas@arm.com>
Cc: Vincenzo Frascino <vincenzo.frascino@arm.com>
Cc: Dmitry Vyukov <dvyukov@google.com>
Cc: Alexander Potapenko <glider@google.com>
Cc: Will Deacon <will.deacon@arm.com>
Cc: Andrey Ryabinin <aryabinin@virtuozzo.com>
Cc: Peter Collingbourne <pcc@google.com>
Cc: Evgenii Stepanov <eugenis@google.com>
Cc: Branislav Rankov <Branislav.Rankov@arm.com>
Cc: Kevin Brodsky <kevin.brodsky@arm.com>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Stephen Rothwell <sfr@canb.auug.org.au>
(cherry picked from commit 4148624e017d86a9443238b71261afd950a54021
 https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git akpm)
Bug: 172318110
Change-Id: Ifa1dd4f0af652b03777daed60a012588c71f0123
2021-02-16 15:33:31 +01:00
..
acpi PM: ACPI: PCI: Drop acpi_pm_set_bridge_wakeup() 2020-12-30 11:54:05 +01:00
asm-generic FROMGIT: asm-generic: export: Stub EXPORT_SYMBOL with __DISABLE_EXPORTS 2021-02-05 17:37:36 +00:00
clocksource
crypto
drm This is the 5.10.15 stable release 2021-02-10 09:53:50 +01:00
dt-bindings UPSTREAM: dt-bindings: connector: Add SVDM VDO properties 2021-02-09 11:55:09 +01:00
keys
kunit kunit: fix display of failed expectations for strings 2020-11-10 13:45:15 -07:00
kvm UPSTREAM: KVM: arm64: Replace KVM_ARM_PMU with HW_PERF_EVENTS 2021-01-28 17:57:18 +00:00
linux FROMGIT: kasan, mm: don't save alloc stacks twice 2021-02-16 15:33:31 +01:00
math-emu
media Merge 5.10.4 into android12-5.10 2020-12-30 12:47:03 +01:00
memory
misc
net This is the 5.10.15 stable release 2021-02-10 09:53:50 +01:00
pcmcia
ras
rdma RDMA/core: remove use of dma_virt_ops 2021-01-09 13:46:24 +01:00
scsi scsi: libiscsi: Fix NOP race condition 2020-11-16 22:32:50 -05:00
soc net: mscc: ocelot: fix dropping of unknown IPv4 multicast on Seville 2020-12-05 15:41:34 -08:00
sound Merge 27bba9c532 ("Merge tag 'scsi-fixes' of git://git.kernel.org/pub/scm/linux/kernel/git/jejb/scsi") into android-mainline 2020-11-22 10:00:49 +01:00
target
trace ANDROID: iommu: Add vendor hook 2021-02-10 01:54:31 +00:00
uapi UPSTREAM: userfaultfd: add UFFD_USER_MODE_ONLY 2021-02-05 13:14:00 +00:00
vdso
video gpu: ipu-v3: remove unused functions 2020-10-26 10:42:38 +01:00
xen xen: Fix event channel callback via INTX/GSI 2021-01-27 11:55:00 +01:00