Chi Wu 973a5a0522 UPSTREAM: mm/page-writeback: Fix performance when BDI's share of ratio is 0. ... Fix performance when BDI's share of ratio is 0. The issue is similar to commit 74d3694433 ("writeback: Fix performance regression in wb_over_bg_thresh()"). Balance_dirty_pages and the writeback worker will also disagree on whether writeback when a BDI uses BDI_CAP_STRICTLIMIT and BDI's share of the thresh ratio is zero. For example, A thread on cpu0 writes 32 pages and then balance_dirty_pages, it will wake up background writeback and pauses because wb_dirty > wb->wb_thresh = 0 (share of thresh ratio is zero). A thread may runs on cpu0 again because scheduler prefers pre_cpu. Then writeback worker may runs on other cpus(1,2..) which causes the value of wb_stat(wb, WB_RECLAIMABLE) in wb_over_bg_thresh is 0 and does not writeback and returns. Thus, balance_dirty_pages keeps looping, sleeping and then waking up the worker who will do nothing. It remains stuck in this state until the writeback worker hit the right dirty cpu or the dirty pages expire. The fix that we should get the wb_stat_sum radically when thresh is low. Link: https://lkml.kernel.org/r/20210428225046.16301-1-wuchi.zero@gmail.com Change-Id: I920e60cd938049641eda70885b069e36200fe153 Signed-off-by: Chi Wu <wuchi.zero@gmail.com> Reviewed-by: Jan Kara <jack@suse.cz> Cc: Tejun Heo <tj@kernel.org> Cc: Miklos Szeredi <mszeredi@redhat.com> Cc: Sedat Dilek <sedat.dilek@gmail.com> Cc: Jens Axboe <axboe@fb.com> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org> Signed-off-by: Tao Huang <huangtao@rock-chips.com> (cherry picked from commit ab19939a6a)		2023-01-08 15:01:36 +08:00
..
damon	FROMLIST: mm/damon/reclaim: Fix the timer always stays active	2022-04-28 23:09:18 +08:00
kasan	UPSTREAM: arm64: kasan: mte: use a constant kernel GCR_EL1 value	2021-10-01 09:39:35 -07:00
kfence	UPSTREAM: kfence: fix memory leak when cat kfence objects	2022-02-11 17:30:26 -08:00
backing-dev.c	mm: bdi: initialize bdi_min_ratio when bdi is unregistered	2021-12-14 11:32:37 +01:00
balloon_compaction.c
cleancache.c
cma_debug_bitmap_hex.c	mm/cma: cma debugfs add bitmap_hex node	2022-03-16 15:54:52 +08:00
cma_debug.c	FROMLIST: mm: cma: introduce gfp flag in cma_alloc instead of no_warn	2021-01-25 12:21:02 -08:00
cma_sysfs.c	ANDROID: make cma_sysfs experimental	2021-03-25 19:20:18 +00:00
cma.c	mm: cma: add CmaAllocated/CmaReleased info for meminfo node	2022-09-27 17:05:11 +08:00
cma.h	ANDROID: GKI: add OEM data in cma struct	2021-06-04 11:15:16 -07:00
compaction.c	UPSTREAM: mm/compaction: correct deferral logic for proactive compaction	2021-07-21 22:18:24 +00:00
debug_page_ref.c
debug_vm_pgtable.c	mm/debug_vm_pgtable: remove pte entry from the page table	2022-02-08 18:30:35 +01:00
debug.c	ANDROID: mm: introduce page_pinner	2021-04-30 09:13:34 -07:00
dmapool.c	mm/dmapool.c: replace hard coded function name with __func__	2020-10-13 18:38:32 -07:00
early_ioremap.c
fadvise.c
failslab.c
filemap.c	ANDROID: mm: unlock the page on speculative fault retry	2021-09-14 17:43:45 +00:00
frame_vector.c
frontswap.c
gup_benchmark.c	mm/gup_benchmark: take the mmap lock around GUP	2020-10-18 09:27:09 -07:00
gup.c	UPSTREAM: mm/gup: remove the vma allocation from gup_longterm_locked()	2021-12-09 19:39:42 +00:00
highmem.c	mm/highmem.c: clean up endif comments	2020-10-16 11:11:18 -07:00
hmm.c	mm/hmm.c: allow VM_MIXEDMAP to work with hmm_range_fault	2022-01-27 10:54:36 +01:00
huge_memory.c	This is the 5.10.53 stable release	2021-07-25 15:37:14 +02:00
hugetlb_cgroup.c	hugetlb_cgroup: fix imbalanced css_get and css_put pair for shared mappings	2021-03-30 14:31:54 +02:00
hugetlb.c	This is the 5.10.82 stable release	2021-11-26 15:37:44 +01:00
hwpoison-inject.c	mm,hwpoison-inject: don't pin for hwpoison_filter	2020-10-16 11:11:16 -07:00
init-mm.c	FROMLIST: mm: protect mm_rb tree with a rwlock	2021-01-22 18:00:57 +00:00
internal.h	Linux 5.10.47	2021-06-30 19:38:46 +02:00
interval_tree.c
ioremap.c
Kconfig	Merge tag 'ASB-2022-05-05_12-5.10' of https://android.googlesource.com/kernel/common	2022-07-15 17:46:01 +08:00
Kconfig.debug	ANDROID: mm: introduce page_pinner	2021-04-30 09:13:34 -07:00
khugepaged.c	This is the 5.10.78 stable release	2021-11-06 14:22:24 +01:00
kmemleak.c	This is the 5.10.110 stable release	2022-04-18 17:41:18 +02:00
ksm.c	Merge 5.10.38 into android12-5.10	2021-05-20 15:35:25 +02:00
list_lru.c	mm: list_lru: set shrinker map bit when child nr_items is not zero	2020-12-06 10:19:07 -08:00
maccess.c
madvise.c	ANDROID: vendor_hooks: Add hooks to madvise_cold_or_pageout_pte_range()	2022-06-30 03:00:23 +00:00
Makefile	Merge tag 'ASB-2022-05-05_12-5.10' of https://android.googlesource.com/kernel/common	2022-07-15 17:46:01 +08:00
mapping_dirty_helpers.c
memblock.c	Merge tag 'ASB-2022-06-05_12-5.10' of https://android.googlesource.com/kernel/common	2022-07-15 17:58:38 +08:00
memcontrol.c	This is the 5.10.110 stable release	2022-04-18 17:41:18 +02:00
memfd.c	memfd: fix F_SEAL_WRITE after shmem huge page allocated	2022-03-08 19:09:36 +01:00
memory_hotplug.c	BACKPORT: mm/memory_hotplug: fix potential permanent lru cache disable	2022-02-11 17:30:23 -08:00
memory-failure.c	mm/hwpoison: clear MF_COUNT_INCREASED before retrying get_any_page()	2021-12-29 12:26:05 +01:00
memory.c	ANDROID: vendor_hook: Add hook in handle_pte_fault()	2022-06-30 03:00:23 +00:00
mempolicy.c	This is the 5.10.110 stable release	2022-04-18 17:41:18 +02:00
mempool.c	FROMGIT: kasan: use separate (un)poison implementation for integrated init	2021-06-17 14:39:37 -07:00
memremap.c	mm: fix memory_failure() handling of dax-namespace metadata	2021-03-04 11:38:21 +01:00
memtest.c
migrate.c	ANDROID: vendor_hook: Add hook in migrate_page_states()	2022-06-30 03:00:23 +00:00
mincore.c
mlock.c	ANDROID: mm: page_pinner: unattribute follow_page in munlock_vma_pages_range	2021-04-30 09:13:35 -07:00
mm_init.c
mmap.c	This is the 5.10.110 stable release	2022-04-18 17:41:18 +02:00
mmu_gather.c
mmu_notifier.c	ANDROID: fix ABI breakage caused by mm_struct->mmu_notifier_lock addition	2021-12-15 21:45:28 +00:00
mmzone.c	ANDROID: mm: export zone_watermark_ok	2021-02-25 19:36:38 +00:00
mprotect.c	This is the 5.10.102 stable release	2022-02-23 12:56:37 +01:00
mremap.c	UPSTREAM: mm/mremap: fix BUILD_BUG_ON() error in get_extent	2021-10-21 08:33:12 -07:00
msync.c
nommu.c	ANDROID: mm: allow vmas with vm_ops to be speculatively handled	2021-04-23 18:42:39 -07:00
oom_kill.c	Merge tag 'android12-5.10.81_r00' into android12-5.10	2022-01-21 09:35:04 +01:00
page_alloc.c	Merge tag 'ASB-2022-07-05_12-5.10' of https://android.googlesource.com/kernel/common	2022-07-15 18:11:10 +08:00
page_counter.c	mm/page_counter: correct the obsolete func name in the comment of page_counter_try_charge()	2020-10-13 18:38:30 -07:00
page_ext.c	Merge tag 'ASB-2022-05-05_12-5.10' of https://android.googlesource.com/kernel/common	2022-07-15 17:46:01 +08:00
page_idle.c	UPSTREAM: mm/idle_page_tracking: make PG_idle reusable	2022-04-28 23:09:14 +08:00
page_io.c	ANDROID: vendor_hooks: Add hooks to record the I/O statistics of swap:	2022-06-30 03:00:23 +00:00
page_isolation.c	mm/page_isolation.c: dump page owner if fail to isolate	2022-09-28 18:10:02 +08:00
page_owner.c	ANDROID: mm: Make page_owner_enabled global	2021-04-01 00:09:00 +00:00
page_pinner.c	ANDROID: mm: page_pinner: fix build warning	2022-03-10 21:35:16 +00:00
page_poison.c	UPSTREAM: kasan: fix conflict with page poisoning	2021-07-19 20:39:17 +00:00
page_reporting.c	mm: rename page_order() to buddy_order()	2020-10-16 11:11:19 -07:00
page_reporting.h
page_vma_mapped.c	mm/thp: another PVMW_SYNC fix in page_vma_mapped_walk()	2021-06-30 08:47:29 -04:00
page-writeback.c	UPSTREAM: mm/page-writeback: Fix performance when BDI's share of ratio is 0.	2023-01-08 15:01:36 +08:00
pagewalk.c	ANDROID: export walk_page_range and swp_swap_info	2022-03-29 17:40:45 +00:00
percpu-internal.h	percpu: make pcpu_nr_empty_pop_pages per chunk type	2021-04-14 08:42:03 +02:00
percpu-km.c
percpu-stats.c	percpu: make pcpu_nr_empty_pop_pages per chunk type	2021-04-14 08:42:03 +02:00
percpu-vm.c
percpu.c	Merge 5.10.30 into android12-5.10	2021-04-15 14:23:41 +02:00
pgalloc-track.h
pgtable-generic.c	mm/thp: fix __split_huge_pmd_locked() on shmem migration entry	2021-06-30 08:47:26 -04:00
process_vm_access.c	mm/process_vm_access.c: include compat.h	2021-01-19 18:27:21 +01:00
ptdump.c	This is the 5.10.32 stable release	2021-04-22 11:12:08 +02:00
readahead.c	ANDROID: add for tuning readahead size	2022-04-24 10:53:17 +00:00
rmap.c	ANDROID: vendor_hook: Add hook in page_referenced_one()	2022-06-30 03:00:23 +00:00
rodata_test.c
shmem.c	ANDROID: mm: Fix implicit declaration of function 'isolate_lru_page'	2022-03-31 19:58:24 +00:00
shuffle.c	mm: rename page_order() to buddy_order()	2020-10-16 11:11:19 -07:00
shuffle.h
slab_common.c	Revert half of "ANDROID: vendor_hooks: Add hooks for memory when debug"	2022-01-21 13:11:10 +01:00
slab.c	Merge 5.10.37 into android12-5.10	2021-05-15 09:28:55 +02:00
slab.h	This is the 5.10.82 stable release	2021-11-26 15:37:44 +01:00
slob.c
slub.c	Merge tag 'ASB-2022-04-05_12-5.10' of https://android.googlesource.com/kernel/common	2022-07-15 17:40:39 +08:00
sparse-vmemmap.c
sparse.c	mm/sparse: add the missing sparse_buffer_fini() in error branch	2021-05-14 09:50:45 +02:00
swap_cgroup.c
swap_slots.c	ANDROID: create and export is_swap_slot_cache_enabled	2022-06-30 03:00:23 +00:00
swap_state.c	This is the 5.10.108 stable release	2022-03-23 12:30:33 +01:00
swap.c	BACKPORT: UPSTREAM: mm: fs: invalidate bh_lrus for only cold path	2021-09-27 17:48:37 -07:00
swapfile.c	ANDROID: mm: export swapcache_free_entries	2022-06-30 03:00:23 +00:00
truncate.c	mm/thp: unmap_mapping_page() to fix THP truncate_cleanup_page()	2021-06-30 08:47:27 -04:00
usercopy.c	mm/usercopy: return 1 from hardened_usercopy __setup() handler	2022-04-08 14:40:43 +02:00
userfaultfd.c	FROMGIT: userfaultfd/shmem: modify shmem_mfill_atomic_pte to use install_pte()	2021-06-04 19:13:10 +00:00
util.c	This is the 5.10.104 stable release	2022-03-12 13:57:09 +01:00
vmacache.c
vmalloc.c	UPSTREAM: mm: vmalloc: prevent use after free in _vm_unmap_aliases	2021-11-09 17:29:42 +00:00
vmpressure.c	FROMLIST: mm, memcg: add mem_cgroup_disabled checks in vmpressure and swap-related functions	2021-07-12 18:26:15 -07:00
vmscan.c	ANDROID: vendor_hook: Add hook in snapshot_refaults()	2022-06-30 03:00:23 +00:00
vmstat.c	ANDROID: mm: allow vmas with vm_ops to be speculatively handled	2021-04-23 18:42:39 -07:00
workingset.c	XArray updates for 5.9	2020-10-20 14:39:37 -07:00
z3fold.c	mm/z3fold: use release_z3fold_page_locked() to release locked z3fold page	2021-07-14 16:56:51 +02:00
zbud.c	mm/zbud: remove redundant initialization	2020-10-13 18:38:34 -07:00
zpool.c
zsmalloc.c	This is the 5.10.80 stable release	2021-11-19 11:50:41 +01:00
zswap.c