Skip to content

Commit defc8cc

Browse files
rananta468Marc Zyngier
authored andcommitted
KVM: arm64: Invalidate the table entries upon a range
Currently, during the operations such as a hugepage collapse, KVM would flush the entire VM's context using 'vmalls12e1is' TLBI operation. Specifically, if the VM is faulting on many hugepages (say after dirty-logging), it creates a performance penalty for the guest whose pages have already been faulted earlier as they would have to refill their TLBs again. Instead, leverage kvm_tlb_flush_vmid_range() for table entries. If the system supports it, only the required range will be flushed. Else, it'll fallback to the previous mechanism. Signed-off-by: Raghavendra Rao Ananta <rananta@google.com> Reviewed-by: Gavin Shan <gshan@redhat.com> Reviewed-by: Shaoqin Huang <shahuang@redhat.com> Signed-off-by: Marc Zyngier <maz@kernel.org> Link: https://lore.kernel.org/r/20230811045127.3308641-14-rananta@google.com
1 parent 3756b6f commit defc8cc

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

arch/arm64/kvm/hyp/pgtable.c

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -806,7 +806,8 @@ static bool stage2_try_break_pte(const struct kvm_pgtable_visit_ctx *ctx,
806806
* evicted pte value (if any).
807807
*/
808808
if (kvm_pte_table(ctx->old, ctx->level))
809-
kvm_call_hyp(__kvm_tlb_flush_vmid, mmu);
809+
kvm_tlb_flush_vmid_range(mmu, ctx->addr,
810+
kvm_granule_size(ctx->level));
810811
else if (kvm_pte_valid(ctx->old))
811812
kvm_call_hyp(__kvm_tlb_flush_vmid_ipa, mmu,
812813
ctx->addr, ctx->level);

0 commit comments

Comments
 (0)