From nobody Wed Jul 9 23:59:01 2025 Delivered-To: importer2@patchew.org Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer2=patchew.org@nongnu.org; dmarc=pass(p=quarantine dis=none) header.from=virtuozzo.com ARC-Seal: i=1; a=rsa-sha256; t=1721140960; cv=none; d=zohomail.com; s=zohoarc; b=l4fRJ1A1ihEr0Unbtrsy3NH4QnCK3hKPHQs3n/NfcRnvsNTZtPzh9Yh3XoZR2z+J9rNv+YWdCwr7/nEvj4NaZ3mkxxqpEVlw8ft54sWt0R7SfNUoPL21ScoeTF7Oe1ODtqCDm6YX9d+PwhXYtGrjs7PCZnYIkUo0r89AlFqmK5g= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1721140960; h=Content-Transfer-Encoding:Cc:Cc:Date:Date:From:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:Subject:To:To:Message-Id:Reply-To; bh=zSlK5i+1UayUSDO7XyqWtJIJ6Zp5SiN8t5JDdEYmRm4=; b=nTLMZiWSc4kV4Qv8t89yKc7UJ3DLTeIuF+dguEnnwjk4gjVmxv54DuAjuJZT27XzlYU1B7iErI8g3NS/rj0wbypybPIoZwIGwioGE32LXvwEtl9l5WuK8Tu2y1uQ1Y4rStF8mKXD1+/bjduxrsGRPbTwRt0PFYnEmCwRzSb2RwQ= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer2=patchew.org@nongnu.org; dmarc=pass header.from= (p=quarantine dis=none) Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1721140960409680.1173518273403; Tue, 16 Jul 2024 07:42:40 -0700 (PDT) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1sTjNE-0003Yn-86; Tue, 16 Jul 2024 10:41:48 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sTjN4-00035g-U9; Tue, 16 Jul 2024 10:41:40 -0400 Received: from relay.virtuozzo.com ([130.117.225.111]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sTjMy-0002go-4p; Tue, 16 Jul 2024 10:41:38 -0400 Received: from [130.117.225.1] (helo=dev005.ch-qa.vzint.dev) by relay.virtuozzo.com with esmtp (Exim 4.96) (envelope-from ) id 1sTjM2-00D0sH-03; Tue, 16 Jul 2024 16:41:14 +0200 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=virtuozzo.com; s=relay; h=MIME-Version:Message-Id:Date:Subject:From: Content-Type; bh=zSlK5i+1UayUSDO7XyqWtJIJ6Zp5SiN8t5JDdEYmRm4=; b=SAiE1j7XAVrr rwrO4cvDICGXGIZQRkHW6K1D0H4XnvyLXyhAejMZcRkaE+ZsyCCgX7oSSWjcfEBxF4Rk3nXjZsLrv 5Tl/O+4GjRxgbITcyGM+iIu4QDDyMAlklE9Ia7wylhRxPTPQR1cx0Cne2tfdNyCCKUcm0nsJA4ovh us6H6G41yq7tr5IbbF8TmnxxSlKKpDQpPIyCUUPYROFciP7vcx763bezJSZqQU43N0mLfw/z9ZlnW fkE81jaaWYtP4CP3o8433O/T759pYF68KikIZjfdgUE+ExeRr5rYgkjhWanYSPUFr+3dflDOSBPXu w/NmGYNyk1EtupO8WHRl0A==; From: Andrey Drobyshev To: qemu-block@nongnu.org Cc: qemu-devel@nongnu.org, hreitz@redhat.com, kwolf@redhat.com, vsementsov@yandex-team.ru, pbonzini@redhat.com, eesposit@redhat.com, andrey.drobyshev@virtuozzo.com, den@virtuozzo.com Subject: [PATCH v3 2/3] iotests/298: add testcase for async writes with preallocation filter Date: Tue, 16 Jul 2024 17:41:22 +0300 Message-Id: <20240716144123.651476-3-andrey.drobyshev@virtuozzo.com> X-Mailer: git-send-email 2.39.3 In-Reply-To: <20240716144123.651476-1-andrey.drobyshev@virtuozzo.com> References: <20240716144123.651476-1-andrey.drobyshev@virtuozzo.com> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer2=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=130.117.225.111; envelope-from=andrey.drobyshev@virtuozzo.com; helo=relay.virtuozzo.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+importer2=patchew.org@nongnu.org Sender: qemu-devel-bounces+importer2=patchew.org@nongnu.org X-ZohoMail-DKIM: pass (identity @virtuozzo.com) X-ZM-MESSAGEID: 1721140962766116300 Content-Type: text/plain; charset="utf-8" The testcase simply creates a 64G image with 1M clusters, generates a list of 1M aligned offsets and feeds aio_write commands with those offsets to qemu-io run with '--aio native --nocache'. Then we check the data written at each of the offsets. Before the previous commit this could result into a race within the preallocation filter which would zeroize some clusters after actually writing data to them. Note: the test doesn't fail in 100% cases as there's a race involved, but the failures are pretty consistent so it should be good enough for detecting the problem. Signed-off-by: Andrey Drobyshev --- tests/qemu-iotests/298 | 49 ++++++++++++++++++++++++++++++++++++++ tests/qemu-iotests/298.out | 4 ++-- 2 files changed, 51 insertions(+), 2 deletions(-) diff --git a/tests/qemu-iotests/298 b/tests/qemu-iotests/298 index 09c9290711..b7126e9e15 100755 --- a/tests/qemu-iotests/298 +++ b/tests/qemu-iotests/298 @@ -20,8 +20,10 @@ =20 import os import iotests +import random =20 MiB =3D 1024 * 1024 +GiB =3D MiB * 1024 disk =3D os.path.join(iotests.test_dir, 'disk') overlay =3D os.path.join(iotests.test_dir, 'overlay') refdisk =3D os.path.join(iotests.test_dir, 'refdisk') @@ -176,5 +178,52 @@ class TestTruncate(iotests.QMPTestCase): self.do_test('off', '150M') =20 =20 +class TestPreallocAsyncWrites(iotests.QMPTestCase): + def setUp(self): + # Make sure we get reproducible write patterns on each run + random.seed(42) + iotests.qemu_img_create('-f', iotests.imgfmt, disk, '-o', + f'cluster_size=3D{MiB},lazy_refcounts=3Don= ', + str(64 * GiB)) + + def tearDown(self): + os.remove(disk) + + def test_prealloc_async_writes(self): + def gen_write_pattern(): + n =3D 0 + while True: + yield '-P 0xaa' if n else '-z' + n =3D 1 - n + + def gen_read_pattern(): + n =3D 0 + while True: + yield '-P 0xaa' if n else '-P 0x00' + n =3D 1 - n + + requests =3D 2048 # Number of write/read requests to feed to qemu-= io + total_clusters =3D 64 * 1024 # 64G / 1M + + wpgen =3D gen_write_pattern() + rpgen =3D gen_read_pattern() + + offsets =3D random.sample(range(0, total_clusters), requests) + aio_write_cmds =3D [f'aio_write {next(wpgen)} {off}M 1M' for off i= n offsets] + read_cmds =3D [f'read {next(rpgen)} {off}M 1M' for off in offsets] + + proc =3D iotests.QemuIoInteractive('--aio', 'native', '--nocache', + '--image-opts', drive_opts) + for cmd in aio_write_cmds: + proc.cmd(cmd) + proc.close() + + proc =3D iotests.QemuIoInteractive('-f', iotests.imgfmt, disk) + for cmd in read_cmds: + out =3D proc.cmd(cmd) + self.assertFalse('Pattern verification failed' in str(out)) + proc.close() + + if __name__ =3D=3D '__main__': iotests.main(supported_fmts=3D['qcow2'], required_fmts=3D['preallocate= ']) diff --git a/tests/qemu-iotests/298.out b/tests/qemu-iotests/298.out index fa16b5ccef..6323079e08 100644 --- a/tests/qemu-iotests/298.out +++ b/tests/qemu-iotests/298.out @@ -1,5 +1,5 @@ -............. +.............. ---------------------------------------------------------------------- -Ran 13 tests +Ran 14 tests =20 OK --=20 2.39.3