From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from atuin.qyliss.net (localhost [IPv6:::1]) by atuin.qyliss.net (Postfix) with ESMTP id 172F233A8; Sat, 06 Dec 2025 12:32:22 +0000 (UTC) Received: by atuin.qyliss.net (Postfix, from userid 993) id 93AF8335F; Sat, 06 Dec 2025 12:32:19 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 4.0.1 (2024-03-26) on atuin.qyliss.net X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,DMARC_MISSING,RCVD_IN_DNSWL_LOW,SPF_HELO_PASS autolearn=unavailable autolearn_force=no version=4.0.1 Received: from fhigh-a4-smtp.messagingengine.com (fhigh-a4-smtp.messagingengine.com [103.168.172.155]) by atuin.qyliss.net (Postfix) with ESMTPS id F1016335E for ; Sat, 06 Dec 2025 12:32:18 +0000 (UTC) Received: from phl-compute-04.internal (phl-compute-04.internal [10.202.2.44]) by mailfhigh.phl.internal (Postfix) with ESMTP id C428B1400080; Sat, 6 Dec 2025 07:32:16 -0500 (EST) Received: from phl-mailfrontend-02 ([10.202.2.163]) by phl-compute-04.internal (MEProxy); Sat, 06 Dec 2025 07:32:16 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=alyssa.is; h=cc :cc:content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm3; t=1765024336; x=1765110736; bh=hCtSqXQOIb uCTLwIfZRQM9vJN7rKB3rqpIUQWccO6fw=; b=lS9DFX+amqaIBxx6lVJ62LpxHh OxE8mWPNEPbqXXvyPoVLo5lWiRgYbV5hW3/x38a3PU9DsIYKSCwVHAK+f3LYNEXL 9bPE9gWY/H+nklYpUjIrclE1IZrsHGiCfaYsPsb9ozLZlbLet2Zsr7IHEvAsPwNr ej8BcwE2Kro8Sm076dNqzPQ4BVTmHczYlP0CEhTFApO4OPJEck6XzAyuiFcfjb90 3VKsDAKaW+5X99MwkTQxNOI3Xh9B4AV81MiPXtPn7AnPwXYixWWlju5M4JtqvF6+ cpB8UlKVBwUEbRbQF1HdSyv/+LYZdFRZ1lCmgN6JYIYVNBarw8x65qH6DYSQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t= 1765024336; x=1765110736; bh=hCtSqXQOIbuCTLwIfZRQM9vJN7rKB3rqpIU QWccO6fw=; b=ldniac6riNv6nBGmEMDGJU3ih2ub9l6UB3h2ieVdl6lYz8c3L7U 5mqldyX2qR/Dg5NT5b8zJSCdFuMRaR3+3qTPLPpbXswJWxJZqbaag3RQnKERHthr AbZrfccIZf2JbEy8w0qU0klHPcBJgchOqkNDZO8v14ys9xIJXxQMYr6LUamup3Xv ltWj2av8gVsqNdKAZWi26I3Sm6nKeqH6L2IMgMmB9EF5TbHap8+49jOfktWsbx4N 91QteRMgiZLzpF02eqpELlk4B6qQY2U96/+uh7NQRXmdOUJqdsjIZwTCevGySS7F P+rkuHzrYFT5yInC2f2REQr6GTdDGaCHdlA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefgedrtddtgddutdelgecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpuffrtefokffrpgfnqfghnecuuegr ihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjug hrpefhvfevufgjfhffkfggtgesghdtreertddtjeenucfhrhhomheptehlhihsshgrucft ohhsshcuoehhihesrghlhihsshgrrdhisheqnecuggftrfgrthhtvghrnhepteehvedugf ejgfehhfeijeduleekleejgedvkeeuuefhhfegvdevfeetveegteeinecuvehluhhsthgv rhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhephhhisegrlhihshhsrgdrih hspdhnsggprhgtphhtthhopedvpdhmohguvgepshhmthhpohhuthdprhgtphhtthhopegu vghmihhosggvnhhouhhrsehgmhgrihhlrdgtohhmpdhrtghpthhtohepuggvvhgvlhessh hpvggtthhruhhmqdhoshdrohhrgh X-ME-Proxy: Feedback-ID: i12284293:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Sat, 6 Dec 2025 07:32:16 -0500 (EST) Received: by fw12.qyliss.net (Postfix, from userid 1000) id CF27647BE31B; Sat, 06 Dec 2025 13:32:14 +0100 (CET) From: Alyssa Ross To: Demi Marie Obenour Subject: Re: Test for portals passes even when file portal is broken In-Reply-To: <21226c74-35a0-4bb3-b8f3-1163d4f5ad10@gmail.com> References: <87bjkblrt0.fsf@alyssa.is> <21226c74-35a0-4bb3-b8f3-1163d4f5ad10@gmail.com> Date: Sat, 06 Dec 2025 13:32:13 +0100 Message-ID: <878qfflrjm.fsf@alyssa.is> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Message-ID-Hash: VRD2YVMDJEMXEGHWE6UJN44LOIWWSSP4 X-Message-ID-Hash: VRD2YVMDJEMXEGHWE6UJN44LOIWWSSP4 X-MailFrom: hi@alyssa.is X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-devel.spectrum-os.org-0; header-match-devel.spectrum-os.org-1; header-match-devel.spectrum-os.org-2; header-match-devel.spectrum-os.org-3; header-match-devel.spectrum-os.org-4; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: Spectrum OS Development X-Mailman-Version: 3.3.9 Precedence: list List-Id: Patches and low-level development discussion Archived-At: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Demi Marie Obenour writes: > On 12/6/25 07:26, Alyssa Ross wrote: >> Demi Marie Obenour writes: >>=20 >>> While trying to sandbox the file chooser portal, I broke it. >>> This caused files not to be saved, resulting in silent data loss. >>> Unfortunately, the integration test still passed. >>> >>> Is this a bug in the test? Is there a better alternative to manual >>> testing? >>=20 >> Not presently, but we can work on improving the test. The current >> portal test was written as a regression test for a specific issue we >> had. It's quite hard to test completely end to end but we could do a >> lot better. >>=20 >> I would quite like to spend some time in February or so working on our >> tests. > > Would it make sense to use openQA for this? Qubes OS uses openQA > and it works very well. openQA is written in Perl, but it=E2=80=99s the > best tool I know of for this. First blocker there would be packaging openQA in Nixpkgs. I do not personally relish the idea of doing that. --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYKAB0WIQQGoGac7QfI+H5ZtFCZddwkt31pFQUCaTQiTQAKCRCZddwkt31p FbVhAP4mcyR0eQ07sJ83vROI9Lsz/IFDLViApwEHdk+623im4gD/QKLiAF6zYD+u HYTueaY5QlOKTQyI0hr9mwF0k6aohwo= =iEw8 -----END PGP SIGNATURE----- --=-=-=--