Re: Test for portals passes even when file portal is broken

[Alyssa Ross <hi@alyssa.is>]

[-- Attachment #1: Type: text/plain, Size: 1057 bytes --]

Demi Marie Obenour <demiobenour@gmail.com> writes:

> On 12/6/25 07:26, Alyssa Ross wrote:
>> Demi Marie Obenour <demiobenour@gmail.com> writes:
>> 
>>> While trying to sandbox the file chooser portal, I broke it.
>>> This caused files not to be saved, resulting in silent data loss.
>>> Unfortunately, the integration test still passed.
>>>
>>> Is this a bug in the test?  Is there a better alternative to manual
>>> testing?
>> 
>> Not presently, but we can work on improving the test.  The current
>> portal test was written as a regression test for a specific issue we
>> had.  It's quite hard to test completely end to end but we could do a
>> lot better.
>> 
>> I would quite like to spend some time in February or so working on our
>> tests.
>
> Would it make sense to use openQA for this?  Qubes OS uses openQA
> and it works very well.  openQA is written in Perl, but it’s the
> best tool I know of for this.

First blocker there would be packaging openQA in Nixpkgs.  I do not
personally relish the idea of doing that.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]