Speeding up image builds?

Speeding up image builds?

[Demi Marie Obenour]

[-- Attachment #1.1.1: Type: text/plain, Size: 558 bytes --]

I often find myself waiting for image builds to run.
What are some steps I can take to make them faster?

Generally, I find that image builds are I/O bound (CPU usage
remains quite low), so one option would be to use a machine
with better I/O.  What is the best option for this?  Is this
something where thin provisioning (instead of thick
provisioning) causes a large performance penalty?  Or is the
only solution to throw hardware at the problem?  If the latter,
what would better hardware be?
-- 
Sincerely,
Demi Marie Obenour (she/her/hers)

[-- Attachment #1.1.2: OpenPGP public key --]
[-- Type: application/pgp-keys, Size: 7253 bytes --]

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: Speeding up image builds?

[Alyssa Ross]

[-- Attachment #1: Type: text/plain, Size: 1076 bytes --]

Demi Marie Obenour <demiobenour@gmail.com> writes:

> I often find myself waiting for image builds to run.
> What are some steps I can take to make them faster?
>
> Generally, I find that image builds are I/O bound (CPU usage
> remains quite low), so one option would be to use a machine
> with better I/O.  What is the best option for this?  Is this
> something where thin provisioning (instead of thick
> provisioning) causes a large performance penalty?  Or is the
> only solution to throw hardware at the problem?  If the latter,
> what would better hardware be?

Okay, well, the absolute best thing we could do would be to write a
vhost-user-blk backend that lazily populates an EROFS image as the disk
is read from.  Everything short of that is a compromise between
effort and results.

I tend to just wait, so I haven't looked too much into this.  It is way
faster on my Apple Silicon MacBook than any x86_64 system I've tried,
but I couldn't tell you why.  I've tried building on tmpfs in the past,
but IIRC it didn't help much for me.  Maybe it would for you though?

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]