patches and low-level development discussion
 help / color / mirror / code / Atom feed
From: colbyt <colby@colbyt.com>
To: devel@spectrum-os.org
Cc: PolymerOS Coordinator <coordinator@polymeros.local>
Subject: [PATCH v2] vm: optional 16K-page guest kernel builds
Date: Thu, 30 Jul 2026 12:28:44 -0700	[thread overview]
Message-ID: <20260730192848.1916888-1-colby@colbyt.com> (raw)
In-Reply-To: <20260730192035.1900845-1-colby@colbyt.com>

From: PolymerOS Coordinator <coordinator@polymeros.local>

KVM hosts with a 16K stage-2 granule (Apple Silicon machines running
upstream kernels, NVIDIA GB10) can only run guests whose kernel is built
with ARM64_16K_PAGES. Add an optional kernelPageSize argument to the app
and net VM kernel builds; the default is unchanged. A 16K-page guest
Image built this way has booted to a full session under a 16K host here
since June without issues on my side.
---
v2: no code change — drop a stray in-body From line that would have
misattributed authorship when applied.

Following up on the offer in my July 7 mail, as a standalone patch now
that the nixpkgs update brings Linux 7.1. The config delta is five
lines; the edit (an argument defaulting to today's behavior) is a
proposal — happy to rework it if you'd rather structure it differently,
e.g. hang it off a single shared helper instead of two arguments.

 spectrum/img/app/default.nix    | 7 +++++++
 spectrum/vm/sys/net/default.nix | 7 +++++++
 2 files changed, 14 insertions(+)

diff --git a/img/app/default.nix b/img/app/default.nix
index 06dfc86c..6b839f0f 100644
--- a/img/app/default.nix
+++ b/img/app/default.nix
@@ -7,6 +7,7 @@ import ../../lib/call-package.nix (
 , cryptsetup
 , erofs-utils, jq, lndir, s6-rc, util-linux
 , cacert, linux_latest
+, kernelPageSize ? null
 }:
 
 let
@@ -49,6 +50,12 @@ let
       VSOCKETS = yes;
       VIRTIO_VSOCKETS = yes;
       VT = no;
+    } // lib.optionalAttrs (kernelPageSize == "16k") {
+      # KVM hosts with a 16K stage-2 granule (e.g. Apple Silicon, NVIDIA
+      # GB10) can only run guests whose kernel uses 16K pages.
+      ARM64_4K_PAGES = lib.mkForce no;
+      ARM64_16K_PAGES = lib.mkForce yes;
+      ARM64_64K_PAGES = lib.mkForce no;
     };
   }).overrideAttrs ({ installFlags ? [], ... }: {
     installFlags = installFlags ++ [
diff --git a/vm/sys/net/default.nix b/vm/sys/net/default.nix
index 3ec34a7f..efd1c8e1 100644
--- a/vm/sys/net/default.nix
+++ b/vm/sys/net/default.nix
@@ -10,6 +10,7 @@ pkgsMusl.callPackage (
 , erofs-utils, jq, lndir, s6-rc, util-linux
 , busybox, dbus, execline, iwd, kmod, linuxPackagesFor, linux_latest
 , mdevd, nftables, s6, s6-linux-init, spectrum-driver-tools, xdp-tools
+, kernelPageSize ? null
 }:
 
 let
@@ -52,6 +53,12 @@ let
       VIRTIO_CONSOLE = yes;
       VIRTIO_PCI = yes;
       VT = no;
+    } // lib.optionalAttrs (kernelPageSize == "16k") {
+      # KVM hosts with a 16K stage-2 granule (e.g. Apple Silicon, NVIDIA
+      # GB10) can only run guests whose kernel uses 16K pages.
+      ARM64_4K_PAGES = lib.mkForce no;
+      ARM64_16K_PAGES = lib.mkForce yes;
+      ARM64_64K_PAGES = lib.mkForce no;
     };
   }).overrideAttrs ({ installFlags ? [], ... }: {
     installFlags = installFlags ++ [
-- 
2.55.0


  reply	other threads:[~2026-07-30 19:28 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-30 19:20 [PATCH] vm: optional 16K-page guest kernel builds colbyt
2026-07-30 19:28 ` colbyt [this message]
2026-07-30 19:35 ` [PATCH v3] " colbyt
2026-07-31 14:04   ` Alyssa Ross
2026-08-01 18:40     ` colby
2026-08-03 12:49       ` Alyssa Ross

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260730192848.1916888-1-colby@colbyt.com \
    --to=colby@colbyt.com \
    --cc=coordinator@polymeros.local \
    --cc=devel@spectrum-os.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this public inbox

	https://spectrum-os.org/git/doc
	https://spectrum-os.org/git/mktuntap
	https://spectrum-os.org/git/spectrum
	https://spectrum-os.org/git/ucspi-vsock

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).