Commit Graph

840 Commits

Author SHA1 Message Date
Avi Deitcher
cf7d83bb13 add sharding option
Signed-off-by: Avi Deitcher <avi@deitcher.net>
2022-10-30 11:16:42 +02:00
Avi Deitcher
7c2b9b3b3a move rtf commands from GHA into make test; remove unused artifacts
Signed-off-by: Avi Deitcher <avi@deitcher.net>
2022-10-24 12:50:28 +03:00
Petr Fedchenkov
3540a1bc34
Update buildkit to have platform fix
We noticed that we use host arch when we want to use previously build
image in oci-layout. Let's use fix on buildkit side and improve test.

Signed-off-by: Petr Fedchenkov <giggsoff@gmail.com>
2022-07-22 12:25:39 +03:00
Petr Fedchenkov
5763c4f4bc
Ability to parse args from Dockerfile
We should check if we have args in "FROM" and replace them:

ARG IMAGE=linuxkit/img
FROM ${IMAGE} as src

will be parsed as

FROM linuxkit/img as src

Signed-off-by: Petr Fedchenkov <giggsoff@gmail.com>
2022-07-20 17:07:43 +03:00
Avi Deitcher
a90ff542cd add support for building from cached images
Signed-off-by: Avi Deitcher <avi@deitcher.net>
2022-07-14 12:53:34 +03:00
Davide Brini
860934d5d9 New output format: iso-efi-initrd
This option was previously not available and required postprocessing of a `tar-kernel-initrd` output.

Comparison with `iso-efi`:

`iso-efi` only loads the kernel at boot, and the root filesystem is mounted from the actual boot media (eg, a CD-ROM - physical or emulated). This can often cause trouble (it has for us) for multiple reasons:
- the linuxkit kernel might not have the correct drivers built-in for the hardware (see #3154)
- especially with virtual or emulated CD-ROMs, performance can be abysmal: we saw the case where the server IPMI allowed using a ISO stored in AWS S3 over HTTP...you can imagine what happens when you start doing random I/O on the root fs in that case.
- The ISO image has the root device name baked in (ie, `/dev/sr0`) which fails if for some reason the CD-ROM we're running from doesn't end up using that device, so manual tweaking is required (see #2375)

`iso-efi-initrd`, on the other hand, packs the root filesystem as an initramfs (ie similar to what the raw output does, except that in this case we're preparing an ISO image), so both the kernel and the initramfs are loaded in memory by the boot loader and, once running, we don't need to worry about root devices or kernel drivers (and the speed is good, as everything runs in RAM).

Also, the generated ISO can be copied verbatim (eg with `dd`) onto a USB media and it still works.

Finally, the image size is much smaller compared to `iso-efi`.

IMHO, `iso-efi-initrd` could be used almost anywhere `iso-efi` would be used, or might even supersede it. I can't think of a scenario where one might explicitly want to use `iso-efi`.

Points to consider:

- Not tested under aarch64 as I don't have access to that arch. If the automated CI tests also test that, then it should be fine.
- I'm not sure what to put inside `images.yaml` for the `iso-efi-initrd` image. As it is it works of course (my personal image on docker hub), but I guess it'll have to be some more "official" image. However, that cannot be until this PR is merged, so it's kind of a chicken and egg situation. Please advise.
- I can look into adding the corresponding `iso-bios-initrd` builder if there is interest.

![cute seal](https://sites.psu.edu/siowfa16/files/2016/09/baby-seal-29vsgyf-288x300.jpg)

Signed-off-by: Davide Brini <waldner@katamail.com>
2022-07-11 20:26:14 +02:00
Avi Deitcher
857f53cdff test pkg/dummy
Signed-off-by: Avi Deitcher <avi@deitcher.net>
2022-06-07 21:16:13 +03:00
Frédéric Dalleau
d308349f96 ./scripts/update-component-sha.sh --hash 5.15.15 5.15.27 2022-05-25 13:39:10 +02:00
Frédéric Dalleau
0d8a1e3033 script/update-component-sha.sh --hash 5.10.92 5.10.104
Signed-off-by: Frédéric Dalleau <frederic.dalleau@docker.com>
2022-05-25 13:39:10 +02:00
Yuri Volchkov
1a013f4424 Declare build-args in build.yml
This allows multiple build flavors for a single codebase, without
sacrificing reproducible builds. The build-args are set in build.yml,
which is typically under the source control (if it is not, then no
reproducible builds are possible anyways). Meaning that mutating
build-args would result in setting "dirty" flag.

Intended use of this commit is to switch between build flavors by
specifying a different yaml file (presumably also under the version
control)  by  `-build-yml` option.

Because it is impossible to build a final image from packages in
cache, the test for this feature relies on the `RUN echo $build-arg`
output during the `pkg build` process.

Signed-off-by: Yuri Volchkov <yuri@zededa.com>
2022-04-13 17:36:55 +00:00
Avi Deitcher
b3f276f8f9 update linuxkit/init dependencies
Signed-off-by: Avi Deitcher <avi@deitcher.net>
2022-03-21 14:15:28 +02:00
Avi Deitcher
200e0ee94a update dependencies of pkg/init and pkg/containerd
Signed-off-by: Avi Deitcher <avi@deitcher.net>
2022-03-21 01:22:19 +02:00
David Scott
521b323270 test: extend cgroupv2 case to support runtime: cgroups:
Signed-off-by: David Scott <dave@recoil.org>
2022-03-13 19:57:28 +00:00
David Scott
f14ad44ce4 update shas for pkg/init
Signed-off-by: David Scott <dave@recoil.org>
2022-03-13 19:57:25 +00:00
Avi Deitcher
8328d4a589 update examples to latest getty
Signed-off-by: Avi Deitcher <avi@deitcher.net>
2022-02-28 19:37:44 +02:00
Rolf Neugebauer
9f2ff29e5e tests: Add 5.15.x kernel tests (renamed from 5.12)
Signed-off-by: Rolf Neugebauer <rn@rneugeba.io>
2022-01-18 12:55:03 +00:00
Rolf Neugebauer
bc3f72b518 Update kernel config test to latest
Signed-off-by: Rolf Neugebauer <rn@rneugeba.io>
2022-01-18 12:49:30 +00:00
Rolf Neugebauer
76d4f3d03a test/pkg: Disable DEVKMEM test for kernels older than 5.13.x
Signed-off-by: Rolf Neugebauer <rn@rneugeba.io>
2022-01-18 12:42:42 +00:00
Rolf Neugebauer
1fd890a76b Bump kernel images to 5.10.92/5.4.172
Signed-off-by: Rolf Neugebauer <rn@rneugeba.io>
2022-01-18 12:41:58 +00:00
Dave Tucker
0b739c80e9 pkg: update shas
Update the SHA of all packages that have been go-mod-ififed
such that they are use for testing in CI

Signed-off-by: Dave Tucker <dave@dtucker.co.uk>
2022-01-12 00:04:37 +00:00
David Scott
341c4a4f5e Update shas for linuxkit/runc
./scripts/update-component-sha.sh linuxkit/runc:21dbbda709ae138de0af6b0c7e4ae49525db5e88  linuxkit/runc:9f7aad4eb5e4360cc9ed8778a5c501cce6e21601

Signed-off-by: David Scott <dave@recoil.org>
2021-12-16 19:10:58 +01:00
Sylvain Prat
4bbb32e68c Update acpid hash
Signed-off-by: Sylvain Prat <sylvain.prat@gmail.com>
2021-12-09 21:05:34 +01:00
David Scott
6a9c6abfba Update hashes for pkg/memlogd
Signed-off-by: David Scott <dave@recoil.org>
2021-11-27 20:01:21 +00:00
Avi Deitcher
46ef83c979
Merge pull request #3702 from deitch/alpine-314
bump alpine to 3.14, remove go version hack
2021-11-16 14:56:01 +02:00
Avi Deitcher
260cc85b52 Update package tags
Signed-off-by: Avi Deitcher <avi@deitcher.net>
2021-11-09 14:02:43 +02:00
Avi Deitcher
bcbabcac28 Update use of test packages to latest
Signed-off-by: Avi Deitcher <avi@deitcher.net>
2021-11-09 14:02:41 +02:00
David Scott
833b3e775d Update linuxkit/kernel:5.4.129 to linuxkit/kernel:5.4.156
Signed-off-by: David Scott <dave@recoil.org>
2021-11-08 13:51:34 +00:00
David Scott
2160964c1a Update kernel:5.10.47 to kernel:5.10.76
Signed-off-by: David Scott <dave@recoil.org>
2021-11-08 13:50:08 +00:00
Avi Deitcher
04b90b986a tests: Update packages to the latest linuxkit/alpine
Signed-off-by: Avi Deitcher <avi@deitcher.net>
2021-11-07 16:41:36 +02:00
David Scott
10599f776a test: add a case for cgroupv2
Signed-off-by: David Scott <dave@recoil.org>
2021-10-26 20:07:38 +01:00
David Scott
9d16e2a2b9 test: the README.md says the numbers correspond to the first letter
A few of these tests appear to be misnumbered, so renumber them.

Signed-off-by: David Scott <dave@recoil.org>
2021-10-26 20:04:51 +01:00
David Scott
e8f8a409e8 Update hashes for pkg/init
Signed-off-by: David Scott <dave@recoil.org>
2021-10-26 19:52:22 +01:00
David Scott
e4776e8778 Update hash for containerd 1.4.11
Signed-off-by: David Scott <dave@recoil.org>
2021-10-21 11:34:59 +01:00
David Scott
476d5a0f2e Update alpine for containerd
Signed-off-by: David Scott <dave@recoil.org>
2021-10-21 11:34:59 +01:00
David Scott
2ff94c0d72 test: kmsg requires /dev/console
Signed-off-by: David Scott <dave@recoil.org>
2021-10-18 21:05:44 +01:00
David Scott
bdb1c13473 test: logwrite requires /dev/console
Signed-off-by: David Scott <dave@recoil.org>
2021-10-18 21:05:44 +01:00
David Scott
5a12600412 test: init-containerd requires /dev/console
Signed-off-by: David Scott <dave@recoil.org>
2021-10-18 21:05:44 +01:00
David Scott
dcecbe57c6 test: containerd tests need losetup which needs block device access
Signed-off-by: David Scott <dave@recoil.org>
2021-10-18 21:05:26 +01:00
David Scott
1c02c9ea86 test: losetup needs block device access
Signed-off-by: David Scott <dave@recoil.org>
2021-10-18 21:03:29 +01:00
David Scott
d4c6ab742b Update hashes for pkg/...
Signed-off-by: David Scott <dave@recoil.org>
2021-10-18 21:02:44 +01:00
Rolf Neugebauer
0dd8086d39 Update YAMLs to latest runc/containerd/test-containerd
Signed-off-by: Rolf Neugebauer <rn@rneugeba.io>
2021-10-16 16:57:15 +01:00
Rolf Neugebauer
6efae97c20 Update alpine for containerd
Signed-off-by: Rolf Neugebauer <rn@rneugeba.io>
2021-10-16 16:57:15 +01:00
David Scott
c3642dd089 Update hashes for pkg/mount
Signed-off-by: David Scott <dave@recoil.org>
2021-10-15 08:19:03 +01:00
David Scott
97d054da5d Update hashes for pkg/getty
Signed-off-by: David Scott <dave@recoil.org>
2021-10-15 08:18:58 +01:00
David Scott
21a7155824 Update hashes for pkg/format
Signed-off-by: David Scott <dave@recoil.org>
2021-10-14 16:14:21 +01:00
Rolf Neugebauer
4eb60514c9 yaml: Update use of alpine:3.11 to alpine:3.13
Seceral YAML files used alpine:3:11. Update them to 3.13

Signed-off-by: Rolf Neugebauer <rn@rneugeba.io>
2021-08-10 00:13:52 +01:00
Rolf Neugebauer
f52c7f17c8 yaml: Remove trust section from examples and tests
With 561ce6f4be ("Remove Notary and Content Trust") we
removed support for content trust. No need to have it
in the YAMLs either.

Signed-off-by: Rolf Neugebauer <rn@rneugeba.io>
2021-08-10 00:07:13 +01:00
Rolf Neugebauer
47198556c2 Update YAMLs to latest kernel config test
Signed-off-by: Rolf Neugebauer <rn@rneugeba.io>
2021-07-04 13:54:55 +01:00
Rolf Neugebauer
88352cd358 pkg: Drop oprofile fs check from kernel config check
oprofile kernel support was dropped with 5.12.x with:
f8408264c77a ("drivers: Remove CONFIG_OPROFILE support")

However the commit stated that the userspace oprofile tools
had stopped using the kernel interface for a log time. So
drop the check.

Signed-off-by: Rolf Neugebauer <rn@rneugeba.io>
2021-07-04 13:47:12 +01:00
Rolf Neugebauer
4389918aef Update YAMLs to latest kernels
Signed-off-by: Rolf Neugebauer <rn@rneugeba.io>
2021-07-04 11:16:45 +01:00