Commit Graph

7521 Commits

Author SHA1 Message Date
Justin Cormack
c2806000e0 Use streaming APIs rather than buffers for building
This should lower memory usage a lot and should be faster.

Signed-off-by: Justin Cormack <justin.cormack@docker.com>
2017-06-07 12:13:12 +01:00
Justin Cormack
7efb87da50 Merge pull request #1979 from ijc25/update-containerd
Update to containerd bdf9f5f7388e8203e63a74b89800f7f3dd4a7743
2017-06-07 10:55:09 +01:00
Ian Campbell
0eb21735ae Update to containerd bdf9f5f7388e8203e63a74b89800f7f3dd4a7743
Note that this is not the latest (which was 95efd45db073 at time of writing)
but the next commit 6428b4bad0c2 merges "Port ctr to use client package" breaks
the use of `ctr run --runtime-config` (by removing that option).

This contains https://github.com/containerd/containerd/pull/954 which was
causing some services to fail to start.

All previous uses of 15541037b9 are updated to
5749f2e9e6.

Signed-off-by: Ian Campbell <ian.campbell@docker.com>
2017-06-07 09:38:10 +01:00
Justin Cormack
d0620eebf9 Merge pull request #1976 from justincormack/containerdup
Containerd update
2017-06-06 22:57:16 +01:00
Justin Cormack
9f4c6da4e5 Update containerd in yaml
Signed-off-by: Justin Cormack <justin.cormack@docker.com>
2017-06-06 22:14:30 +01:00
Justin Cormack
ad7770fbf9 Update containerd
Fixes boltdb copying issue which caused failures.

Signed-off-by: Justin Cormack <justin.cormack@docker.com>
2017-06-06 22:10:12 +01:00
Riyaz Faizullabhoy
edd49cabc6 Merge pull request #1975 from avsm/gc-aws
projects/aws: remove remaining files now that #1964 is merged
2017-06-06 14:04:41 -07:00
Justin Cormack
e09f062ef6 Merge pull request #1974 from kencochrane/improve_aws_docs
Improved the AWS docs
2017-06-06 22:04:27 +01:00
Riyaz Faizullabhoy
d31413c39c Merge pull request #1973 from kencochrane/fix_aws_name
Added more log statements to linuxkit push aws command
2017-06-06 13:31:22 -07:00
Anil Madhavapeddy
5652987f63 projects: mark aws as completed in a new section in README
Signed-off-by: Anil Madhavapeddy <anil@docker.com>
2017-06-06 21:24:29 +01:00
Anil Madhavapeddy
4b7e0e11a8 projects/aws: remove remaining files now that #1964 is merged
The AWS support has gone mainline so no need for the project anymore.

Signed-off-by: Anil Madhavapeddy <anil@docker.com>
2017-06-06 20:56:39 +01:00
Ken Cochrane
67c2a230fb Fixed AWS push command, name wasn't set correctly
Signed-off-by: Ken Cochrane <kencochrane@gmail.com>
2017-06-06 15:50:25 -04:00
Justin Cormack
d7e8627c4e Merge pull request #1971 from nrocco/kernel-drivers-for-broadcom-nics
Add tg3 module for Broadcom NIC support
2017-06-06 20:31:16 +01:00
Ken Cochrane
a1e0a301a6 Improved the AWS docs
Signed-off-by: Ken Cochrane <kencochrane@gmail.com>
2017-06-06 15:28:14 -04:00
Nico Di Rocco
f9da106c46 Add tg3 module for Broadcom NIC support
Signed-off-by: Nico Di Rocco <dirocco.nico@gmail.com>
2017-06-06 20:55:36 +02:00
Justin Cormack
3f8d627be6 Merge pull request #1969 from DieterReuter/fix-aws-default-img-name
Fix empty AWS default image name
2017-06-06 19:25:57 +01:00
Justin Cormack
b940a7f85d Merge pull request #1968 from thebsdbox/open-vm-tools-wait
Added capability to wait for the OpenVM tools to report the IP of new VM
2017-06-06 18:29:14 +01:00
Dieter Reuter
fc5135b5cc Fix empty AWS default image name
Signed-off-by: Dieter Reuter <dieter.reuter@me.com>
2017-06-06 19:10:21 +02:00
thebsdbox
7cc2bc43e4 Added capability to wait for the OpenVM tools to report the IP of new VM
Signed-off-by: Dan Finneran <daniel.finneran@gmail.com>
2017-06-06 17:52:18 +01:00
Riyaz Faizullabhoy
c5834261a2 Merge pull request #1967 from dgageot/fix-1966
Fix outdated GCP docs
2017-06-06 09:45:28 -07:00
Justin Cormack
55931b2d00 Merge pull request #1960 from MagnusS/vsudd-pkg
Add /pkg/vsudd
2017-06-06 17:19:59 +01:00
David Gageot
f5b8dd2620 Fix outdated GCP docs
The proper way to output an image for GCP is to
use `-output gcp-img`.

Fixes #1966

Signed-off-by: David Gageot <david@gageot.net>
2017-06-06 17:45:10 +02:00
Magnus Skjegstad
ae56dd81c2 vsudd: add /pkg/vsudd with README and example yml
Signed-off-by: Magnus Skjegstad <magnus@skjegstad.com>
2017-06-06 16:32:01 +01:00
Justin Cormack
b086231008 Allow streaming output for tar
This is a little ugly in terms of the validation now, but it is a move towards
splitting "build" and "package".

The "tar" output (and soon others) can output direct to a file or to stdout.
Obviously you can only build a single output format like this.

The LinuxKit output formats that build disk images cannot stream as they
have to build whole images. These allow multiple outputs.

In future we will probably change to
```
moby build | moby package
```

or similar, but that is a bit ugly, so currently have a compromise where
there are essentially two output types.

Signed-off-by: Justin Cormack <justin.cormack@docker.com>
2017-06-06 14:50:28 +01:00
Justin Cormack
b460a718cc Merge pull request #1965 from samoht/mtime
sdk: update the tests to use mtime 1.0 and logs.fmt
2017-06-06 13:44:38 +01:00
Thomas Gazagnaire
c4c44253cb sdk: the tests need logs.fmt
Signed-off-by: Thomas Gazagnaire <thomas@gazagnaire.org>
2017-06-06 13:42:45 +02:00
Thomas Gazagnaire
c0d999dbab sdk: use mtime 1.0
Signed-off-by: Thomas Gazagnaire <thomas@gazagnaire.org>
2017-06-06 13:42:42 +02:00
Justin Cormack
d617db19bf Merge pull request #1964 from dave-tucker/aws
Add AWS Support to LinuxKit Push and Run
2017-06-06 12:06:50 +01:00
Dave Tucker
8f4408310d docs: Add basic docs for AWS support
Signed-off-by: Dave Tucker <dt@docker.com>
2017-06-06 10:36:43 +01:00
Dave Tucker
719f260e01 linuxkit: Order push/run backends and cases alphabetically
This makes it easier to identify where a new backend should be added.
It's also simpler to match help text and case statements.

Signed-off-by: Dave Tucker <dt@docker.com>
2017-06-06 10:36:43 +01:00
Dave Tucker
3dcd8a2730 linuxkit: Add run support for AWS
Signed-off-by: Dave Tucker <dt@docker.com>
2017-06-06 10:36:31 +01:00
Dave Tucker
0737694eb7 linuxkit: Add push support for AWS
Signed-off-by: Dave Tucker <dt@docker.com>
2017-06-06 10:06:28 +01:00
Dave Tucker
3aa65e8fd3 vendor: Add dependencies for AWS
Signed-off-by: Dave Tucker <dt@docker.com>
2017-06-06 09:42:26 +01:00
Riyaz Faizullabhoy
b845703a79 Merge pull request #1952 from avsm/sdk-yaml
projects/miragesdk: add a frontend yaml format for dhcp-client
2017-06-05 15:09:57 -07:00
Justin Cormack
12a2ea5143 Merge pull request #1959 from justincormack/mobyup
Update moby tool and qemu fixes
2017-06-05 17:42:06 +01:00
Justin Cormack
e1197cf43c Merge pull request #1963 from justincormack/report-5-june
Add development report for 6 June
2017-06-05 17:40:26 +01:00
Anil Madhavapeddy
2da4aefb37 projects/miragesdk: add a frontend yaml format for dhcp-client
The intention with the yaml fragment is that it specifies the
set of processes that form the daemon, with minimal privileges
for each component and each running inside a separate container.

In addition to the normal container capabilities, there is also
a new field which lets a startup process establish an RPC channel,
based on a Capnp specification. This allows for extremely
unprivileged components to be started, such as the `dhcp-engine`
in this example which can only communicate with the outside world
via the `dhcp-network` (to transmit) or `dhcp-actuator` (to alter
the state of the local Linux distribution).

This is a first cut at the yaml interface and the capnp, with the
intention to refine it as we combine it with the rest of the existing
prototype (which currently doesnt have an RPC layer).  Expect
more changes...

Signed-off-by: Anil Madhavapeddy <anil@docker.com>
2017-06-05 16:49:54 +01:00
Justin Cormack
181c66d42c Merge pull request #70 from justincormack/multiple-yaml
Allow specification of multiple yaml files for a single build
2017-06-05 16:39:31 +01:00
Justin Cormack
e782a469d5 Update moby tool and qemu fixes
- no longer uses several of the `mkimage-*` tools in favour of dogfooding
with `linuxkit` and using the `mkimage` package.
- fix the qemu docker container fallbacks to work better when multiple
paths are used for disks and the image.

Signed-off-by: Justin Cormack <justin.cormack@docker.com>
2017-06-05 16:34:26 +01:00
Justin Cormack
0dac3fe1c8 Add development report for 6 June
Signed-off-by: Justin Cormack <justin.cormack@docker.com>
2017-06-05 16:19:49 +01:00
Justin Cormack
3a16c02f10 Merge pull request #69 from justincormack/gcp-fix
Do not use Linuxkit to build GCP images for now
2017-06-05 15:37:48 +01:00
Justin Cormack
e879037646 Disable use of linuxkit for GCP for now
GCP does not recognise the images, even though they appear identical to those made
by libguestfs and work on qemu fine. Their validation code does not like them for some
reason.

Signed-off-by: Justin Cormack <justin.cormack@docker.com>
2017-06-05 15:31:45 +01:00
Justin Cormack
4b60965990 Merge pull request #1933 from radu-matei/run-azure
Add linuxkit run azure
2017-06-05 10:26:43 +01:00
Justin Cormack
503545a2de Merge pull request #67 from riyazdf/trust-caching
trust: check local image cache to not pull every time
2017-06-04 19:31:47 +01:00
Justin Cormack
54e58f2808 Allow specification of multiple yaml files for a single build
Each section will be appended in order of the CLI, other then
kernel where last specified one wins.

This is useful if you eg want to have a base version for (say)
AWS and GCP and then add your own image on top.

Signed-off-by: Justin Cormack <justin.cormack@docker.com>
2017-06-04 17:50:13 +01:00
Justin Cormack
982bddb185 Merge pull request #1961 from deitch/compose-examples
add compose dynamic
2017-06-04 16:25:04 +01:00
Avi Deitcher
e4512864ac add compose dynamic
Signed-off-by: Avi Deitcher <avi@deitcher.net>
2017-06-04 16:18:34 +03:00
Justin Cormack
11b1eb75ad Merge pull request #1953 from dnephin/update-yaml-docs
Update configuration docs
2017-06-03 10:42:22 +01:00
Riyaz Faizullabhoy
6c6190172c trust: include trust configuration in docker inspect for OCI config
Signed-off-by: Riyaz Faizullabhoy <riyaz.faizullabhoy@docker.com>
2017-06-02 15:18:55 -07:00
Justin Cormack
058ce768f4 Merge pull request #66 from justincormack/linuxkit-part2
Add the temporary directories under ~/.moby
2017-06-02 22:39:41 +01:00