From d2fb76a86a0f48adaa2db2ff24f7f2f8de405ef7 Mon Sep 17 00:00:00 2001 From: Anil Madhavapeddy Date: Mon, 12 Jun 2017 18:47:34 +0100 Subject: [PATCH] reports: add week 23 dev report Signed-off-by: Anil Madhavapeddy --- reports/2017-06-11.md | 247 ++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 247 insertions(+) create mode 100644 reports/2017-06-11.md diff --git a/reports/2017-06-11.md b/reports/2017-06-11.md new file mode 100644 index 000000000..4668094ff --- /dev/null +++ b/reports/2017-06-11.md @@ -0,0 +1,247 @@ +# LinuxKit dev report for 2017-06-05 to 2017-06-11 (week 23) + +This report covers weekly developments in the [linuxkit], [virtsock], +[linuxkit-ci] and [rtf] repositories. There will be a [Moby development +Summit](https://www.eventbrite.com/e/moby-summit-tickets-34483396768) in the +Docker office in San Francisco on June 19, with several of the LinuxKit +developers. + +**Homebrew:** On MacOS there is a `brew tap` available. Detailed instructions are at +[linuxkit/homebrew-linuxkit](https://github.com/linuxkit/homebrew-linuxkit), +and the short summary is ([#2012] [@justincormack] [@riyazdf]) + +``` + brew tap linuxkit/linuxkit + brew install --HEAD moby + brew install --HEAD linuxkit +``` + +This week also saw the addition of several new backends for LinuxKit: + +**Hyper-V**: Add a new Hyper-V backend that provides interactive console access +in Powershell (and potentially bash, untested). It supports networking via an +existing switch, and supports multiple disks. ([#2017] [@rn] [@justincormack]). + +**Microsoft Azure:** The CLI now has `linuxkit run azure` functionality by +integrating with the Azure Go SDK. ([#1933] [#1421] [@radu-matei]). + +**AWS support:** following on from the initial addition last week, the CLI now +has `push` and `run` support for AMIs ([#1918] [#1964] [@kencochrane] +[@dave-tucker] [@justincormack] [@riyazdf]). +The AWS provider in the metadata Go package was also enhanced to include more +data ([#2014] [@kencochrane] [@riyazdf] [@rn]), and the default image name is +now set correctly if one is not supplied ([#1969] [@DieterReuter]). If you are +debugging the push support, there is now more verbose logging available +([#1973] [@kencochrane] [@riyazdf]). + +**VMWare VCenter:** Added the capability to wait for the OpenVM tools to report +the IP of new VM on doing a `linuxkit vcenter run` ([#1968] [@thebsdbox]). + +Meanwhile, the tools all compile cleanly on Linux, macOS and Windows now ([#2000] [@rn] [@mor1]) +and there is a `make local` target that does not use Docker ([#2011] [@justincormack]). + +### Base + +- Add tg3 module for Broadcom NIC support ([#1971] [@justincormack] [@nrocco]) +- Containerd was updated to the latest upstream ([#1976] [#1979] [@rn] [@justincormack]) + which in turn fixed `ctr exec -t` that used to hang ([#1837] [@rn]). +- The Moby tool has been update to the latest upstream ([#1983] [@justincormack]) +- The Linux kernels have been updated to 4.11.4/4.9.31./4.4.71 ([#1990] [@rn] [@RobbKistler]) +- The default disk `size` parameter is now in gigabytes instead of megabytes ([#2009] [@rn]) + +### Packaging + +**Getty containerised:** Added a `getty` pkg that containerises the serial handling ([#1977] [#1993] [#1997] [@deitch] [@justincormack] [@riyazdf]). +Also update `linuxkit/init` to remove the getty logic, and the getty package to relevant examples ([#2004] [#2016] [@riyazdf] [@deitch] [@justincormack] [@rn]). + +**Leave no port behind:** The containerd metrics port is now not exposed by default ([#1951] [@dave-tucker] [@rn] [@justincormack] [@ijc] [@riyazdf]). +See the issue for discussion about further security implications of which ports to leave open. + +**vsudd virtual communication:** There is a new package `vsudd` that clones and builds `linuxkit/virtsock/cmd/vsudd` for virtsock communication ([#1960] [@MagnusS]). + +Other packaging activity: + +- Update packages to use `linuxkit run` instead of `moby run` ([#2007] [@riyazdf]) +- In the build, make `GOOS` and `GOARCH` over-writeable ([#1984] [@riyazdf] [@rn]) +- Fix the repository build in some cases ([#1994] [@tych0] [@riyazdf]) +- Update LinuxKit target for the virtsock build ([virtsock#31] [@rn]) +- The `sshd` pkg should have additional mounts ([@justincormack] [@rn] [@deitch]) +- Fix perms on /etc/init.d/000-issue ([#2005] [@justincormack] [@deitch]) + +### Projects + +The MirageSDK was the topic of this week's Moby Security SIG#2, so there is a presentation +available (see the SIG notes). There were various updates in the tree to continue to build +the DHCP container ([#1965] [#2013] [#1952] [@yomimono] [@samoht] [@avsm] [@m4rcu5] [@riyazdf]). + +The `projects/aws` was removed now that the functionality is mainline ([#1975] [@avsm] [@riyazdf]). + +The probational channel proposal PR was closed ([#1945] [@tych0]) with the following actions +based on feedback from the SIG. +- we should use the new merging functionality in the `moby` tool to do the userspace init merging +- there should be no new tooling in `projects/` so e.g. the stuff that merges kernel command lines and such needs to be integrated into the `moby` tool proper +- we should try to reduce bitrot by doing Makefile includes instead of copy/paste everywhere + +These guidelines above generally help to reduce the difference in tooling between experimental +projects and the mainline LinuxKit distribution tools. + +Discussion continues on the issues about EBPF Jit verification ([linuxkit#1623] [@l0kod] [@thestinger] [@tych0]) +and the containerd test harness ([linuxkit/linuxkit#1906] [@justincormack] [@AkihiroSuda]) + +### Docs and Examples + +- Remove `docker.json` from `linuxkit.yml` ([#1996] [@justincormack] [@rn]) +- Fix outdated GCP docs ([#1967] [#1966] [@dgageot] [@riyazdf]) +- Improved the AWS docs ([#1974] [@justincormack]) +- Update platform documentation ([#1980] [@rn]) +- Moby SIG: notes and links for 2017-06-07 [(#1985] [#1986] [#1987] [@mgoelzer] [@riyazdf] [@l0kod]) +- Update MAINTAINERS ([#2010] [rtf#19] [virtsock#32] [@ijc] [@rn] [@dave-tucker]) +- Update AUTHORS ([#1999] [@djs55] [@justincormack]) +- Update `.mailmap` to make auto-generating work ([#2001] [@justincormack] [@thaJeztah]) +- Move the yaml docs to `moby/tool` ([#2002] [@riyazdf]) +- Add a test pattern to help text ([rtf#17] [@dave-tucker]) +- Convert some tests to run on hyperkit when run on OSX ([#1982] [@justincormack] [@riyazdf] [@rn]) +- Re-enable content trust on build test ([#1998] [@justincormack]) + + +## Ongoing Activity + +- The CI is being extended to build and sign Packages ([linuxkit#2003] [@talex5] [@rn] [@dave-tucker] [@justincormack] [@riyazdf]) +- The moby tool and qemu are being updated with fixes ([linuxkit#1959] [@justincormack]) +- Add https example for the MirageSDK ([linuxkit#1981] [@talex5] [@justincormack] [@rn] [@avsm]) +- There is now a vpnkit-forwarder in `/pkg/vpnkit-forwarder` ([linuxkit#2008] [@MagnusS] [@justincormack] [@ijc]) +- Change label check logic to look for only one match ([linuxkit/rtf#18] [@dave-tucker]) +- RFC: Enabling signed kernel modules support ([#2015] [@riyazdf] [@justincormack] [@fntlnz]) + +Other reports in this series can be browsed directly in the repository at [linuxkit:/reports](https://github.com/linuxkit/linuxkit/tree/master/reports/). + +[@AkihiroSuda]: https://github.com/AkihiroSuda +[@DieterReuter]: https://github.com/DieterReuter +[@MagnusS]: https://github.com/MagnusS +[@RobbKistler]: https://github.com/RobbKistler +[@ajeetraina]: https://github.com/ajeetraina +[@avsm]: https://github.com/avsm +[@chungers]: https://github.com/chungers +[@dave-tucker]: https://github.com/dave-tucker +[@dcui]: https://github.com/dcui +[@deitch]: https://github.com/deitch +[@dgageot]: https://github.com/dgageot +[@djs55]: https://github.com/djs55 +[@fntlnz]: https://github.com/fntlnz +[@ijc]: https://github.com/ijc +[@joeabbey]: https://github.com/joeabbey +[@justincormack]: https://github.com/justincormack +[@kairen]: https://github.com/kairen +[@kencochrane]: https://github.com/kencochrane +[@l0kod]: https://github.com/l0kod +[@m4rcu5]: https://github.com/m4rcu5 +[@mgoelzer]: https://github.com/mgoelzer +[@mor1]: https://github.com/mor1 +[@nrocco]: https://github.com/nrocco +[@radu-matei]: https://github.com/radu-matei +[@riyazdf]: https://github.com/riyazdf +[@rn]: https://github.com/rn +[@talex5]: https://github.com/talex5 +[@thaJeztah]: https://github.com/thaJeztah +[@thebsdbox]: https://github.com/thebsdbox +[@thestinger]: https://github.com/thestinger +[@tych0]: https://github.com/tych0 +[@yankunsam]: https://github.com/yankunsam +[@yomimono]: https://github.com/yomimono +[linuxkit]: https://github.com/linuxkit/linuxkit +[#1231]: https://github.com/linuxkit/linuxkit/issues/1231 +[#1336]: https://github.com/linuxkit/linuxkit/issues/1336 +[#1421]: https://github.com/linuxkit/linuxkit/issues/1421 +[#1623]: https://github.com/linuxkit/linuxkit/pull/1623 +[#1710]: https://github.com/linuxkit/linuxkit/issues/1710 +[#1837]: https://github.com/linuxkit/linuxkit/issues/1837 +[#1848]: https://github.com/linuxkit/linuxkit/issues/1848 +[#1872]: https://github.com/linuxkit/linuxkit/issues/1872 +[#1902]: https://github.com/linuxkit/linuxkit/issues/1902 +[#1906]: https://github.com/linuxkit/linuxkit/pull/1906 +[#1918]: https://github.com/linuxkit/linuxkit/issues/1918 +[#1923]: https://github.com/linuxkit/linuxkit/issues/1923 +[#1933]: https://github.com/linuxkit/linuxkit/pull/1933 +[#1940]: https://github.com/linuxkit/linuxkit/pull/1940 +[#1945]: https://github.com/linuxkit/linuxkit/pull/1945 +[#1951]: https://github.com/linuxkit/linuxkit/pull/1951 +[#1952]: https://github.com/linuxkit/linuxkit/pull/1952 +[#1956]: https://github.com/linuxkit/linuxkit/issues/1956 +[#1959]: https://github.com/linuxkit/linuxkit/pull/1959 +[#1960]: https://github.com/linuxkit/linuxkit/pull/1960 +[#1962]: https://github.com/linuxkit/linuxkit/issues/1962 +[#1963]: https://github.com/linuxkit/linuxkit/pull/1963 +[#1964]: https://github.com/linuxkit/linuxkit/pull/1964 +[#1965]: https://github.com/linuxkit/linuxkit/pull/1965 +[#1966]: https://github.com/linuxkit/linuxkit/issues/1966 +[#1967]: https://github.com/linuxkit/linuxkit/pull/1967 +[#1968]: https://github.com/linuxkit/linuxkit/pull/1968 +[#1969]: https://github.com/linuxkit/linuxkit/pull/1969 +[#1970]: https://github.com/linuxkit/linuxkit/issues/1970 +[#1971]: https://github.com/linuxkit/linuxkit/pull/1971 +[#1972]: https://github.com/linuxkit/linuxkit/issues/1972 +[#1973]: https://github.com/linuxkit/linuxkit/pull/1973 +[#1974]: https://github.com/linuxkit/linuxkit/pull/1974 +[#1975]: https://github.com/linuxkit/linuxkit/pull/1975 +[#1976]: https://github.com/linuxkit/linuxkit/pull/1976 +[#1977]: https://github.com/linuxkit/linuxkit/pull/1977 +[#1978]: https://github.com/linuxkit/linuxkit/pull/1978 +[#1970]: https://github.com/linuxkit/linuxkit/issues/1970 +[#1971]: https://github.com/linuxkit/linuxkit/pull/1971 +[#1972]: https://github.com/linuxkit/linuxkit/issues/1972 +[#1973]: https://github.com/linuxkit/linuxkit/pull/1973 +[#1974]: https://github.com/linuxkit/linuxkit/pull/1974 +[#1975]: https://github.com/linuxkit/linuxkit/pull/1975 +[#1976]: https://github.com/linuxkit/linuxkit/pull/1976 +[#1977]: https://github.com/linuxkit/linuxkit/pull/1977 +[#1978]: https://github.com/linuxkit/linuxkit/pull/1978 +[#1979]: https://github.com/linuxkit/linuxkit/pull/1979 +[#1980]: https://github.com/linuxkit/linuxkit/pull/1980 +[#1981]: https://github.com/linuxkit/linuxkit/pull/1981 +[#1982]: https://github.com/linuxkit/linuxkit/pull/1982 +[#1983]: https://github.com/linuxkit/linuxkit/pull/1983 +[#1984]: https://github.com/linuxkit/linuxkit/pull/1984 +[#1985]: https://github.com/linuxkit/linuxkit/pull/1985 +[#1986]: https://github.com/linuxkit/linuxkit/pull/1986 +[#1987]: https://github.com/linuxkit/linuxkit/pull/1987 +[#1988]: https://github.com/linuxkit/linuxkit/issues/1988 +[#1989]: https://github.com/linuxkit/linuxkit/issues/1989 +[#1990]: https://github.com/linuxkit/linuxkit/pull/1990 +[#1991]: https://github.com/linuxkit/linuxkit/issues/1991 +[#1992]: https://github.com/linuxkit/linuxkit/pull/1992 +[#1993]: https://github.com/linuxkit/linuxkit/pull/1993 +[#1994]: https://github.com/linuxkit/linuxkit/pull/1994 +[#1995]: https://github.com/linuxkit/linuxkit/issues/1995 +[#1996]: https://github.com/linuxkit/linuxkit/pull/1996 +[#1997]: https://github.com/linuxkit/linuxkit/pull/1997 +[#1998]: https://github.com/linuxkit/linuxkit/pull/1998 +[#1999]: https://github.com/linuxkit/linuxkit/pull/1999 +[#2000]: https://github.com/linuxkit/linuxkit/pull/2000 +[#2001]: https://github.com/linuxkit/linuxkit/pull/2001 +[#2002]: https://github.com/linuxkit/linuxkit/pull/2002 +[#2003]: https://github.com/linuxkit/linuxkit/pull/2003 +[#2004]: https://github.com/linuxkit/linuxkit/pull/2004 +[#2005]: https://github.com/linuxkit/linuxkit/pull/2005 +[#2006]: https://github.com/linuxkit/linuxkit/issues/2006 +[#2007]: https://github.com/linuxkit/linuxkit/pull/2007 +[#2008]: https://github.com/linuxkit/linuxkit/pull/2008 +[#2009]: https://github.com/linuxkit/linuxkit/pull/2009 +[#2010]: https://github.com/linuxkit/linuxkit/pull/2010 +[#2011]: https://github.com/linuxkit/linuxkit/pull/2011 +[#2012]: https://github.com/linuxkit/linuxkit/pull/2012 +[#2013]: https://github.com/linuxkit/linuxkit/pull/2013 +[#2014]: https://github.com/linuxkit/linuxkit/pull/2014 +[#2015]: https://github.com/linuxkit/linuxkit/issues/2015 +[#2016]: https://github.com/linuxkit/linuxkit/pull/2016 +[#2017]: https://github.com/linuxkit/linuxkit/pull/2017 +[#2018]: https://github.com/linuxkit/linuxkit/issues/2018 +[#748]: https://github.com/linuxkit/linuxkit/issues/748 +[linuxkit-ci]: https://github.com/linuxkit/linuxkit-ci +[rtf]: https://github.com/linuxkit/rtf +[rtf#16]: https://github.com/linuxkit/rtf/issues/16 +[rtf#17]: https://github.com/linuxkit/rtf/pull/17 +[rtf#18]: https://github.com/linuxkit/rtf/pull/18 +[rtf#19]: https://github.com/linuxkit/rtf/pull/19 +[virtsock]: https://github.com/linuxkit/virtsock +[virtsock#31]: https://github.com/linuxkit/virtsock/pull/31 +[virtsock#32]: https://github.com/linuxkit/virtsock/pull/32