All the mail mirrored from lore.kernel.org
 help / color / mirror / Atom feed
From: Andrew Cooper <andrew.cooper3@citrix.com>
To: Xen-devel <xen-devel@lists.xen.org>
Cc: Wei Liu <wei.liu2@citrix.com>,
	Ian Campbell <Ian.Campbell@citrix.com>,
	Wen Congyang <wency@cn.fujitsu.com>,
	Andrew Cooper <andrew.cooper3@citrix.com>,
	Ian Jackson <Ian.Jackson@eu.citrix.com>,
	Yang Hongyang <yanghy@cn.fujitsu.com>
Subject: [PATCH v3 00/27]  Libxl migration v2
Date: Mon, 13 Jul 2015 13:01:19 +0100	[thread overview]
Message-ID: <1436788907-1921-1-git-send-email-andrew.cooper3@citrix.com> (raw)

This series adds support for the libxl migration v2 stream, and untangles the
existing layering violations of the toolstack and qemu records.

It can be found on the branch "libxl-migv2-v3"
  git://xenbits.xen.org/people/andrewcoop/xen.git
  http://xenbits.xen.org/git-http/people/andrewcoop/xen.git

No major changes over v2, but a lot of minor changes following review.

At the end of the series, legacy migration is no longer used.

The Remus code is untested by me.  All other combinations of
suspend/migrate/resume have been tested with PV and HVM guests (qemu-trad and
qemu-upstream), including 32 -> 64 bit migration (which was the underlying bug
causing us to write migration v2 in the first place).

Anyway, thoughts/comments welcome.  Please test!

~Andrew

Summary of Acks/Modified/New from v2

A   bsd-sys-queue-h-seddery: Massage `offsetof'
A   tools/libxc: Always compile the compat qemu variables into xc_sr_context
A   tools/libxl: Introduce ROUNDUP()
AM  tools/libxl: Introduce libxl__kill()
A   tools/libxl: Stash all restore parameters in domain_create_state
A   tools/libxl: Split libxl__domain_create_state.restore_fd in two
 M  tools/libxl: Extra management APIs for the save helper
  N tools/libxl: Add save_helper_state pointers to libxl__xc_domain_{save,restore}()
A   tools/xl: Mandatory flag indicating the format of the migration stream
A   docs: Libxl migration v2 stream specification
A   tools/python: Libxc migration v2 infrastructure
A   tools/python: Libxl migration v2 infrastructure
A   tools/python: Other migration infrastructure
A   tools/python: Verification utility for v2 stream spec compliance
A   tools/python: Conversion utility for legacy migration streams
A   tools/libxl: Migration v2 stream format
 M  tools/libxl: Infrastructure for reading a libxl migration v2 stream
 M  tools/libxl: Infrastructure to convert a legacy stream
 M  tools/libxl: Convert a legacy stream if needed
 M  tools/libxc+libxl+xl: Restore v2 streams
 M  tools/libxl: Infrastructure for writing a v2 stream
 M  tools/libxc+libxl+xl: Save v2 streams
A   docs/libxl: Introduce CHECKPOINT_END to support migration v2 remus streams
AM  tools/libxl: Write checkpoint records into the stream
 M  tools/libx{c,l}: Introduce restore_callbacks.checkpoint()
 M  tools/libxl: Handle checkpoint records in a libxl migration v2 stream
A   tools/libxc: Drop all XG_LIBXL_HVM_COMPAT code from libxc
A   tools/libxl: Drop all knowledge of toolstack callbacks

Andrew Cooper (24):
  tools/libxc: Always compile the compat qemu variables into xc_sr_context
  tools/libxl: Introduce ROUNDUP()
  tools/libxl: Introduce libxl__kill()
  tools/libxl: Stash all restore parameters in domain_create_state
  tools/libxl: Split libxl__domain_create_state.restore_fd in two
  tools/libxl: Extra management APIs for the save helper
  tools/libxl: Add save_helper_state pointers to libxl__xc_domain_{save,restore}()
  tools/xl: Mandatory flag indicating the format of the migration stream
  docs: Libxl migration v2 stream specification
  tools/python: Libxc migration v2 infrastructure
  tools/python: Libxl migration v2 infrastructure
  tools/python: Other migration infrastructure
  tools/python: Verification utility for v2 stream spec compliance
  tools/python: Conversion utility for legacy migration streams
  tools/libxl: Infrastructure to convert a legacy stream
  tools/libxl: Convert a legacy stream if needed
  tools/libxc+libxl+xl: Restore v2 streams
  tools/libxc+libxl+xl: Save v2 streams
  docs/libxl: Introduce CHECKPOINT_END to support migration v2 remus streams
  tools/libxl: Write checkpoint records into the stream
  tools/libx{c,l}: Introduce restore_callbacks.checkpoint()
  tools/libxl: Handle checkpoint records in a libxl migration v2 stream
  tools/libxc: Drop all XG_LIBXL_HVM_COMPAT code from libxc
  tools/libxl: Drop all knowledge of toolstack callbacks

Ian Jackson (1):
  bsd-sys-queue-h-seddery: Massage `offsetof'

Ross Lagerwall (3):
  tools/libxl: Migration v2 stream format
  tools/libxl: Infrastructure for reading a libxl migration v2 stream
  tools/libxl: Infrastructure for writing a v2 stream

 docs/specs/libxl-migration-stream.pandoc           |  217 ++++++
 tools/include/xen-external/bsd-sys-queue-h-seddery |    2 +
 tools/libxc/Makefile                               |    2 -
 tools/libxc/include/xenguest.h                     |    7 +
 tools/libxc/xc_sr_common.h                         |   12 +-
 tools/libxc/xc_sr_restore.c                        |   71 +-
 tools/libxc/xc_sr_restore_x86_hvm.c                |  124 ----
 tools/libxc/xc_sr_save_x86_hvm.c                   |   36 -
 tools/libxl/Makefile                               |    7 +
 tools/libxl/libxl.h                                |   19 +
 tools/libxl/libxl_aoutils.c                        |   15 +
 tools/libxl/libxl_convert_callout.c                |  158 ++++
 tools/libxl/libxl_create.c                         |   91 ++-
 tools/libxl/libxl_dom.c                            |  107 +--
 tools/libxl/libxl_internal.h                       |  172 ++++-
 tools/libxl/libxl_no_convert_callout.c             |   35 +
 tools/libxl/libxl_save_callout.c                   |  117 ++-
 tools/libxl/libxl_save_helper.c                    |   33 +-
 tools/libxl/libxl_save_msgs_gen.pl                 |    9 +-
 tools/libxl/libxl_sr_stream_format.h               |   58 ++
 tools/libxl/libxl_stream_read.c                    |  768 ++++++++++++++++++++
 tools/libxl/libxl_stream_write.c                   |  525 +++++++++++++
 tools/libxl/libxl_types.idl                        |    1 +
 tools/libxl/xl_cmdimpl.c                           |    9 +-
 tools/python/Makefile                              |    4 +
 tools/python/scripts/convert-legacy-stream         |  678 +++++++++++++++++
 tools/python/scripts/verify-stream-v2              |  174 +++++
 tools/python/setup.py                              |    1 +
 tools/python/xen/migration/legacy.py               |  279 +++++++
 tools/python/xen/migration/libxc.py                |  446 ++++++++++++
 tools/python/xen/migration/libxl.py                |  199 +++++
 tools/python/xen/migration/public.py               |   21 +
 tools/python/xen/migration/tests.py                |   54 ++
 tools/python/xen/migration/verify.py               |   37 +
 tools/python/xen/migration/xl.py                   |   12 +
 35 files changed, 4071 insertions(+), 429 deletions(-)
 create mode 100644 docs/specs/libxl-migration-stream.pandoc
 create mode 100644 tools/libxl/libxl_convert_callout.c
 create mode 100644 tools/libxl/libxl_no_convert_callout.c
 create mode 100644 tools/libxl/libxl_sr_stream_format.h
 create mode 100644 tools/libxl/libxl_stream_read.c
 create mode 100644 tools/libxl/libxl_stream_write.c
 create mode 100755 tools/python/scripts/convert-legacy-stream
 create mode 100755 tools/python/scripts/verify-stream-v2
 create mode 100644 tools/python/xen/migration/__init__.py
 create mode 100644 tools/python/xen/migration/legacy.py
 create mode 100644 tools/python/xen/migration/libxc.py
 create mode 100644 tools/python/xen/migration/libxl.py
 create mode 100644 tools/python/xen/migration/public.py
 create mode 100644 tools/python/xen/migration/tests.py
 create mode 100644 tools/python/xen/migration/verify.py
 create mode 100644 tools/python/xen/migration/xl.py

--
1.7.10.4

             reply	other threads:[~2015-07-13 12:01 UTC|newest]

Thread overview: 62+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-07-13 12:01 Andrew Cooper [this message]
2015-07-13 12:01 ` [PATCH v3 01/28] bsd-sys-queue-h-seddery: Massage `offsetof' Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 02/28] tools/libxc: Always compile the compat qemu variables into xc_sr_context Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 03/28] tools/libxl: Introduce ROUNDUP() Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 04/28] tools/libxl: Introduce libxl__kill() Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 05/28] tools/libxl: Stash all restore parameters in domain_create_state Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 06/28] tools/libxl: Split libxl__domain_create_state.restore_fd in two Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 07/28] tools/libxl: Extra management APIs for the save helper Andrew Cooper
2015-07-13 13:21   ` Ian Campbell
2015-07-13 15:01   ` Ian Jackson
2015-07-13 12:01 ` [PATCH v3 08/28] tools/libxl: Add save_helper_state pointers to libxl__xc_domain_{save, restore}() Andrew Cooper
2015-07-13 13:24   ` Ian Campbell
2015-07-13 12:01 ` [PATCH v3 09/28] tools/xl: Mandatory flag indicating the format of the migration stream Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 10/28] docs: Libxl migration v2 stream specification Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 11/28] tools/python: Libxc migration v2 infrastructure Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 12/28] tools/python: Libxl " Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 13/28] tools/python: Other migration infrastructure Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 14/28] tools/python: Verification utility for v2 stream spec compliance Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 15/28] tools/python: Conversion utility for legacy migration streams Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 16/28] tools/libxl: Migration v2 stream format Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 17/28] tools/libxl: Infrastructure for reading a libxl migration v2 stream Andrew Cooper
2015-07-13 13:42   ` Ian Campbell
2015-07-13 13:53     ` Andrew Cooper
2015-07-13 14:11       ` Ian Jackson
2015-07-13 14:03     ` Ian Jackson
2015-07-13 14:31   ` Ian Jackson
2015-07-13 14:53     ` Andrew Cooper
2015-07-13 15:33       ` Ian Jackson
2015-07-13 15:08   ` Ian Jackson
2015-07-13 15:13     ` Andrew Cooper
2015-07-13 15:35       ` Ian Jackson
2015-07-13 12:01 ` [PATCH v3 18/28] tools/libxl: Infrastructure to convert a legacy stream Andrew Cooper
2015-07-13 14:45   ` Ian Jackson
2015-07-13 15:08     ` Andrew Cooper
2015-07-13 15:44       ` Ian Jackson
2015-07-13 15:53         ` Andrew Cooper
2015-07-13 15:56           ` Ian Jackson
2015-07-13 16:04           ` Ian Campbell
2015-07-13 12:01 ` [PATCH v3 19/28] tools/libxl: Convert a legacy stream if needed Andrew Cooper
2015-07-13 14:51   ` Ian Jackson
2015-07-13 15:20     ` Andrew Cooper
2015-07-13 15:44       ` Ian Jackson
2015-07-13 12:01 ` [PATCH v3 20/28] tools/libxc+libxl+xl: Restore v2 streams Andrew Cooper
2015-07-13 15:02   ` Ian Jackson
2015-07-13 12:01 ` [PATCH v3 21/28] tools/libxl: Infrastructure for writing a v2 stream Andrew Cooper
2015-07-13 15:09   ` Ian Jackson
2015-07-13 15:21   ` Ian Jackson
2015-07-13 15:33     ` Andrew Cooper
2015-07-13 15:47       ` Ian Jackson
2015-07-13 15:56         ` Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 22/28] tools/libxc+libxl+xl: Save v2 streams Andrew Cooper
2015-07-13 15:25   ` Ian Jackson
2015-07-13 12:01 ` [PATCH v3 23/28] docs/libxl: Introduce CHECKPOINT_END to support migration v2 remus streams Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 24/28] tools/libxl: Write checkpoint records into the stream Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 25/28] tools/libx{c, l}: Introduce restore_callbacks.checkpoint() Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 26/28] tools/libxl: Handle checkpoint records in a libxl migration v2 stream Andrew Cooper
2015-07-13 13:53   ` Ian Campbell
2015-07-14 10:33   ` Yang Hongyang
2015-07-14 10:35     ` Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 27/28] tools/libxc: Drop all XG_LIBXL_HVM_COMPAT code from libxc Andrew Cooper
2015-07-13 12:01 ` [PATCH v3 28/28] tools/libxl: Drop all knowledge of toolstack callbacks Andrew Cooper
2015-07-13 15:55   ` Ian Jackson

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1436788907-1921-1-git-send-email-andrew.cooper3@citrix.com \
    --to=andrew.cooper3@citrix.com \
    --cc=Ian.Campbell@citrix.com \
    --cc=Ian.Jackson@eu.citrix.com \
    --cc=wei.liu2@citrix.com \
    --cc=wency@cn.fujitsu.com \
    --cc=xen-devel@lists.xen.org \
    --cc=yanghy@cn.fujitsu.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.