Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
View analytic
Monday, May 18 • 5:30pm - 6:10pm
Being a shepherd in the clouds.

Sign up or log in to save this to your schedule and see who's attending!



Problem:

Any Openstack operator running a large cloud will eventually find a need to move tenants between zones quickly for:

  • Newly added capacity in a new zone

  • OpenStack version upgrade

  • Cross datacenter migration / cloning

Naïve solution:
A simple way to migrate tenants across zones without Flyway is to use Nova and Glance to create a snapshot, download and upload it to the other zone and nova-boot the new VM instance. The downside to this is that glance needs to store and move a lot of redundant data as this the VM's base image that is logically copied over for every snapshot taken. Plus destination not an exact copy of the source, compute and storage wise.

 

Our Solution:

At EBay/PayPal we have developed Flyway, a tool which enables seamless migration of a tenant from one datacenter to another.




  • Tenant view - Can move the array of tenant specific resources (users, roles, key pairs, quotas etc).

  • VM, cinder instances, volume data and images from source to target.

  • Hypervisors connects to Celery task queue and a message bus enables the transport of VM’s sparse files directly from their source to target hypervisors efficiently. Thus avoiding the redundant data migration as explained above.

To monitor and visualize the progress of Flyway as it runs, we also developed the Flyview utility.  This tool gives a bird’s eye view of a zone and helps us see patterns of usage and quickly identify unusual tenants.  It generates SVG images as well as animated GIFs of the zones over their lifetime providing a very insightful visualization.



Speakers
avatar for Rodney Peck

Rodney Peck

Cloud Solutions Architect, eBay / PayPal
Rodney joined the OpenStack team two years back to focus on scaling and capacity issues with OpenStack storage in a real production environment. His background is in large distributed storage systems goes as far back as Excite@Home in the 1990s developing a cable modem network for home users. He worked many years with Yahoo! Groups providing operations devops support, and two years with Yahoo! Mail as the operations architect coordinating many... Read More →
avatar for Darshan Sanghani

Darshan Sanghani

Cloud Engineer, eBay Inc.
I started my adventure in the distributed systems domain after joining eBay Inc. 2 years ago as a software engineer in the company's private cloud team a.k.a C3 (Connected Commerce Cloud). Before finding zen in this gig, I was a student at the evergreen University of Illinois, Urbana-Champaign, hacking on operating systems, distributed systems, node.js, a bunch of front-end javascript frameworks, mobile application developement and a bit of... Read More →


Monday May 18, 2015 5:30pm - 6:10pm
Room 121/122

Attendees (156)