Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
View analytic
Thursday, May 21 • 9:00am - 9:40am
Big Data Analytics and Docker: The Thrilla in Manila

Sign up or log in to save this to your schedule and see who's attending!

Docker containers are an ideal platform for the Big Data analytics use case because of their unique security and performance advantages.  Big Data work loads typically use distributed file systems to provide shared access to both input and output data sets. OpenStack Manila is an excellent way to manage distributed file systems in the Cloud environment. Applications like Spark and Hadoop add the analytics engine to complete the picture.

 

In this talk, we describe how we use Manila, Nova-docker and our distributed file system to allow Big Data clients in OpenStack, distributed across various compute nodes, to access large amounts of data in a shared, load-balanced and multi-tenant fashion.  We will discuss our experience deploying this cloud service, in use today by a collection universities, and provide a brief demo.

Speakers
avatar for Nilesh Bhosale

Nilesh Bhosale

Advisory Software Engineer, IBM
Nilesh Bhosale is a working as a member of IBM Storage & SDS CTO office, closely working with IBM's Spectrum Scale (a.k.a. General Parallel File System) team.  He is responsible for the integration of OpenStack with GPFS and has been actively contributing to OpenStack Cinder, Manila projects.  He is also working on integrating and enhancing OpenStack Swift object store with IBM Spectrum Scale object offering. | He has been... Read More →
avatar for Dean Hildebrand

Dean Hildebrand

Research Staff Member - IBM Research
Dean Hildebrand is a researcher at the IBM Almaden Research Center and a recognized expert in the field of object storage as well as distributed and parallel file systems. Dr. Hildebrand pioneered pNFS, demonstrating the feasibility of providing standard and scalable access to any file system. He received a B.Sc. degree in computer science from the University of British Columbia in 1998 and M.S. and PhD. degrees in computer science from... Read More →
avatar for Michael Hines

Michael Hines

Research Staff Member, IBM
I enjoy creating and analyzing experimental systems software and networks. Particularly when the application (usually) does not know where its resources are coming from. Sometimes that involves manipulating the OS. Sometimes writing a network protocol. Or it may, perhaps, require a virtual machine/container. http://michael.hinespot.com
avatar for Bill Owen

Bill Owen

Senior Software Engineer - IBM, IBM
Bill Owen is Senior Software Engineer with IBM's General Parallel File System team.  He is responsible for the integration of OpenStack with GPFS.  He has worked in various development roles within IBM for the past 15 years.  Prior to joining IBM, Bill developed and deployed grid management software for electric utilities.


Thursday May 21, 2015 9:00am - 9:40am
Room 109

Attendees (228)