Multi-cloud Deployment of Computing Clusters for Loosely Coupled MTC Applications

Home » Unlabelled » Multi-cloud Deployment of Computing Clusters for Loosely Coupled MTC Applications

Multi-cloud Deployment of Computing Clusters for Loosely Coupled MTC Applications

Posted by hari Saturday, 31 March 2012 1 comment

Abstract:

Cloud computing is gaining acceptance in many IT organizations, as an elastic, flexible, and variable-cost way to deploy their service platforms using outsourced resources. Unlike traditional utilities where a single provider scheme is a common practice, the ubiquitous access to cloud resources easily enables the simultaneous use of different clouds. In this paper, we explore this scenario to deploy a computing cluster on the top of a multicloud infrastructure, for solving loosely coupled Many-Task Computing (MTC) applications. In this way, the cluster nodes can be provisioned with resources from different clouds to improve the cost

effectiveness of the deployment, or to implement high-availability strategies. We prove the viability of this kind of solutions by evaluating the scalability, performance, and cost of different configurations of a Sun Grid Engine cluster, deployed on a multicloud infrastructure spanning a local data center and three different cloud sites: Amazon EC2 Europe, Amazon EC2 US, and ElasticHosts. Although the testbed deployed in this work is limited to a reduced number of computing resources (due to hardware and budget limitations), we have complemented our analysis with a simulated infrastructure model, which includes a larger number of resources, and runs larger problem sizes. Data obtained by simulation show that performance and cost results can be extrapolated to large-scale problems and cluster infrastructures.

Existing System:

· In the existing system building and managing physical clusters exhibits several drawbacks:

· 1) Major investments in hardware, specialized installations (cooling, power, etc.), and qualified personal.

· 2) Long periods of cluster underutilization; and 3) cluster overloading and insufficient computational resources during peak demand periods.

· MANY-TASK Computing (MTC) paradigm embraces different types of high-performance applications involving many different tasks, and requiring large number of computational resources over short periods of time.

· Computing clusters have been one of the most popular platforms for solving MTC problems, especially in the case of loosely coupled tasks.

Proposed System:

· In the proposed system cloud computing technology has been proposed as a viable solution to deploy elastic computing clusters, or to complement the in-house data center infrastructure to satisfy peak workloads.

· In the proposed system we have analyzed the challenges and viability of deploying a computing cluster on top of a multi-cloud infrastructure spanning four different sites for solving loosely coupled MTC applications.

· We have implemented a real test bed cluster (based on a SGE queuing system) that comprises computing resources from our in-house infrastructure, and external resources from three different clouds: Amazon EC2 (Europe and US zones) and Elastic Host.

· We have also implemented a model for simulating larger cluster infrastructures.

· In the proposed system cost analysis shows that, for the workload considered, some hybrid configurations (including local and cloud nodes) exhibit better performance-cost ratio than the local setup.

· We are proving that the multicloud solution is also appealing from a cost perspective.

· We have complemented our analysis with a simulated infrastructure model, which includes a larger number of resources, and runs larger problem sizes.

KEYWORDS:

Generic Technology Keywords: Database, User Interface, Programming

Specific Technology Keywords: C#.Net, Windows Application, MS SqlServer-08

Project Keywords: Presentation, Business Object, Data Access Layer

SDLC Keywords: Analysis, Design, Code, Testing, Implementation, Maintenance

SYSTEM CONFIGURATION

HARDWARE CONFIGURATION

S.NO	HARDWARE	CONFIGURATIONS
1	Operating System	Windows 2000 & XP
2	RAM	1GB
3	Processor (with Speed)	Intel Pentium IV (3.0 GHz) and Upwards
4	Hard Disk Size	40 GB and above
5	Monitor	15’ CRT

SOFTWARE CONFIGURATION

S.NO	SOFTWARE	CONFIGURATIONS
1	Platform	Microsoft Visual Studio
2	Framework	.Net Framework 4.0
3	Language	C#.Net
4	Front End	Windows application(cloud)
5	Back End	SQL Server 2008