-
Simulation Framework for Modeling Large-Scale Distributed Systems
Authors:
Dobre Ciprian,
Cristea Valentin,
Iosif C. Legrand
Abstract:
Simulation has become the evaluation method of choice for many areas of distributing computing research. However, most existing simulation packages have several limitations on the size and complexity of the system being modeled. Fine grained simulation of complex systems such as Grids requires high computational effort which can only be obtained by using an underlying distributed architecture. We…
▽ More
Simulation has become the evaluation method of choice for many areas of distributing computing research. However, most existing simulation packages have several limitations on the size and complexity of the system being modeled. Fine grained simulation of complex systems such as Grids requires high computational effort which can only be obtained by using an underlying distributed architecture. We are proposing a new distributed simulation system that has the advantage of being able to model very complex distributed systems while hiding the computational effort from the end-user.
△ Less
Submitted 30 June, 2011;
originally announced June 2011.
-
A distributed service for on demand end to end optical circuits
Authors:
Ramiro Voicu,
Iosif Legrand,
Harvey Newman,
Nicolae Tapus,
Ciprian Dobre
Abstract:
In this paper we present a system for monitoring and controlling dynamic network circuits inside the USLHCNet network. This distributed service system provides in near real-time complete topological information for all the circuits, resource allocation and usage, accounting, detects automatically failures in the links and network equipment, generate alarms and has the functionality to take automat…
▽ More
In this paper we present a system for monitoring and controlling dynamic network circuits inside the USLHCNet network. This distributed service system provides in near real-time complete topological information for all the circuits, resource allocation and usage, accounting, detects automatically failures in the links and network equipment, generate alarms and has the functionality to take automatic actions. The system is developed based on the MonALISA framework, which provides a robust monitoring and controlling service oriented architecture, with no single points of failure.
△ Less
Submitted 28 June, 2011;
originally announced June 2011.
-
A Distributed Agent Based System to Control and Coordinate Large Scale Data Transfers
Authors:
Ciprian Dobre,
Ramiro Voicu,
Adrian Muraru,
Iosif C. Legrand
Abstract:
We present a distributed agent based system used to monitor, configure and control complex, large scale data transfers in the Wide Area Network. The Localhost Information Service Agent (LISA) is a lightweight dynamic service that provides complete system and applications monitoring, is capable to dynamically configure system parameters and can help in optimizing distributed applications.
As part…
▽ More
We present a distributed agent based system used to monitor, configure and control complex, large scale data transfers in the Wide Area Network. The Localhost Information Service Agent (LISA) is a lightweight dynamic service that provides complete system and applications monitoring, is capable to dynamically configure system parameters and can help in optimizing distributed applications.
As part of the MonALISA (Monitoring Agents in A Large Integrated Services Architecture) system, LISA is an end host agent capable to collect any type of monitoring information, to distribute them, and to take actions based on local or global decision units. The system has been used for the Bandwidth Challenge at Supercomputing 2006 to coordinate global large scale data transfers using Fast Data Transfer (FDT) application between hundreds of servers distributed on major Grid sites involved in processing High Energy Physics data for the future Large Hadron Collider experiments.
△ Less
Submitted 25 June, 2011;
originally announced June 2011.
-
LISA (Localhost Information Service Agent)
Authors:
Iosif C. Legrand,
Ciprian Dobre,
Ramiro Voicu,
Corina Stratan,
Catalin Cirstoiu,
Lucian Musat
Abstract:
Grid computing has gained an increasing importance in the last years, especially in the academic environments, offering the possibility to rapidly solve complex scientific problems. The monitoring of the Grid jobs has a vital importance for analyzing the system's performance, for providing the users an appropriate feed-back, and for obtaining historical data which may be used for performance predi…
▽ More
Grid computing has gained an increasing importance in the last years, especially in the academic environments, offering the possibility to rapidly solve complex scientific problems. The monitoring of the Grid jobs has a vital importance for analyzing the system's performance, for providing the users an appropriate feed-back, and for obtaining historical data which may be used for performance prediction. Several monitoring systems have been developed, with different strategies to collect and store the information. We shall present here a solution based on MonALISA, a distributed service for monitoring, control and global optimization of complex systems, and LISA, a component application of MonALISA which can help in optimizing other applications by means of monitoring services. The advantages of this system are, among others, flexibility, dynamic configuration, high communication performance.
△ Less
Submitted 25 June, 2011;
originally announced June 2011.
-
A Simulation Study for T0/T1 Data Replication and Production Activities
Authors:
Iosif Legrand,
Ciprian Dobre,
Ramiro Voicu,
Corina Stratan,
Catalin Cirstoiu,
Lucian Musat
Abstract:
This paper discusses the latest generation of the MONARC (MOdels of Networked Analysis at Regional Centers) simulation framework, as a design and modeling tool for large scale distributed systems applied to HEP experiments. The simulation of Grid architectures has a vital importance in the future deployment of Grid systems for providing the users an appropriate feed-back. We present here an exampl…
▽ More
This paper discusses the latest generation of the MONARC (MOdels of Networked Analysis at Regional Centers) simulation framework, as a design and modeling tool for large scale distributed systems applied to HEP experiments. The simulation of Grid architectures has a vital importance in the future deployment of Grid systems for providing the users an appropriate feed-back. We present here an example of simulating complex data processing systems and the way the framework is used to optimize the overall Grid architecture and/or the policies that govern the Grid's use.
△ Less
Submitted 25 June, 2011;
originally announced June 2011.
-
MonALISA : A Distributed Monitoring Service Architecture
Authors:
H. B. Newman,
I. C. Legrand,
P. Galvez,
R. Voicu,
C. Cirstoiu
Abstract:
The MonALISA (Monitoring Agents in A Large Integrated Services Architecture) system provides a distributed monitoring service. MonALISA is based on a scalable Dynamic Distributed Services Architecture which is designed to meet the needs of physics collaborations for monitoring global Grid systems, and is implemented using JINI/JAVA and WSDL/SOAP technologies. The scalability of the system derive…
▽ More
The MonALISA (Monitoring Agents in A Large Integrated Services Architecture) system provides a distributed monitoring service. MonALISA is based on a scalable Dynamic Distributed Services Architecture which is designed to meet the needs of physics collaborations for monitoring global Grid systems, and is implemented using JINI/JAVA and WSDL/SOAP technologies. The scalability of the system derives from the use of multithreaded Station Servers to host a variety of loosely coupled self-describing dynamic services, the ability of each service to register itself and then to be discovered and used by any other services, or clients that require such information, and the ability of all services and clients subscribing to a set of events (state changes) in the system to be notified automatically. The framework integrates several existing monitoring tools and procedures to collect parameters describing computational nodes, applications and network performance. It has built-in SNMP support and network-performance monitoring algorithms that enable it to monitor end-to-end network performance as well as the performance and state of site facilities in a Grid. MonALISA is currently running around the clock on the US CMS test Grid as well as an increasing number of other sites. It is also being used to monitor the performance and optimize the interconnections among the reflectors in the VRVS system.
△ Less
Submitted 16 June, 2003;
originally announced June 2003.
-
The CMS Integration Grid Testbed
Authors:
Gregory E. Graham,
M. Anzar Afaq,
Shafqat Aziz,
L. A. T. Bauerdick,
Michael Ernst,
Joseph Kaiser,
Natalia Ratnikova,
Hans Wenzel,
Yujun Wu,
Erik Aslakson,
Julian Bunn,
Saima Iqbal,
Iosif Legrand,
Harvey Newman,
Suresh Singh,
Conrad Steenberg,
James Branson,
Ian Fisk,
James Letts,
Adam Arbree,
Paul Avery,
Dimitri Bourilkov,
Richard Cavanaugh,
Jorge Rodriguez,
Suchindra Kategari
, et al. (5 additional authors not shown)
Abstract:
The CMS Integration Grid Testbed (IGT) comprises USCMS Tier-1 and Tier-2 hardware at the following sites: the California Institute of Technology, Fermi National Accelerator Laboratory, the University of California at San Diego, and the University of Florida at Gainesville. The IGT runs jobs using the Globus Toolkit with a DAGMan and Condor-G front end. The virtual organization (VO) is managed us…
▽ More
The CMS Integration Grid Testbed (IGT) comprises USCMS Tier-1 and Tier-2 hardware at the following sites: the California Institute of Technology, Fermi National Accelerator Laboratory, the University of California at San Diego, and the University of Florida at Gainesville. The IGT runs jobs using the Globus Toolkit with a DAGMan and Condor-G front end. The virtual organization (VO) is managed using VO management scripts from the European Data Grid (EDG). Gridwide monitoring is accomplished using local tools such as Ganglia interfaced into the Globus Metadata Directory Service (MDS) and the agent based Mona Lisa. Domain specific software is packaged and installed using the Distrib ution After Release (DAR) tool of CMS, while middleware under the auspices of the Virtual Data Toolkit (VDT) is distributed using Pacman. During a continuo us two month span in Fall of 2002, over 1 million official CMS GEANT based Monte Carlo events were generated and returned to CERN for analysis while being demonstrated at SC2002. In this paper, we describe the process that led to one of the world's first continuously available, functioning grids.
△ Less
Submitted 10 June, 2003; v1 submitted 30 May, 2003;
originally announced May 2003.
-
DIAMOnDS - DIstributed Agents for MObile & Dynamic Services
Authors:
Aamir Shafi,
Umer Farooq,
Saad Kiani,
Maria Riaz,
Anjum Shehzad,
Arshad Ali,
Iosif Legrand,
Harvey Newman
Abstract:
Distributed Services Architecture with support for mobile agents between services, offer significantly improved communication and computational flexibility. The uses of agents allow execution of complex operations that involve large amounts of data to be processed effectively using distributed resources. The prototype system Distributed Agents for Mobile and Dynamic Services (DIAMOnDS), allows a…
▽ More
Distributed Services Architecture with support for mobile agents between services, offer significantly improved communication and computational flexibility. The uses of agents allow execution of complex operations that involve large amounts of data to be processed effectively using distributed resources. The prototype system Distributed Agents for Mobile and Dynamic Services (DIAMOnDS), allows a service to send agents on its behalf, to other services, to perform data manipulation and processing. Agents have been implemented as mobile services that are discovered using the Jini Lookup mechanism and used by other services for task management and communication. Agents provide proxies for interaction with other services as well as specific GUI to monitor and control the agent activity. Thus agents acting on behalf of one service cooperate with other services to carry out a job, providing inter-operation of loosely coupled services in a semi-autonomous way. Remote file system access functionality has been incorporated by the agent framework and allows services to dynamically share and browse the file system resources of hosts, running the services. Generic database access functionality has been implemented in the mobile agent framework that allows performing complex data mining and processing operations efficiently in distributed system. A basic data searching agent is also implemented that performs a query based search in a file system. The testing of the framework was carried out on WAN by moving Connectivity Test agents between AgentStations in CERN, Switzerland and NUST, Pakistan.
△ Less
Submitted 13 June, 2003; v1 submitted 30 May, 2003;
originally announced May 2003.