Tutorial-JavaCoG-Nov-02

Laszewsk

Informations

• Publié par: Naphug
• Nombre de lectures: 44
• Langue: English

Extrait

www.globus.org/cog
Java CoG Kit Tutorial
Presented by
Gregor von Laszewski
[e-mail]
Argonne National Laboratory
Nov. 2002
prepared by
Gregor, Beulah, Sandeep, Jarek
1
www.globus.org/cog
Objectives
•L e a r n a b o u t
–What are Grids?
– What is the Java CoG Kit, and why do I want to
use it?
– Why would I not want to use the Java CoG Kit?
– How do I use the Java CoG Kit?
– How do I develop my own components with the
Java CoG Kit?
– How can I participate?
•Conclusion
• Future
2
1www.globus.org/cog
Introduction to Grids
•Grids
– What is a Grid?
– What is the Globus Toolkit?
– What is a Commodity Grid Kit?
• Using and Programming Grids with the Java
CoG Kit
– Secure access to remote resources
– Remote job submission and monitoring
– Distributed grid information management and
remote data access
– Graphical component to access a Grid
• Conclusion for this part of the presentation
3
www.globus.org/cog
Motivation
• Climatology => Grids can help
sensors scientists compute and storage consumer
facilities
measure collaborate calculate deliver
observations model prediction
feedback
• von Laszewski, et al. Gestalt of the Grid, http://www.mcs.anl.gov/~gregor/bib 4
2www.globus.org/cog
An Example Application:
An Advanced Scientific Instrument
Virtual Reality Cave
Advanced Photon Source
ScientistAvatar
Sensor Nets
Instruments
Supercomputer
Network
Electronic Library Computing Portal
Clientsand Databases
• von Laszewski, et al. Computational Grid Capabilities to Enhance the Ability of an X-Ray Source for Structural
Biology. Cluster Computing, 3(3):187-199, 2000. 5
www.globus.org/cog
Definitions
• von Laszewski, et al. Gestalt of the Grid, http://www.mcs.anl.gov/~gregor/bib
• Definition: Grid approach
– The Grid approach promotes a vision for sophisticated international scientific and
business-oriented collaborations.
• Definition: Grid
– An infrastructure that allows for flexible, secure, coordinated resource sharing among
dynamic collections of individuals, resources, and organizations.
• Definition: Production Grid
– An instantiation of a Grid that manifests itself by including a set of resources to be
accessed by Grid users.
• Definition: Community Production Grid
– A production Grid in which the creation and maintenance are performed by a
community of users, developers, and administrators.
• Definition: Virtual Organization
– An organization that defines rules that guide membership and use of individuals,
resources, and institutions within a community production Grid.
• Definition: Grid Plant
– A high end resource that is integrated in a virtual organization and can be shared by
its users.
• Definition: Grid Appliance
– A device that can be integrated into a Grid while providing the user with a service
that uses resources accessible through the Grid.
• Definition: Sporadic or ad-hoc Grid
– A Grid that is instantiated for a finite amount of time on a potential ad-hoc basis
through sporadic needs by the members defining a transient virtual organization
6
3www.globus.org/cog
Grid Architecture
• Review of Grid research provides multiple
architectures dependent on which aspect of
the Grid is emphasized
– N-Tier Layered Architecture
– Role-based Layered Architecture
– Service-based Architecture
7
www.globus.org/cog
N-Tier Layered Architecture
• Emphasize on the user
System Level User Level
Applications
Grid Advanced
Middleware
Fabric Services
Portals
8
4High End Technologies
www.globus.org/cog
Role-Based Layered Architecture
• separation between individual and
collective resources
Application Services and User Applications
Development Tools
Distributed Information Services, Collective Services
Brokering, and Monitoring
Resource andSecure Access
Connectivityto
LayerResources and
Services
Physical Devices and
Resources such as
FabricComputers, Storage,
Networks, and Sensors
9
www.globus.org/cog
Service Based Architecture
• Definition: Service
– A platform-independent software component
published within a directory or registry by a
service provider.
Registry
find
publish
Requestor Provider
bind
10
5
Commodity Technologieswww.globus.org/cog
Grid Computing and Existing
Technologies
• Commonalities between “Grid computing”
and major industrial thrusts
– Business-to-business, peer-to-peer, application
service providers, storage service providers,
distributed computing, Internet computing
• Differences between Grid computing and
existing technologies
– Complicated requirements: “Run program X at
site Y subject to community policy P, providing
access to data at Z according to policy Q”
– High performance: unique demands of advanced
& high-performance systems
11
www.globus.org/cog
What challenges do we have to
solve?
• Authenticate once
• Specify simulation (code, resources, etc.)
• Locate resources
• Negotiate authorization, acceptable use, etc.
• Acquire resources
• Initiate computation
• Steer computation
• Access remote datasets
Domain 1• Collaborate on results
• Account for usage Domain 2
12
6www.globus.org/cog
The Globus Toolkit
The Globus Toolkit provides a range of basic
Grid Services
– Security, information, fault detection,
communication, resource management
• These services are simple and orthogonal
– Independently use: mix and match
– Programming model independence
• For each service there is generally a well-
defined API
• Standards are used extensively
– E.g. LDAP, GSS-API, X.509
13
www.globus.org/cog
Globus Approach
• A toolkit and collection of services addressing
key technical problems
–Modular “bag of services” model
–Not a vertically integrated solution
–General infrastructure tools (aka
middleware) that can be applied to many
application domains
• Interdomain issues, rather than clustering
–Integration of intradomain solutions
• Distinction between local and global services
14
7Internet Protocol Architecture
www.globus.org/cog
Globus Hourglass
A p p l i c a t i o n s • Focus on architecture
issues Diverse global services
– Propose set of core
services as basic
infrastructure
– Use to construct high-level,
Core Globusdomain-specific solutions
services
• Design principles
– Keep participation cost low
– Enable local control
–Support adaptation
Local OS• “IP hourglass” model
15
www.globus.org/cog
Layered Grid Architecture
Application
Collective Applica-
tion
Resource
Connectivity Transport
Internet
LinkFabric
16
8www.globus.org/cog
Production Grids & Testbeds
First Grid Testbed
The Alliance National Technology Grid
NASA’s Information Power Grid
17
www.globus.org/cog
Key Grid Services
• Resource Discovery
– List all of the solaris machines with at least 16
processors and 2 Gig’s of memory
• Resource Acquisition
– Submit my job to this machine
• Data Management/Movement
– Locate, or create, a replica of this data set
– Move this data set to this host
• Security
– Authentication
– Authorization
18
9www.globus.org/cog
Grid Security Infrastructure
• Standards based infrastructure that
provides:
–Single sign-on
–Authentication & data
integrity/confidentiality
–Delegation
•Based on:
– X.509 Proxy certificates (draft ietf
pkix standard)
–TLS
–GSS-API 19
www.globus.org/cog
Example: Delegation in GSI
1.
ClientGSI Proxy
1. Create Grid Proxy
2. Mutual Authentication2.
7. – client-compute resource
Credential 4.Compute Resource 3. Delegate Credential
3.
GSI Proxy 4. Submit and Start Job
5.6. 5. Mutual Authentication
– compute res.- storrage
6. Retrieve Data Set
Tertiary Storage 7. Run Computation
20
10