Difference between revisions of "Procedure Infrastructure Deployment"
(→gCube Resources) |
|||
| Line 15: | Line 15: | ||
# gHN - The gHN distribution is available from the [http://www.gcube-system.org/ gCube ] website. The [https://gcore.wiki.gcube-system.org/gCube/index.php/Administrator_Guide Administrator Guide] provides detailed information about the gHN installation process. | # gHN - The gHN distribution is available from the [http://www.gcube-system.org/ gCube ] website. The [https://gcore.wiki.gcube-system.org/gCube/index.php/Administrator_Guide Administrator Guide] provides detailed information about the gHN installation process. | ||
| − | #SmartGears - The SmartGears distribution is available from the [http://www.gcube-system.org/ gCube ] website. The [https:// | + | #SmartGears - The SmartGears distribution is available from the [http://www.gcube-system.org/ gCube ] website. The [https://wiki.gcube-system.org/index.php/SmartGears_gHN_Installation Smargears installation guide] provides information about the Smartgears installation process |
# gCube Service - gCube services are installed when new VOs/VREs are deployed. Check the [[Procedure VO Creation|VO Creation]] and [[Procedure VRE Creation|VRE Creation]] procedures. | # gCube Service - gCube services are installed when new VOs/VREs are deployed. Check the [[Procedure VO Creation|VO Creation]] and [[Procedure VRE Creation|VRE Creation]] procedures. | ||
| Line 21: | Line 21: | ||
'''Upgrade''' | '''Upgrade''' | ||
| − | # gHN and SmartGears - The upgrade of gHNs is based on upgrade plans published in the [[Resources Upgrade|Resources Upgrade]] page | + | # gHN and SmartGears - The upgrade of gHNs is based on upgrade plans published in the [[Resources Upgrade|Resources Upgrade]] page. |
| − | # gCube - The upgrade of gCube services is based on upgrade plans published in the [[Resources Upgrade|Resources Upgrade]] page | + | # gCube - The upgrade of gCube services is based on upgrade plans published in the [[Resources Upgrade|Resources Upgrade]] page. |
| − | In order to coordinate Installation and Upgrade activities the [[Role Infrastructure Manager|Infrastructure Managers]] use the [https:// | + | In order to coordinate Installation and Upgrade activities the [[Role Infrastructure Manager|Infrastructure Managers]] use the [https://support.d4science.org/ Redmine system] . For each activity the [[Role Infrastructure Manager|Infrastructure Managers]] should open a "D4Science Infrastructure" RedMine ticket describing the activity to perform and assign it to a [[Role Site Manager|Site Managers]] with a '''Due Date'''. |
[[Role Site Manager|Site Managers]] responsible of the tasks when closing the ticket are supposed to fill the field '''Intervention Time''' with the time spent performing the task. | [[Role Site Manager|Site Managers]] responsible of the tasks when closing the ticket are supposed to fill the field '''Intervention Time''' with the time spent performing the task. | ||
| − | Tickets associated with installation and upgrades are also reported in the [[Resources Upgrade|Resources Upgrade]] page. More information are available on the [http://wiki. | + | Tickets associated with installation and upgrades are also reported in the [[Resources Upgrade|Resources Upgrade]] page. More information are available on the [http://wiki.d4science.org/index.php/Procedure_Infrastructure_upgrade Infrastructure upgrade wiki] |
== UMD Resources == | == UMD Resources == | ||
| Line 35: | Line 35: | ||
UMD components are in general expected to run on dedicated machines. However it maybe be possible to have some UMD components co-existing with other UMD/gCube nodes. For example the UMD [http://repository.egi.eu/2011/07/11/worker-node-1-0-0/ Worker Node ] can be installed in the same machine of a gCube node. | UMD components are in general expected to run on dedicated machines. However it maybe be possible to have some UMD components co-existing with other UMD/gCube nodes. For example the UMD [http://repository.egi.eu/2011/07/11/worker-node-1-0-0/ Worker Node ] can be installed in the same machine of a gCube node. | ||
| − | The UMD nodes of the D4Science | + | The UMD nodes of the D4Science Infrastructure run the following gLite components: Cream_CE, WN, DPM_SE, WMS, LB, VOMS, UI and Apel |
'''Installation''' | '''Installation''' | ||
| Line 43: | Line 43: | ||
The configuration of UMD nodes is performed by a set of shell scripts provided by the [https://twiki.cern.ch/twiki/bin/view/LCG/YaimGuide400 YAIM] framework . The provided configuration scripts can be used by [[Role Site Manager|Site Managers]] with no need for in-depth knowledge of specific middleware configuration details. They must adapt some configuration files, according to provided examples. The resulting configuration is a default site configuration. | The configuration of UMD nodes is performed by a set of shell scripts provided by the [https://twiki.cern.ch/twiki/bin/view/LCG/YaimGuide400 YAIM] framework . The provided configuration scripts can be used by [[Role Site Manager|Site Managers]] with no need for in-depth knowledge of specific middleware configuration details. They must adapt some configuration files, according to provided examples. The resulting configuration is a default site configuration. | ||
| − | Detailed instructions about the installation of UMD can be found in the [http://repository.egi.eu/category/umd_releases/distribution/umd_1/ UMD Installation Guide]. | + | Detailed instructions about the installation of UMD can be found in the [http://repository.egi.eu/category/umd_releases/distribution/umd_1/ UMD Installation Guide]. D4science specific configuration examples can be found [[Nodes_Deployment_Configurations|here]]. |
| Line 55: | Line 55: | ||
== Hadoop and Runtime Resources== | == Hadoop and Runtime Resources== | ||
| − | Hadoop and Runtime Resources installation and upgrades due to the diverse nature of Service and installation type does not follow a predefined installation or upgrade procedure, but as for the gCube Resources each action is associated with a | + | Hadoop and Runtime Resources installation and upgrades due to the diverse nature of Service and installation type does not follow a predefined installation or upgrade procedure, but as for the gCube Resources each action is associated with a Redmine ticket where [[Role Site Manager|Site Managers]] have to report the Intervention Time spent. |
Revision as of 16:09, 2 September 2015
gCube Resources
The gCube nodes of the D4ScienceAn e-Infrastructure operated by the D4Science.org initiative. Infrastructure can be deployed in 32 and 64 bits machines and supports several Linux distributions. It has been tested on CERN Scientific Linux, RedHat Enterprise, Ubuntu, and Fedora.
A gCube node of the D4ScienceAn e-Infrastructure operated by the D4Science.org initiative. Infrastructure is composed by two main constituents:
- A base gHN-distribution or SmartGears distribution Managed locally by Site Managers;
- gCube services running on the gHN or on the Smartgears container. Managed remotely by VO Admins and the VRE Managers.
Installation
- gHN - The gHN distribution is available from the gCube website. The Administrator Guide provides detailed information about the gHN installation process.
- SmartGears - The SmartGears distribution is available from the gCube website. The Smargears installation guide provides information about the Smartgears installation process
- gCube Service - gCube services are installed when new VOs/VREs are deployed. Check the VO Creation and VRE Creation procedures.
Upgrade
- gHN and SmartGears - The upgrade of gHNs is based on upgrade plans published in the Resources Upgrade page.
- gCube - The upgrade of gCube services is based on upgrade plans published in the Resources Upgrade page.
In order to coordinate Installation and Upgrade activities the Infrastructure Managers use the Redmine system . For each activity the Infrastructure Managers should open a "D4ScienceAn e-Infrastructure operated by the D4Science.org initiative. Infrastructure" RedMine ticket describing the activity to perform and assign it to a Site Managers with a Due Date.
Site Managers responsible of the tasks when closing the ticket are supposed to fill the field Intervention Time with the time spent performing the task.
Tickets associated with installation and upgrades are also reported in the Resources Upgrade page. More information are available on the Infrastructure upgrade wiki
UMD Resources
The UMD middleware is composed by several components providing different grid services for distributed computing and storage. The latest stable release is UMD 1.5. This release is certified to run on CERN Scientific Linux 5. All UMD components run on x86_64 architecture
UMD components are in general expected to run on dedicated machines. However it maybe be possible to have some UMD components co-existing with other UMD/gCube nodes. For example the UMD Worker Node can be installed in the same machine of a gCube node.
The UMD nodes of the D4ScienceAn e-Infrastructure operated by the D4Science.org initiative. Infrastructure run the following gLite components: Cream_CE, WN, DPM_SE, WMSSee Workload Management System or Web Mapping Service., LB, VOMSVirtual Organization Membership Service., UI and Apel
Installation
The default installation method for SLC5 packages is the YUM tool. All gLite components have a YUM meta-packages associated.
The configuration of UMD nodes is performed by a set of shell scripts provided by the YAIM framework . The provided configuration scripts can be used by Site Managers with no need for in-depth knowledge of specific middleware configuration details. They must adapt some configuration files, according to provided examples. The resulting configuration is a default site configuration.
Detailed instructions about the installation of UMD can be found in the UMD Installation Guide. D4science specific configuration examples can be found here.
Upgrade
Upgrades in UMD are done on a per component basis. Each upgrade is associated with one web page containing the details of the upgrade and the list of affected components. All updates are announced via the EGI CIC Portal broadcast tool and are requested on a regular basis. Sites are asked to keep their installations up-to-date with respect to the latest update released.
Detailed instructions about the upgrade of gLite can be found in the UMD Installation Guide.
Hadoop and Runtime Resources
Hadoop and Runtime Resources installation and upgrades due to the diverse nature of Service and installation type does not follow a predefined installation or upgrade procedure, but as for the gCube Resources each action is associated with a Redmine ticket where Site Managers have to report the Intervention Time spent.
