Difference between revisions of "Upgrade Plan 210 SPD"

From D4Science Wiki
Jump to: navigation, search
Line 27: Line 27:
 
  http://monitor.d4science.research-infrastructures.eu
 
  http://monitor.d4science.research-infrastructures.eu
  
−
== Infrastructure (xx-xx-xx) ==
+
== Infrastructure ==
  
−
* '''DONE''' (CERN) node1.p.d4science.research-infrastructures.eu:8000: patch Deployer 2.3
+
* (CNR) node28.p.d4science.research-infrastructures.eu:8080: upgrade GHN ( restart)
−
* '''DONE''' (CERN) node1.p.d4science.research-infrastructures.eu:8080: patch Deployer 2.3
+
* (CNR) node47.p.d4science.research-infrastructures.eu:8080 :upgrade GHN ( restart)
−
*  '''DONE''' (CERN) node2.p.d4science.research-infrastructures.eu:8080: patch Deployer 2.3
+
* (CNR) node59.p.d4science.research-infrastructures.eu:8080 :upgrade GHN ( restart)
−
* '''DONE''' (CERN) node17.p.d4science.research-infrastructures.eu:8080: patch Deployer 2.3
+
−
*  '''DONE''' (CERN) node11.p.d4science.research-infrastructures.eu:8080: patch Deployer 2.3
+
  
−
== gCubeApps VO (xx xx xx) ==
 
  
 +
== Portals (xx xx xx==
  
−
* '''DONE''' (CERN) node66.p.d4science.research-infrastructures.eu:8000:  patch Deployer 2.3
 
−
* '''DONE''' (CERN) node66.p.d4science.research-infrastructures.eu:8080:  patch Deployer 2.3
 
−
* '''DONE''' (CERN) node65.p.d4science.research-infrastructures.eu:8080:  patch Deployer 2.3
 
−
* '''DONE''' (CERN) node36.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.3
 
−
* '''DONE''' (CERN) rstudio.p.d4science.research-infrastructures.eu:8080 :  patch Deployer 2.3
 
−
* '''DONE''' (CERN) node39.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.3
 
−
* '''DONE''' (CERN) node47.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.3
 
−
* '''DONE''' (CERN) node49.p.d4science.research-infrastructures.eu:8080 :  patch Deployer 2.3
 
−
* '''DONE''' (CERN) node53.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.3
 
−
* '''DONE''' (CERN) node54.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.3
 
−
* '''DONE''' (CERN) node59.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.3
 
−
* '''DONE''' (CERN) node60.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.3
 
−
* '''DONE''' (CERN) node61.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.3
 
−
* '''DONE''' (CERN) node62.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.3
 
−
* '''DONE''' (CERN) node63.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.3
 
−
* '''DONE''' (CERN) node64.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.3
 
  
−
== FARM VO ==
+
D4science.org and Imarine portal upgrade:
  
−
=== FARM Enabling Services (12 Jul PM) ===
+
* (CNR) portal.i-marine.d4science.org:9000: upgrade GHN ( restart)
 +
* (CNR) portal.d4science.org:9000: upgrade GHN ( restart)
  
−
In order to enable the upgrade to the new Maven based dynamic deployment of packages, we need to have a procedure for the upgrade:
 
  
−
* The old and new RM are incompatible, cause they use 2 different services for Dependencies resolution and deployment ( SR vs SG)
 
−
* In order to undeploy the current installed packages we need to use the old version of the RM services
 
−
* In parallel the new version should be deployed in order to perform the new deployment
 
−
* In addition the undeployment of packages must be performed with the old version of the Deployer Service, while the deployment with the new one.
 
−
* The flow of action is the following.
 
−
** remove the service from VRE scopes before performing the undeployment ( we fond a bug in this case (https://support.d4science-ii.research-infrastructures.eu/ticket/429), and nodes must be patched before removing the scope)
 
−
** undeploy the service
 
−
** upgrade the GHN to version  3.3.0
 
−
** Deploy the upgraded service using the new version of the RM.
 
−
 
−
For this reason only the GHNs where we need to upgrade services are going to be upgraded to GHN 3.3.0
 
−
 
−
gHNs:
 
−
 
−
 
−
* '''DONE''' (CNR) node24.p.d4science.research-infrastructures.eu:8080: upgrade node ( restart )
 
−
* '''DONE''' (CNR) node26.p.d4science.research-infrastructures.eu:8080: upgrade node ( restart )
 
−
* '''DONE''' (CNR) node32.p.d4science.research-infrastructures.eu:8000: upgrade node ( restart )
 
−
 
−
Services:
 
−
* '''DONE''' (CNR) node26.p.d4science.research-infrastructures.eu:8080: upgrade IS-Registry
 
−
* '''DONE''' (CNR) node32.p.d4science.research-infrastructures.eu:8000: install RM
 
−
 
−
Configuration:
 
−
 
−
The following RuntimeResource must be configured
 
−
 
−
 
−
* '''DONE''' Geo Server
 
−
* '''DONE''' GeoNetwork
 
−
* '''DONE''' RStudio
 
−
* '''DONE''' TimeSeries Database
 
−
* '''DONE''' Ecological Modeling Database
 
−
* '''DONE''' PostGis Database
 
−
*  Obis database
 
−
*  Species Link
 
−
*  Worms
 
−
*  CoL
 
−
*  Maven Repository
 
−
* Transect
 
−
 
−
 
−
The SG must be added to FARM scope and 2.9.0 profile registered on this scope.
 
−
 
−
=== FARM VO/VRE Services (xx xx xx) ===
 
−
 
−
gHNs:
 
−
 
−
*  '''DONE''' (FAO) ldvapp08.fao.org:8080: upgrade node (restart)
 
−
*  '''DONE''' (FAO) ldvapp08.fao.org:8081: upgrade node (restart)
 
−
*  '''DONE''' (CNR) node14.p.d4science.research-infrastructures.eu:8080: upgrade node(restart)
 
−
*  '''DONE''' (CNR) node28.p.d4science.research-infrastructures.eu:8080: upgrade node(restart)
 
−
*  '''DONE''' (CNR) node44.p.d4science.research-infrastructures.eu:8080 : upgrade node (restart)
 
−
*  '''DONE''' (NKUA) dl16.di.uoa.gr:8084 : upgrade node (restart) 
 
−
*  '''DONE''' (NKUA) dl25.di.uoa.gr:8084 : upgrade node (restart)
 
−
*  '''DONE''' (NKUA) dl16.di.uoa.gr:8080 : upgrade node (restart)
 
−
 
−
 
−
Services:
 
−
 
−
a patch to the previous version of the deployer is needed (https://support.d4science-ii.research-infrastructures.eu/ticket/429)
 
−
 
−
 
−
*  '''DONE''' (CERN) node6.p.d4science.research-infrastructures.eu:8000 : patch Deployer 2.2
 
−
*  '''DONE''' (CERN) node9.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.2
 
−
*  '''DONE''' (CERN) node23.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.2
 
−
*  '''DONE''' (CERN) node27.p.d4science.research-infrastructures.eu:8080 :  patch Deployer 2.2
 
−
*  '''DONE''' (CERN) node30.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.2
 
−
*  '''DONE''' (CERN) node33.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.2
 
−
*  '''DONE''' (CERN) node38.p.d4science.research-infrastructures.eu:8080 : patch Deployer 2.2
 
−
*  '''DONE''' (CERN) node37.p.d4science.research-infrastructures.eu:8080: patch Deployer 2.2
 
−
*  '''DONE''' (CERN) dl17.di.uoa.gr:8080 : patch Deployer 2.2
 
−
*  (CERN) dl23.di.uoa.gr:8080 : patch Deployer 2.2
 
−
*  '''DONE''' (CERN) dl25.di.uoa.gr:8080 : patch Deployer 2.2
 
−
 
−
*  '''DONE'''  (CERN) node28.p.d4science.research-infrastructures.eu:8080:upgrade TS  service
 
−
**  org.gcube.content-management.time-series.2-3-0
 
−
**  org.gcube.content-management.time-series-geo-tools.1-4-0
 
−
**  org.gcube.common.TSDBInterface.1-3-0
 
−
**  org.gcube.common.TSPostgresImplementation.1-3-0
 
−
**  org.gcube.common.GeoServerInterface.1-8-0
 
−
**  org.gcube.data-analysis.ecological-engine.1-2-0
 
−
**  org.gcube.content-management.codelist-manager.1-2-0
 
−
* '''DONE''' (CERN) node44.p.d4science.research-infrastructures.eu:8080: upgrade VREModeler
 
−
* '''DONE''' (CERN) node14.p.d4science.research-infrastructures.eu:8080: upgrade RM
 
−
* (CERN) ldvapp08.fao.org:8080 : upgrade RM
 
−
* '''DONE''' (CERN) dl16.di.uoa.gr:8080: upgrade RM
 
−
* '''DONE''' (CERN) dl25.di.uoa.gr:8084: upgrade RM
 
−
 
−
== Portals (xx xx xx==
 
−
 
−
CNR is responsible for the portal upgrade activity, both D4science.org and Imarine portal need to complete their upgrade to gCube 2.9.0.
 
−
The latest artifact build can be downloaded from:
 
−
 
−
 
−
 
−
=== iMarine portal ===
 
  
 
==== Upgrade ====
 
==== Upgrade ====
Line 164: Line 49:
  
  
−
new portlets:
+
upgraded  portlets:
−
*'''DONE''' org.gcube.portlets-user.species-discovery.1-0-0
+
−
*'''DONE''' org.gcube.application.aquamaps.aquamapsspeciesview.1-0-0
+
−
 
+
−
upgraded portlets:
+
−
 
+
−
*'''DONE''' org.gcube.messaging.accounting-portlet.1-6-0
+
−
*'''DONE''' org.gcube.messaging.monitoring-portlet.1-2-0
+
−
*'''DONE''' org.gcube.messaging.node-accounting-portlet.1-4-0
+
−
*'''DONE''' org.gcube.portlets-user.template-generator.3-4-0
+
−
*'''DONE''' org.gcube.portlets-user.report-generator-portlet.3-4-0
+
−
*'''DONE''' org.gcube.portlets-user.results-portlet.4-4-0
+
−
*'''DONE''' org.gcube.portlets-user.time-series-portlet.3-3-0
+
−
*'''DONE''' org.gcube.portlets-user.codelist-management-portlet.1-1-0
+
−
*'''DONE''' org.gcube.portlets-user.geoexplorer-portlet.1-1-0
+
−
*'''DONE''' org.gcube.portlets-user.workspace-portlet.5-0-0
+
−
*'''DONE''' org.gcube.portlets-user.war-management-portlet.1-1-1
+
−
*'''DONE''' org.gcube.portlets-user.web-application-management-portlet.1-1-1
+
−
*'''DONE''' org.gcube.portlets-user.wf-documents-portlet.1-1-0
+
−
*'''DONE''' org.gcube.portlets-admin.wf-docs-manager.1-1-0
+
−
*'''DONE''' org.gcube.application.aquamaps.aquamapsportlet.2-8-0
+
−
*'''DONE''' org.gcube.application.aquamaps.datamanagementfacilityportlet.1-4-0
+
−
*'''DONE''' org.gcube.portlets-user.gcube-login-portlet.1-6-0
+
−
*'''DONE''' org.gcube.portlets-admin.runtime-resource-creator.1-1-0
+
−
 
+
−
upgraded libraries:
+
−
 
+
−
*'''DONE''' org.gcube.portlets-user.war-management-widget.1-1-0
+
−
*'''DONE''' org.gcube.portlets-user.GISViewer.2-0-0
+
−
*'''DONE''' org.gcube.portlets-user.gcube-GISViewer.1-1-0
+
−
*'''DONE''' org.gcube.application.aquamaps.enhabling.iscrawler.1-2-0
+
−
*'''DONE''' org.gcube.messaging.accounting-portal.1-4-0
+
−
*'''DONE''' org.gcube.messaging.consumer-library.1-5-0
+
−
*'''DONE''' org.gcube.application.aquamaps.aquamapsservice-stubs.3-2-0
+
−
*'''DONE''' org.gcube.common.GeoServerInterface.1-8-0 ( to install from remote build cause the last fix is not available in the release).
+
−
*  org.gcube.portlets-user.geoexplorer.1-1-0
+
−
* org.gcube.portlets-user.gcube-geoexplorer.1-1-0
+
−
 
+
−
new libraries:
+
−
 
+
−
*'''DONE''' species-products-discovery-stubs.1-0-0
+
−
*'''DONE''' tree-manager-stubs-1.0.0
+
−
*'''DONE''' tree-manager-library-1.0.0
+
−
*'''DONE''' tree-manager-framework-1.0.0
+
−
*'''DONE''' streams-.1.0.0
+
−
*'''DONE''' trees-1.0.0
+
−
*'''DONE''' common-gcore-clients-1.0.0
+
−
*'''DONE''' common-clients-1.0.0
+
−
*'''DONE''' org.gcube.vre-management.softwaregateway-client.1-0-0
+
−
 
+
−
Due to a problem in the previous upgrade operations, a lot of portal lib need to be restored from the backup server, the libs to be restored under $GLOBUS_LOCATION/lib/ext are the following:
+
  
−
'''DONE'''
+
* org.gcube.portlets-user.species-discovery.2-0-0
−
* commons-net-2.0.jar
+
−
* datanucleus-cache-2.1.2.jar
+
−
* datanucleus-core-2.2.3.jar
+
−
* datanucleus-enhancer-2.1.3.jar
+
−
* datanucleus-googlecollections-2.2.0-release.jar
+
−
* datanucleus-javaxtime-2.1.2.jar
+
−
* datanucleus-jdo-query-2.2.1.jar
+
−
* datanucleus-jodatime-2.1.2.jar
+
−
* datanucleus-jpa-2.1.7.jar
+
−
* datanucleus-jpa-query-2.1.2.jar
+
−
* datanucleus-ldap-2.2.1.jar
+
−
* datanucleus-management-1.0.2.jar
+
−
* datanucleus-rdbms-2.2.3.jar
+
−
* DataTransformationHandlers.jar
+
−
* G_CQLParser.jar
+
−
* gcube-reporting-libray.jar
+
−
* ij140g.jar
+
−
* iText-2.1.4.jar
+
−
* javassist.jar
+
−
* jdo-api-3.1-SNAPSHOT-20110223.jar
+
−
* jena.jar
+
−
* mockito-all-1.8.5.jar
+
−
* org.gcube.contentmanagement.contentmanager.stubs.jar
+
−
* org.gcube.contentmanagement.gcubemodellibrary.jar
+
−
* org.gcube.contentmanagement.lexicalmatcher.jar
+
−
* org.gcube.contentmanagement.storagelayer.storagemanagementservice.stubs.jar
+
−
* org.gcube.contentmanagement.timeseries.geotools.jar
+
−
* org.gcube.contentmanagement.viewmanager.stubs.jar
+
−
* org.gcube.datatransformation.datatransformationservice.stubs.jar
+
−
* org.gcube.dir.master.stubs.jar
+
−
* org.gcube.indexmanagement.forwardindexlookup.stubs.jar
+
−
* org.gcube.indexmanagement.forwardindexmanagement.stubs.jar
+
−
* org.gcube.indexmanagement.forwardindexupdater.stubs.jar
+
−
* org.gcube.indexmanagement.fulltextindexlookup.stubs.jar
+
−
* org.gcube.indexmanagement.fulltextindexmanagement.stubs.jar
+
−
* org.gcube.indexmanagement.fulltextindexupdater.stubs.jar
+
−
* org.gcube.indexmanagement.geoindexlookup.stubs.jar
+
−
* org.gcube.indexmanagement.geoindexmanagement.stubs.jar
+
−
* org.gcube.indexmanagement.geoindexupdater.stubs.jar
+
−
* org.gcube.indexmanagement.incrementalindexupdater.stubs.jar
+
−
* org.gcube.searchsystem.searchsystemservice.stubs.jar
+
−
* ResourceRegistryAggregator.jar
+
−
* RRGCubeBridge.jar
+
−
* RRModel.jar
+
−
* slf4j-api.jar
+
−
* slf4j-log4j12.jar
+
  
−
for the same problem the following configuration files need to be restored under $GLOBUS_LOCATION/lib/_ext/property-files
+
upgraded components:  ( under $GLOBUS_LOCATION/lib/_ext)
  
−
* config.gcubebridge.properties
+
* streams-2.0.0 (from streams-1.0.0)
−
* datanucleus.buffer.properties
+
* tree-manager-framework-2.0.0.jar (from tree-manager-framework-1.0.0)
−
* datanucleus.derby.properties
+
* tree-manager-library-2.0.0.jar (from tree-manager-library-1.0.0)
−
* logging.rr.properties
+
* tree-manager-stubs-2.0.0.jar ( from tree-manager-stubs-1.0.0.jar)
−
* targets.model.properties
+
* species-products-discovery-stubs.1-1-0 ( from species-products-discovery-stubs.1-1-0-SNAPSHOT)
 +
* spd-plugin-framework-1.0.0 (from spd-plugin-framework-1.0.0-SNAPSHOT)
 +
* spql-parser-1.0.0 ( from spql-parser.1-0-0-SNAPSHOT)
 +
* spd-client-library-1.0.0 (from spd-client-library.1-0-0-SNAPSHOT)
 +
* trees-1.1.0 ( from trees-1.0.0)

Revision as of 09:42, 11 October 2012

UNDER DEFINITION

gHN Upgrade Instructions

It should be carried as follows:

1) Download the upgrade script from 

wget http://svn.research-infrastructures.eu/public/d4science/gcube/trunk/ghn-distribution/upgrade-scripts/upgrade-ghn-3-4-0.sh

and make it executable: 

chmod 700 upgrade-ghn-3-4-0.sh

2) Verify that the GLOBUS_LOCATION environment variable is correctly set 

echo $GLOBUS_LOCATION

3) Run the upgrade script with the following arguments:

  • <port>: The port where the container runs.
  • <restart/norestart>: tells if the container has to be restarted or not after the upgrade
./upgrade-ghn-3-4-0.sh <port> <restart/norestart>

Notes:

  • The script ask for the removal of previous GHNgCube Hosting Node. logs ( recommended )

4) Verify the upgrade operation using the infrastructure monitoring tools 

http://monitor.d4science.research-infrastructures.eu

Infrastructure

  • (CNR) node28.p.d4science.research-infrastructures.eu:8080: upgrade GHNgCube Hosting Node. ( restart)
  • (CNR) node47.p.d4science.research-infrastructures.eu:8080 :upgrade GHNgCube Hosting Node. ( restart)
  • (CNR) node59.p.d4science.research-infrastructures.eu:8080 :upgrade GHNgCube Hosting Node. ( restart)


Portals (xx xx xx

D4science.org and Imarine portal upgrade:

  • (CNR) portal.i-marine.d4science.org:9000: upgrade GHNgCube Hosting Node. ( restart)
  • (CNR) portal.d4science.org:9000: upgrade GHNgCube Hosting Node. ( restart)


Upgrade

Artifacts are available at:


upgraded portlets:

  • org.gcube.portlets-user.species-discovery.2-0-0

upgraded components: ( under $GLOBUS_LOCATION/lib/_ext)

  • streams-2.0.0 (from streams-1.0.0)
  • tree-manager-framework-2.0.0.jar (from tree-manager-framework-1.0.0)
  • tree-manager-library-2.0.0.jar (from tree-manager-library-1.0.0)
  • tree-manager-stubs-2.0.0.jar ( from tree-manager-stubs-1.0.0.jar)
  • species-products-discovery-stubs.1-1-0 ( from species-products-discovery-stubs.1-1-0-SNAPSHOT)
  • spd-plugin-framework-1.0.0 (from spd-plugin-framework-1.0.0-SNAPSHOT)
  • spql-parser-1.0.0 ( from spql-parser.1-0-0-SNAPSHOT)
  • spd-client-library-1.0.0 (from spd-client-library.1-0-0-SNAPSHOT)
  • trees-1.1.0 ( from trees-1.0.0)
Retrieved from "https://wiki.d4science.org/index.php?title=Upgrade_Plan_210_SPD&oldid=7274"