Difference between revisions of "Procedure Infrastructure Accounting"

From D4Science Wiki
Jump to: navigation, search
(Created page with "_TOC__ Different accounting procedures apply for gCube, gLite, and Hadoop nodes. == gCube Nodes == The accounting of gCube nodes is based on the gCube Messaging System. This s...")
 
 
(8 intermediate revisions by 2 users not shown)
Line 1: Line 1:
_TOC__
+
__TOC__
Different accounting procedures apply for gCube, gLite, and Hadoop nodes.
+
The accounting of D4Science Resources is based on the gCube Messaging System. This system is composed of a number of remote probes deployed in all the SmartGears empowered nodes that publish information to a central broker which is them consumed by the D4Science accounting framework.  
 +
Different accounting information is produced, collected and collated:
  
 +
*'''User Accounting'''
 +
** Information about the activity of VO and VRE users in the portal: number of logins, executed jobs, accessed content, etc
 +
** This data is available from the Portal Accounting portlet  ( only for Infrastructure Managers )
  
== gCube Nodes ==
+
* '''Service Accounting'''
 
+
The accounting of gCube nodes is based on the gCube Messaging System. This system is composed by a number of remote probes deployed in all gCube nodes that publish information to a central broker which is them consumed by different gCube components. Different accounting information is produced:
+
* User Accounting
+
** Information about the activity of VO and VRE users in the portal: number of logins, executed search, accessed content, etc
+
** This data is available from the Portal Accounting portlet  ( only for Infrastructure Managers )
+
* Service Accounting
+
 
** Information about the number, type, and duration of service calls  
 
** Information about the number, type, and duration of service calls  
 
** This data is available from the Node Accounting Portlet ( only for Infrastructure Managers )
 
** This data is available from the Node Accounting Portlet ( only for Infrastructure Managers )
* System Accounting
 
** Information about usage of specific gCube Services, mostly the Services that act as interoperability mediators between iMarine and other e-infrastructures.
 
** This data will be available from the Node Accounting Portlet ( only for Infrastructure Managers )
 
 
== gLite Nodes ==
 
 
The accounting of gLite nodes is based on the official EGI accounting tool. This tool provides information about the CPU usage for each VO present in the EGI infrastructure.
 
 
This data is available from the EGI [http://www4.egee.cesga.es/accounting/egee_view.php Accounting Site].
 
  
== Hadoop Nodes ==
+
* '''System Accounting'''
 +
** Information about the usage of specific D4Science Services, mostly the Services that act as interoperability mediators between iMarine and other e-infrastructures.
  
The accounting for Hadoop nodes is based on the information about [http://hadoop.apache.org/mapreduce/ MapReduce] jobs. The collection of this information exploits the gCube Execution Engine Hadoop Adaptor through the system accounting mechanism described above.
+
All the above information are available from the Node Accounting Portlet ( only for Infrastructure Managers ) at [https://services.d4science.org/group/d4science.research-infrastructures.eu/accounting D4Science Accounting Site]

Latest revision as of 18:41, 29 March 2018

The accounting of D4ScienceAn e-Infrastructure operated by the D4Science.org initiative. Resources is based on the gCube Messaging System. This system is composed of a number of remote probes deployed in all the SmartGears empowered nodes that publish information to a central broker which is them consumed by the D4ScienceAn e-Infrastructure operated by the D4Science.org initiative. accounting framework. Different accounting information is produced, collected and collated:

  • User Accounting
    • Information about the activity of VOVirtual Organization; and VREVirtual Research Environment. users in the portal: number of logins, executed jobs, accessed content, etc
    • This data is available from the Portal Accounting portlet ( only for Infrastructure Managers )
  • Service Accounting
    • Information about the number, type, and duration of service calls
    • This data is available from the Node Accounting Portlet ( only for Infrastructure Managers )
  • System Accounting
    • Information about the usage of specific D4ScienceAn e-Infrastructure operated by the D4Science.org initiative. Services, mostly the Services that act as interoperability mediators between iMarine and other e-infrastructures.

All the above information are available from the Node Accounting Portlet ( only for Infrastructure Managers ) at D4Science Accounting Site