Difference between revisions of "Ecosystem Approach Community of Practice: smartfish"

From D4Science Wiki
Jump to: navigation, search
(Created page with "The SMARTFISH project offers an opportunity for participating countries of Indian Ocean and related RECs, RFBs and NGOs to receive support from FAO for the implementation of a Re...")
 
Line 16: Line 16:
  
 
; Product
 
; Product
: (Describe the expected service in maximum 3 sentences) iMarine is providing on one side hosting solution for the SmartFish portal. 2 versions of the prototypes are currently on-line, a first version
+
: (Describe the expected service in maximum 3 sentences) iMarine is firstly providing side hosting solution for the SmartFish portal. 2 versions of the prototypes are currently on-line, a first version that has validated the proof of concept ([http://http://smartfish.d4science.org/v1/index.php link to v1)] and a second version, currently under progress with a new design and improved web semantic services ([http://http://smartfish.d4science.org/v2/index.php link to v2)]. Secondly, iMarine is providing web semantic services for indexing and annotating documents collections from WIOFish (HTML files), FIRMS (XML files) and StatBase (Excel files).
  
 
; Implementation activity
 
; Implementation activity
  
The implementation can be tracked through TRAC:
+
The creation of a webserver instance to host SmartFish can be tracked through TRAC:
* The initial request was described here [[https://issue.i-marine.research-infrastructures.eu/ticket/563]]
+
* The initial request was described here [[https://issue.imarine.research-infrastructures.eu/ticket/2060]]
 +
* Additional tools were request to set up a development environment such as:
 +
** a SVN: [[https://issue.imarine.research-infrastructures.eu/ticket/2200]]
 +
** a JIRA: created in the FIGIS framewok.
 +
The implementation of web semantic services has been defined as follow:
 
* Main enhancements to the delivered facility are described by e.g.:
 
* Main enhancements to the delivered facility are described by e.g.:
** Data exchange [[https://issue.i-marine.research-infrastructures.eu/ticket/2066]]
+
** improvement of the search engine with the following activities
** Quick Search to update an existing VME description;
+
***Create an index with Elastic Search, with default settings, on a subset of F-RIS document collection (provided by FAO)
** Stateless 'reports'
+
***Integrate the search facilities of iMarine search component in the F-RIS back-end, and serve the front-end maintaining the same search response schema
** Fact-sheets can contain 'dynamic' sections with e.g. a overview of latest encounters / statistics;
+
***Test the integration result by performing the user query from the F-RIS front-end and ensure that it mimics the current behavior. This will also set a base line to evaluate the improvements requested.
** Confidential sections (not all fact-sheets are public);
+
***Produce indication of the document sections sensitive of specific indexing
** Evolving fact-sheets (Some changes over time have to be kept; compare this to e.g. the EU-membership that evolve over time);
+
***Engineer a new index schema provided the indication of the sections in the document that are sensitive of higher relevance to a user query.
** Tablet or other media support.
+
This operation can be recursively refined over time as a tweak for improving precision and recall (see activity #8)
 +
***Running full text indexing of the complete collection of documents
 +
***Test the portal search feature and evaluate improvement of precision and recall.
 +
***More rounds of activities 4, 5 and 6 if necessary
 +
** improved annotation base for the F-RIS portal with the following activities
 +
***Analysis of the document types to identify the elements sensitive of producing an annotation
 +
***Implementation of the document processors to extracts the annotation
 +
***Running test for producing annotations
 +
***Deploying in the infrastructure the F-RIS services, that uses the annotations
 +
***Test the behavior of the F-RIS front-end
 +
 
 
   
 
   
 
; Priority to CoP  
 
; Priority to CoP  
 
: (List proposed solution priority following the iMarine Board priority setting criteria:)  
 
: (List proposed solution priority following the iMarine Board priority setting criteria:)  
 
:* The target community can be split in 2: data contributors and data consumers.  
 
:* The target community can be split in 2: data contributors and data consumers.  
:** data contributors are scientists, policy makers, industry,
+
:** data contributors are source information systems. This source information systems are not limited to the 3 current source information Systems;
:** data consumers are and the wider public with an expressed interst in ;
+
:** data consumers are fisheries experts, fisheries professional and the wider public with an expressed interest in fisheries ;
:* Users; data entry will be done by any registered scientist, policy support officer, biologist, industry representatives. With such a large and diverse  user group, requirements to clearly separate content and ensure confidentiality requiremstn are obvious.  
+
:* Users; there are 2 groups of users: the source information systems data managers, which can be any kind of open information systems publishing public data and the final data user.  
:* Potential for co-funding; High
+
:* Potential for co-funding; High as other stakeholders could be interesting to develop Regional Information Systems based on the same concepts
:* Structural allocation of resources; The VRE is expected to be prototyped towards the end of 2013. The GeoExplorer development has started, and the deliverables can be aligned with the release of VRE components.  
+
:* Structural allocation of resources; SmartFish hosting is already in place. Activities on annotation and indexing are currently in progress and should be achieved by December 2013 for a presentation in a stakeholder workshop mid December 2013..  
:* Referred in DoW;in BC2
+
:* Referred in DoW;in BC3
:* How does the proposed action generally support sustainability aspects;  
+
:* How does the proposed action generally support sustainability aspects? SmartFish being hosted in iMarine e-infrastructure is a sustainable solution compared to the initial foreseen solution of a local hosting a marine research institute in Kenya that showed its limits with another hosted statistical database;  
 
:* How consistent it is with regulations/strategies ?.  
 
:* How consistent it is with regulations/strategies ?.  
:* Re-usability – benefits – compatibility;  
+
:* Re-usability – benefits – compatibility: SmartFish use case is the typical example of reuse of existing components (FLOD) and of improvement of these components. Benefits are immediate with the possibility to reuse existing components (saving development time) and to easily improve them (use of common open source technologies);  
  
 
; Parentage
 
; Parentage
 
: Relation to CoP Software
 
: Relation to CoP Software
* FAO VME-DB
+
* FAO FLOD
* FAO Webservices for reference data and code lists
+
* iMarine ConnectCube
* FAO Master Data Management
+
* iSearch
* FiGIS schema, fact sheet engine and website
+
* Xsearch
 +
 
 
: Relation to D4S technologies
 
: Relation to D4S technologies
* D4Science Reporting tool is the base for VME-DB VRE
+
 
* D4Science Work-flow tool will marshal the editing work-flow
+
* D4Science Web-services will update reports in the FAO database
+
  
 
; Productivity
 
; Productivity
 
: Are the proposed measures effective?
 
: Are the proposed measures effective?
* Yes, as it enables a controlled multi-groups and multi-user editing network.  
+
* Yes, as it proposes a faster and more efficient way of accessing data scattered among 3 source information systems.  
  
 
: Does it reduce a known workload?
 
: Does it reduce a known workload?
* When completed the VME-VRE
+
* User gets in one result page proposals for information and data available in 3 IS. The user saves time and access information he might suspect not available in a given system (like statistical information scarcely available in WIOFish but widely available in FIRMS)
  
 
; Presentation  
 
; Presentation  
Line 73: Line 86:
  
 
: Have the Copyright / attribution / metadata / legal aspects been addressed from a user and technology perspective?
 
: Have the Copyright / attribution / metadata / legal aspects been addressed from a user and technology perspective?
For Yann / Aureliano.
+
xxxxxxx

Revision as of 15:25, 2 October 2013

The SMARTFISH project offers an opportunity for participating countries of Indian Ocean and related RECs, RFBs and NGOs to receive support from FAO for the implementation of a Regional Fishery Strategy for the ESA-IO Region The project assists participating countries to strengthen national and regional fishery/aquaculture policy and strategy frameworks and to acquire additional knowledge on fisheries management for use in planning and monitoring. The project is funded by the EC and support participating countries to fulfill international commitment towards responsible fisheries and to improve food security. In this context, the 4th session of the SWIOFC Scientific Committee (Mahé, Seychelles, 29 November–2 December 2010) requested FIRMS, WIOFish, Statbase and Fishcode-STF to work on systems’ integration in order to lay the foundations of a comprehensive fisheries regional information system (F-RIS). This activity is part of the overall SmartFish project work plan.
The 3 existing information systems provide information and statistics on South West Indian Ocean fisheries:

  • WIOFish, a regional knowledge database on fisheries;
  • FIRMS, the Fisheries and Resources Monitoring System which globally integrates regional knowledge on the state of resources, including SWIO resources;
  • and StatBase, a fisheries statistical database.

The main ojbective of the f-RIS is to develop a fisheries regional information system centralizing the SWIO information and statistics currently scattered among three distinct existing systems. The initial assessment phase highlighted the need to offer innovative technical to avoid developing a system based on a typical central database architecture with ad-hoc exchanges mechanisms.
The iMarine FLOD components were identified as potential core F-RIS engine to index and annotate information and data available in the 3 source systems and proposing the F-RIS portal browsing and query tools to access easily these information and data.

Collaboration with iMarine was initially focusing on web semantic services implementation and later was enriched with the need to host the portal as the initial hosting solution in the Kenyan Fisheries Marine Research Institute in Mombasa, Kenya was subject to sustainability issues.


The possibility to create a VREVirtual Research Environment. to host and make available to the community F-RIS index and annotations has been discussed and could be added to the SmartFish - iMarine collaboration in the next phase of SmartFish if it is validated.


Product
(Describe the expected service in maximum 3 sentences) iMarine is firstly providing side hosting solution for the SmartFish portal. 2 versions of the prototypes are currently on-line, a first version that has validated the proof of concept (link to v1) and a second version, currently under progress with a new design and improved web semantic services (link to v2). Secondly, iMarine is providing web semantic services for indexing and annotating documents collections from WIOFish (HTML files), FIRMS (XML files) and StatBase (Excel files).
Implementation activity

The creation of a webserver instance to host SmartFish can be tracked through TRAC:

  • The initial request was described here [[1]]
  • Additional tools were request to set up a development environment such as:
    • a SVN: [[2]]
    • a JIRA: created in the FIGIS framewok.

The implementation of web semantic services has been defined as follow:

  • Main enhancements to the delivered facility are described by e.g.:
    • improvement of the search engine with the following activities
      • Create an index with Elastic Search, with default settings, on a subset of F-RIS document collection (provided by FAO)
      • Integrate the search facilities of iMarine search component in the F-RIS back-end, and serve the front-end maintaining the same search response schema
      • Test the integration result by performing the user query from the F-RIS front-end and ensure that it mimics the current behavior. This will also set a base line to evaluate the improvements requested.
      • Produce indication of the document sections sensitive of specific indexing
      • Engineer a new index schema provided the indication of the sections in the document that are sensitive of higher relevance to a user query.

This operation can be recursively refined over time as a tweak for improving precision and recall (see activity #8)

      • Running full text indexing of the complete collection of documents
      • Test the portal search feature and evaluate improvement of precision and recall.
      • More rounds of activities 4, 5 and 6 if necessary
    • improved annotation base for the F-RIS portal with the following activities
      • Analysis of the document types to identify the elements sensitive of producing an annotation
      • Implementation of the document processors to extracts the annotation
      • Running test for producing annotations
      • Deploying in the infrastructure the F-RIS services, that uses the annotations
      • Test the behavior of the F-RIS front-end


Priority to CoPCommunity of Practice.
(List proposed solution priority following the iMarine Board priority setting criteria:)
  • The target community can be split in 2: data contributors and data consumers.
    • data contributors are source information systems. This source information systems are not limited to the 3 current source information Systems;
    • data consumers are fisheries experts, fisheries professional and the wider public with an expressed interest in fisheries ;
  • Users; there are 2 groups of users: the source information systems data managers, which can be any kind of open information systems publishing public data and the final data user.
  • Potential for co-funding; High as other stakeholders could be interesting to develop Regional Information Systems based on the same concepts
  • Structural allocation of resources; SmartFish hosting is already in place. Activities on annotation and indexing are currently in progress and should be achieved by December 2013 for a presentation in a stakeholder workshop mid December 2013..
  • Referred in DoW;in BC3
  • How does the proposed action generally support sustainability aspects? SmartFish being hosted in iMarine e-infrastructure is a sustainable solution compared to the initial foreseen solution of a local hosting a marine research institute in Kenya that showed its limits with another hosted statistical database;
  • How consistent it is with regulations/strategies ?.
  • Re-usability – benefits – compatibility: SmartFish use case is the typical example of reuse of existing components (FLOD) and of improvement of these components. Benefits are immediate with the possibility to reuse existing components (saving development time) and to easily improve them (use of common open source technologies);
Parentage
Relation to CoPCommunity of Practice. Software
  • FAO FLOD
  • iMarine ConnectCube
  • iSearch
  • Xsearch
Relation to D4S technologies


Productivity
Are the proposed measures effective?
  • Yes, as it proposes a faster and more efficient way of accessing data scattered among 3 source information systems.
Does it reduce a known workload?
  • User gets in one result page proposals for information and data available in 3 IS. The user saves time and access information he might suspect not available in a given system (like statistical information scarcely available in WIOFish but widely available in FIRMS)
Presentation
How must the component be delivered to users? (UI Design / on-line help / training material / support)
  • The interactive Map User interface is expected to be able to describe / edit the properties (attributes) of a polygon or point.
  • Collecting these features, defined through their featuretype, is expected to be done either through a VREVirtual Research Environment. or a connected stand-alone GIS Application. The feature type (the schema) can e.g. be defined in a VREVirtual Research Environment. for re-use in a desk-top GIS.
  • The geoExplorer should be enriched with a style editor, and style settings should be persisted for a next login.
Policy
Are there any policies available that describe data access and sharing?
  • data access and sharing policy of geospatial and OGC data [3]
Have the Copyright / attribution / metadata / legal aspects been addressed from a user and technology perspective?

xxxxxxx