Skip to content

Latest commit

 

History

History
268 lines (158 loc) · 9.02 KB

README.md

File metadata and controls

268 lines (158 loc) · 9.02 KB
Raw

ckanext-ecospheres

CKAN extension for the french minister of ecology Open Data Portals.

Contents

License

ckanext-ecospheres is Free and Open Source software and is licensed under the GNU Affero General Public License (AGPL) v3.0.

Demo Instance

A demo instance can be found lien vers le guichet de donnnées.

Overview

Ajouter une desription

Requirements

For the proper functioning of the echosphere extension it is strongly recommended to install the extension ckanext-dsfr

Installation

To install ckanext-ecospheres:

  1. Install the requirements as described above

  2. Activate your CKAN virtual environment, for example:

     . /usr/lib/ckan/default/bin/activate

  1. Go into your CKAN path for extension (like /usr/lib/ckan/default/src):

     cd ckanext-ecospheres    

 git clone https://github.com/ecolab/ckanext-ecospheres.git

 pip install -e .

 pip install -r requirements.txt

  1. Add the required plugins to the ckan.plugins setting in your CKAN config file (by default the config file is located at /etc/ckan/default/production.ini).

    • ecospheres
    • dcat_ecospheres_harvester
    • dcat_ecospheres_plugin
    • spatial_ecospheres_harvester
    • spatial_ecospheres_template

  1. Set the following configuration properties in the production.ini file:

    • Set de DCAT catalog endpoint (more detail here):

        ckanext.dcat.catalog_endpoint = /dcat/catalog/{_format}

    • Set information about the publisher:

            ckanext.dcatfrench_config.publisher_name = MTE
      ckanext.dcatfrench_config.publisher_mail = [email protected]
      ckanext.dcatfrench_config.publisher_phone = 015858585858
      ckanext.dcatfrench_config.publisher_url =  mte.gouv.fr

    • Set the general config

        ckan.site_title = Guichet d accès à la donnée du ministère .......
  ckan.site_description = Guichet d accès à la donnée du ministère
  ckan.locale_default = fr
  ckan.locale_order =  fr en

    • Set Scheming configuration (more details here):

        scheming.dataset_schemas = ckanext.ecospheres.scheming:ecospheres_dataset_schema.yaml
  scheming.presets =  ckanext.ecospheres.scheming:presets.yml
                      ckanext.scheming:presets.json
                      ckanext.fluent:presets.json

    • spatial settings

        ckanext.spatial.harvest.continue_on_validation_errors = True
  ckanext.spatial.common_map.type = custom
  ckanext.spatial.common_map.custom.url = https://wxs.ign.fr/decouverte/geoportail/wmts?service=WMTS&request=GetTile&version=1.0.0&tilematrixset=PM&tilematrix={z}&tilecol={x}&tilerow={y}&layer=GEOGRAPHICALGRIDSYSTEMS.PLANIGNV2&format=image/png&style=normal
  ckanext.spatial.common_map.attribution = "IGN-F/Géoportail"                                                                                                                                  
  ckan.datasets_per_page = 5

  1. Enable the dcatfrench profile adding the following configuration property in the production.ini file, (more details here):

     ckanext.dcat.rdf.profiles = ecospheres_dcat_ap

  1. Configure the CKAN base URI as reported in the dcat documentation:

     ckanext.dcat.base_uri = YOUR_BASE_URI

  1. Initialize the vocabularies needed to run the ckanext-ecosphere extension (more detail about command line in CKAN here)

     ckan --config=/etc/ckan/default/production.ini ecospherefr load-vocab

  1. Update the Solr schema.xml file used by CKAN introducing the following element (more about defining multivaluted fields the Solr here):

     <fields>
 .........
 <field name="page" type="string" indexed="true" stored="true" multiValued="true"/>
 <field name="contact_point" type="string" indexed="true" stored="true" multiValued="true"/>
 <field name="publisher" type="string" indexed="true" stored="true" multiValued="true"/>
 <field name="creator" type="string" indexed="true" stored="true" multiValued="true"/>
 <field name="rights_holder" type="string" indexed="true" stored="true" multiValued="true"/>
 <field name="qualified_attribution" type="string" indexed="true" stored="true" multiValued="true"/>
 <field name="free_tags" type="string" indexed="true" stored="true" multiValued="true"/>
 <field name="licenses" type="string" indexed="true" stored="true" multiValued="true"/>
 <field name="series_member" type="string" indexed="true" stored="true" multiValued="true"/>
 <field name="in_series" type="string" indexed="true" stored="true" multiValued="true"/>
 <field name="category" type="string" indexed="true" stored="true" multiValued="true"/>
 <field name="territory" type="string" indexed="true" stored="true" multiValued="true"/>
 <field name="modified" type="date" indexed="true" stored="true" multiValued="false"/>
 <field name="created" type="date" indexed="true" stored="true" multiValued="false"/>
 <field name="issued" type="date" indexed="true" stored="true" multiValued="false"/>
 <field name="theme" type="string" indexed="true" stored="true" multiValued="true"/>
 ........
 </fields>

  2. Restart Solr.


  1. Restart CKAN. For example if you've deployed CKAN with Apache on Ubuntu:

    sudo service apache2 reload



Development Installation

To install ckanext-ecospheres for development, activate your CKAN virtualenv and do:

git clone https://github.com/ecolab/ckanext-ecospheres.git
cd ckanext-ecospheres
python setup.py develop
pip install -r dev-requirements.txt

Running the Tests

   cd /usr/lib/ckan/default/src/ckanext-ecospheres
    . /usr/lib/ckan/default/bin/activate

    pytest --ckan-ini=test.ini --disable-warnings ckanext/ecospheres/tests

Running harvest manually

To start a harvest

  • you must first load the vocabularies

  • create an admin account

  • add a harvesting source

  • get the id of the harvesting source

      ckan --config=/etc/ckan/default/production.ini harvester sources

  • launch the harvesting

      ckan --config=/etc/ckan/default/production.ini harvester run-test id_src_harvest

APIs

Access to these APIs does not require a token

  1. Thèmes

     GET /api/themes

  2. Territoires

     GET /api/territoires
 GET /api/territoires_hierarchy

  3. Organisations

     GET /api/organizations

  4. Vocabulaires

     POST /api/load-vocab
     --header 'Content-Type: application/json'
     --header 'Authorization: <token_admin>
     --data-raw '{
                 "vocab_list":[
                                 ]
                 }'

token_admin: Générer un token sur cette url /user/username/api-tokens

vocab_list: liste des vocabulaires à re/charger, si la vocab_list est vide alors tous les vocabulaires seront re/chargé

L'API permet de lancer un job en asynchrone dans l'instance CKAN et l'api renvera un message informant que le chargement a été lancé. On ne peut pas suivre la progression de chargement des vocabulaires



Administration tasks

the creation of organizations and harvesting sources is done by API. To do this you need to generate a token and be an admin The creation scripts are stored in this repository

Contributing

Support, Communication and Credits