Adding new Data and Information¶
This section guides you through the process of adding new records (new data with information) into the GeoNetwork catalogue using either the online metadata editor or the advanced metadata insert tool, based on XML documents. In both cases you will use the template system, add thumbnails, upload data, link to services and set access privileges to the metadata and data.
To add or edit data and metadata, you must be registered as an Editor into the work group you want to add records to. Contact your administrator if you are not a registered editor for your work group.
For the metadata creation using the online editor, GNos provides a set of simplified metadata templates based on the cited standards: ISO, FGDC and DC. The templates for vector and raster based on the ISO 19139 are the preferred ones since they are devised in a way that hides the complexity of the ISO19115 standard in the default view. At the same time those templates are extensible with new elements to fit specialized needs through the advanced view.
To produce a good metadata record, always try to gather as much details as possible on the resource that you want to describe taking into account the metadata elements that have been presented in the previous chapter. The next step is to fill out properly the fields provided by the metadata templates, while at the same time avoiding duplication of information throughout the form.
The most important fields that may not be waived while compiling a standard based metadata record are the following: Title, Date of Creation o Publication, Abstract, Language used for documenting data, Topic Category, Scale, Maintenance and Update Frequency, Metadata Author, Language Used for Documenting Metadata.
In addition to the main mandatory fields, we recommend you to fill out these optional but critical fields (if information is available): Purpose - Keywords - Presentation Form - Status - Spatial Representation Type - Geographic Location - Reference System Info - Temporal Extent - Data Quality Info - Access and Use Constraints - Point of Contact - Distribution Info: Online Resources.
You should also prepare an image of your data that is required to be displayed in search results as thumbnail.
Next section will guide you through the process of metadata creation using the online editor.
Creating a New Record using the web based Metadata Editor¶
- In the home page, click on the Administration Tab.
- Select New Metadata from the List of the admin page.
- Select the metadata standard Template, if possible, using the preferred ones. GeoNetwork opensource comes by default with support for three metadata standards, ISO19139, FGDC and Dublin core. For the ISO standard, two templates have been developed; one for vector and one for raster data. Both contain a relevant set of elements to describe the respective types of data. More templates can be developed online.
- Select the Group the metadata will belong to. These are the groups authorized to add metadata to by your administrator.
- Click on Create.
The steps in more details¶
Enter your username and password and click on the login button. The system will identify you and assign the correct privileges to work with.
Open the Administration page by clicking the Administration button in the banner and then click on the New metadata link.
From the metadata creation page, select the metadata standard to use from the dropdown list (Figure 4.3, “Template selection”)
After selecting the correct template, you should identify which group of users the metadata will belong to and finally click on Create.
A new metadata form based on the selected template will be displayed for you to fill out.
Switching Editing Views from Default to Advanced to XML View¶
Once you create a new record, you can choose between Default, Advanced or XML View. To switch view, simply click on the view you want to switch to on the left column of the page. The view in bold is the view you are currently using.
In the previous chapter you have analyzed the metadata structure as it is presented in the Default View. A selection of the main fields from different categories of information is shown in one single view. The minimum set of metadata required to serve the full range of metadata applications (data discovery, determination of data fitness for use, data access, data transfer and use of digital data) is defined here, along with optional metadata elements to allow for a more extensive standard description of geographic data, if required. However, if should be there a need to add more metadata elements, you can switch to the advanced view at any time while editing.
In the Advanced View, the ISO profile offers the possibility to visualize and edit the entire metadata structure organized in sections accessible through tabs from the left column. You can use this view to write more advanced metadata descriptions or templates to fit specialized needs.
The XML View shows the entire content of the metadata in the original hierarchical structure; different colors allow to distinguish between an element’s name and its value. The XML structure is composed of tags and to every tag must correspond a closing tag. The content is entirely contained withing the two, i.e.:
<gmd:language>
<gco:CharacterString>eng</gco:CharacterString>
</gmd:language>
Nevertheless, the use of the XML view requires some knowledge of the XML language.
Both the Default and the Advanced Views are composed of mandatory, conditional and optional metadata fields. The meaning of mandatory and optional is fairly intuitive; the mandatory fields are required, like Title and Abstract for instance, whereas the optional fields can be provided but are not fundamental, depending on the metadata author. The conditional fields may be considered mandatory under certain circumstances: essentially a conditional requirement indicates that the presence of a specified data element is dependent on the value or presence of other data elements in the same section. For instance, the Individual name metadata element of the Point of Contact, which is a conditional element of the Identification section, becomes mandatory if another element of the same section, Organization name or Position name is not already defined.
The mandatory fields as well as those highly recommended are flagged with red asterisk [*]. The standard definition for each field can be read by passing the mouse on the element name.
The Default View is the preferred view as it provides a selection of the available metadata elements, facilitating both the user and the editor in reading and editing a metadata record, and at the same time it ensures that a geospatial data can be properly described, through :
- the minimum set of metadata required to serve the full range of metadata applications (data discovery, determination of data fitness for use, data access, data transfer, and use of digital data);
- optional metadata elements - to allow for a more extensive standard description of geographic data, if required;
- a method for extending metadata to fit specialized needs.
Using basic commands of the editor¶
Fields are either free text fields or drop down lists. Free text means you can type any text into that field. Drop down lists allow you to select only one option from the list. You can add multiple fields of the same kind by clicking on the [+] symbol next to the element. Every new field that you will add in the advanced view will then be visible in the default view. You can also delete existing fields by clicking on the [x] symbol next to the element. Clearly, mandatory fields cannot be deleted. One example of the need to add multiple fields can arise if the content of your dataset has some text written in two different languages.
Entering Metadata for your Map¶
As we mentioned in the introduction to this guide, GNos provides tools to describe any type of geographic data (verctor layers, raster, tables, map services, etc.) as well as general document like reports, projects, papers, etc. For the purpose of this Quick Start Guide, an example of required and useful metadata elements to properly describe a thematic map will be provided hereafter. You should gather as much information as possible to identify and understand the map’s resource and characteristics you want to describe. Use the default view to start. If necessary, you can always switch to advanced view or come back later and edit the record with the additonal information collected.
Entering Metadata For Your Map¶
Please follow these steps to enter your map’s metadata. Note that we will only go through the fields that have been identified as compulsory (i.e. those fields marked with the asterix [*], mandatory or highly recommended).
Title *: Under the Identification Info field, give your map a name. There will be a default name of your data. Use free text to describe your map here.
Date *: Indicate the exact date of creation, publication or revision on your map.
Presentation Form: Specify the type of presentation, i.e. digital, hard copy, table, etc.
Abstract *: Enter some description of the map.
Purpose: Enter a short summary of the purposes for your map to be developed.
Status: Specify the status of your map within the following options: completed, historical archive, obsolete, ongoing, planned, required, under development.
Point of Contact: Enter all mandatory information and others you have at hand for the contact of the person(s) associated with this resources of the map. Note that some fields are only conditionally mandatory, such as Organization Name if Individual Name and Position are not entered.
Maintenance and update frequency * : Specify the frequency with which you expect to make changes and additions to your map after the initial version is completed. If any changes are scheduled you can leave As Needed selected from the drop-down list.
Descriptive Keywords: Enter keywords that describe your map. Also specify the type of keyword you are entering, i.e. place, theme, etc. Remember that you can add another keyword field if you need to add different types of keywords.
Access Constraints: Enter an access constraint here, such as a copyright, trademark, etc. to assure the protection of privacy and intellectual property.
User Constraints: Enter a user constraint here to assure the protection of privacy and intellectual property.
Other Constraints * : Enter other constraint here to assure the protection of privacy and intellectual property. Note that this field is conditionally mandatory if Access and Use constraints are not entered.
Spatial representation type: Select, from the drop-down list the method used to spatially represent your data. The options are: vector, grid, text table, stereo model, video.
Scale Denominator * : Enter the denominator for an equivalent scale of a hard copy of the map.
Language* : Select the language used within your map
Topic category * : Specify the main ISO category/ies through which your map could be classified (see Annex for the complete list of ISO topic categories).
Temporal Extent * : Enter the starting and ending date of the validity period.
Geographic Bounding Box * : Enter the longitude and latitude for the map or select a region from the predefined drop-down list. Make sure you use degrees for the unit of the geographic coordinates as they are the basis for the geographic searches.
Supplemental Information: Enter any other descriptive information about your map that can help the user to better understand its content.
Distribution Info: Enter information about the distributor and about options for obtaining your map.
Online Resource: Enter information about online resources for the map, such as where a user may download it, etc. This information should include a link, the link type (protocol) and a description of the resource.
Reference System Info: Enter information about the spatial reference system of your map. The default view contains one element to provide the alphanumeric value identifying the reference system used. GNos uses the EPSG codes which are numeric codes associated with coordinate system definitions. For instance, EPSG:4326 is Geographic lat-long WGS84, and EPSG:32611 is “UTM zone 11 North, WGS84”. Using elements from the advanced view, you may add more details on data projection, ellipsoid and datum. Note that if this information is provided, a reference system identifier is not mandatory.
Data Quality: Specify the hierarchal level of the data (dataset series, dataset, features, attributes, etc.) and provide a general explanation on the production processes (lineage) used for creating the data. The statement element is mandatory if the hierarchical level element is equal to dataset or series. Detailed information on completeness, logical consistency and positional, thematic and temporal accuracy can be directly added into the advanced form.
Metadata Author * : Provide information about the author of the map, including the person’s name, organization, position, role and any other contact information available.
After completion of this section, you may select the Type of document that you are going to save in the catalogue. You have three options: Metadata, Template, Sub-template. By default Metadata is set up.
When done, you may click Save or Save and Close to close the editing session.
Metadata validation¶
In editing mode, editors could validate the current metadata record against standard rules and recommendations.
For all standards, a first level of validation is made for XML metadata validation based on XML Schema (XSD). For ISO19139 records, other rules are checked:
- ISO recommendations
- GeoNetwork recommendations
- (Optional and not available by default) INSPIRE recommendations
The validation report display the list of rules checked and their status (pass or failed). The top checkbox allows to display only errors or all.
Creating a Thumbnail¶
Next, you need to create a graphic overview of your map which will be for a double purpose; as small thumbnail will be displayed in search results and as large thumbnail with much more details, to allow users to properly evaluate the data usefulness. As for the latest, the image that you will use as source should be a significant reproduction of the real dataset, possibly inclusive of the legend.
To create a thumbnail, go to the editing menu for your map. If you are no longer in editing mode, retrieve the map from one of the search options then click on Edit. Then follow these simple steps:
From the editing menu, click on the Thumbnails button on the top or bottom of the page.
- You will be taken to the Thumbnail Management wizard.
- To create a small or large thumbnail, click on the Browse button next to either one. It is recommended that you use 180 pixels for small thumbnails and 800x600 for large thumbnails. Using the ‘Large thumbnail’ option allows you to create both a small and large thumbnail in one go.
- You can use GIF, PNG and JPEG images as input for the thumbnails.
- A pop up window will appear allowing you to browse your files on your computer. Select the file you wish to create a thumbnail with by double-clicking on it.
- Click on Add.
- Your thumbnail will be added and displayed on the following page.
- You can then click on Back to Editing and save your record.
Linking WMS online resources¶
Metadata records in ISO19139 could be related to resources defined in WMS services. When searching metadata that has related WMS online resources, the Interactive Map button is displayed to load the WMS layer/s in the map viewer. A WMS online resource can be referenced in metadata like:
- Selecting protocol OCG-WMS Web Map Capabilities 1.1.1 or OCG-WMS Web Map Capabilities 1.3.0:
- URL: Url of WMS service
- Name of the resource: empty.
The Interactive Map button opens a window to select the layer/s defined in WMS capabilities document to load in map viewer.
- Selecting protocols OGC-WMS Web Map Service, OGC Web Map Service 1.1.1 or OGC Web Map Service 1.3.0:
- URL: Url of WMS service
- Name of the resource: WMS layer name (optional)
The behaviour the Interactive Map button depends if user indicated the layer name in the field Name of the resource or not, to show the window to select the layer/s to load in map viewer or load the layer directly.
Linking data for download¶
Finally, you can upload the dataset stored on your local computer and then create a link between data and related description. Files in whatever format can be uploaded: doc, PDF, images, vector layers, etc. For the latter the distribution in a compressed file is recommended. You can include the verctor data, the legend, any documentation that can help the interpretation of the data, related reports, detailed descriptions of the data processing, base data used to create the dataset specified and/or other relevant information. Follow these guidelines for uploading datasets:
- Make sure the total size of the compressed file is reasonable (less than 50 MB). Should your data be bigger than 50MB, consider a different mechanism to serve this data, e.g. through an FTP or HTTP server and than link the resource through an online resource ‘Web address (URL)’.
- You can create several smaller files when appropriate and upload them sequentially.
- You add the size of the file at the end of the description field.
To Upload a Dataset, follow these steps:
- The URL field can be left empty when uploading a file. The system will automatically fill this field out;
- Select the correct protocol to be used. If you do not see the buttons to browse and upload when File for download is selected, save the metadata and return to the upload section. Both buttons should appear;
- Provide a short description of the data;
- Click the Browse button and navigate to the folder where the file to be released is stored. Consider if you want to upload multiple files as one unique zip file or as multiple separate downloads. It is a good idea to add additional documentation with the datasets that provide the user with information related to the data described. Remind: the size of a single file to upload can’t exceed 50 Mbytes;
- Click Upload and then Save.
Linking metadata¶
Metadata records in ISO19139 could be related together based on ISO elements using for example:
- parent identifier
- operates on element for service metadata
Using GeoNetwork editor, user could define 3 types of relation:
- dataset metadata / service metadata (including a link to the data based on WMS layer name)
- parent / child relation
- feature catalogue (ISO19110) / dataset metadata (ISO19139)
All relations are described in the top right corner of the metadata. The menu allows navigation from one record to the other. Only metadata records visible to current user are displayed (ie. a metadata could be linked to another one but not displayed because not published for current user).
Parent / child relation¶
To create a child record, editors could click on the other actions menu, create child option in the search results.
Using this option, parent identifier will be automatically set up when duplicating the record.
Editors could also link an existing metadata record using the parent identifier displayed in the advanced view, metadata section. Clicking on the Add or update parent metadata section on the metadata relation list will move to this view. Then editors should use the (+) to expand the parent identifier and click on the field to open the metadata selection panel.
Once the parent selected, it will appear in the metadata relation list on the top right corner of the editor.
If a metadata record has children attached, the editor suggest the children update mechanism which propagate changes from a parent to all its children. The following interface define the configuration of the propagation:
Metadata on dataset / metadata on service relation¶
Linking a dataset to a service or a service to a dataset is made using the following panel:
Editor could define a layer name using the combo box (which try to retrieve layers from the WMS GetCapabilities document) or typing the layer name in the text field. This information is required to display the layer using the map viewer.
Relation is stored in :
<srv:operatesOn uuidref="" xlink:href=""/>
and (according to ISO CSW profil)
<srv:coupledResource>
<srv:SV_CoupledResource>
<srv:operationName></srv:operationName>
<srv:identifier></srv:identifier>
<gco:ScopedName></gco:ScopedName>
</srv:SV_CoupledResource>
</srv:coupledResource>
Only relation between records in the same catalogue are handle. Use of XLink attributes are not supported to create relation between datasets and services.
Feature catalogue relation¶
Feature catalogues are records stored in ISO 19110 standard. Relation between the 2 records are created using the link feature catalogue menu.
Compute bounding box from keywords¶
Editor can add extent information based on keyword analysis.
- For each keywords
- Search for the keyword in thesaurus
- If keyword in the thesaurus has an extent
- Add an extent with a description and a bounding box to the metadata record.
The process could be run in 2 modes :
- Add : Keep existing extent elements and add the new one at the end. Editor could clean the section after processing.
- Replace : Remove all extent having only a bounding box (temporal, vertical and bounding polygon are not removed), and add the new one at the end.
Editor need to select keyword from a thesaurus with spatial information. The name is added to the extent description field.
Then in the other actions menu, the compute boundinx box menus are available:
The metadata is saved during the process and one extent is added for each keywords.
If user manually add keywords just before computing bounding box, then it’s recommended to save your metadata record before launching the action in order to have latest keywords taken into account.
Assigning Privileges for a Map¶
As an important step of entering metadata to your map, you need to assign privileges for each map. This means that you will identify which work groups have which privileges, i.e. view, download, etc. for your particular map.
For instance, you can fdefine if the information and related services is visible to all (Internet users) or just to internal users only (Intranet). Privileges are assigned on a per group basis. Depending on the user profile (Guest, Registered User, Editor, Admin etc.) access to these functions may differ on a per user basis.
To assign privileges for your map, follow these steps:
- Find your map by using the search option. Whether you have multiple or single results from the search, on top of the individual record or next to the record you will always see a row of buttons including a Privileges button.
- Click on the Privileges button. This will take you to a new page. You can assign certain privileges to specific groups by selecting or deselecting them from this page. Simply click on the small box next to the privilege to place or remove a checkmark. Set All and Clear All buttons allow you to place and remove the checkmarks all at once.
Below is a brief description for each privilege to help you identify which ones you should assign to which group(s).
Publish: Users in the specified group/s are able to see the map, i.e. if searching with matching criteria.
Download: Users in the specified group/s are able to download the map.
Interactive Map: Users in the specified group/s are able to get an interactive map. The interactive map has to be created separately using a Web Map Server, which is part of the GeoNetwork opensource application.
Featured: When selected, the map is placed in the Features Maps of the home page and it appears there randomly.
Notify: Users in that work group receive notification that the map has been uploaded.
Assigning Categories for a Map¶
As a final step to entering metadata for a map, you should assign categories for it. The assigned categories will determine the categories the map will display under on the home page. To assign categories for a map, follow these steps:
- Find your map by using the search option. Whether you have multiple or single results from your search, on top of the individual record or next to the record, you will always see a row of buttons including a Categories button.
- Click on the Categories button. This will take you to a new page. You can assign one or multiple categories selecting or deselecting them from this page. Simply click on the small box next to the category to place or remove a checkmark.
Multilingual metadata in ISO19139¶
Editors could create multilingual metadata using ISO 19139. A default template is provided but user could add translation to an existing record.
To declare a new language in a metadata record:
- First check, the main language is defined in the metadata section
- then add one or more languages in the other language in the metadata section.
In editing mode, each multilingual elements are composed of:
- text input
- language selection list (language declared on the other language section are listed here)
By default, the selected language is the GUI language if language is defined in the metadata.
Optionnaly, Google translation service could be used. Translation could be suggested to the editor using the small icon right to the language selector. The translation convert the default metadata character string in the current selected language.
In view mode, according to GUI language : if GUI language is available in the metadata, the element is displayed in this language else the element is displayed in metadata default language. This behaviour is also applied to dublin core output for CSW services.
Uploading a New Record using the XML Metadata Insert Tool¶
A more advanced procedure to upload a new metadata record in the GeoNetwork system is using an XML document. This procedure is particularly useful for users who already have metadata in XML format, for instance created by some GIS application. To this regard, it has to be noted that the metadata must be in one of the standards used by GeoNetwork: ISO19115, FGDC and Dublin Core.
To start the metadata uploading process through the XML Metadata Insert tool, you should log in and select the appropriate option from the Administration page.
The main part of the page Import XML Formatted Metadata that is displayed is the Metadata text area, where the user can paste the XML metadata to import. Below this, there is the Type choice, which allows you select the type of record that you are going to create (Metadata, Template and Subtemplate). Then you can apply a stylesheet to convert your metadata input from ArcCatalog8 to ISO1915 or from ISO19115 to ISO19139, if required. Otherwise you can just leave none selected. The Destination schema list provides you with four options to choose the final standard layout for your metadata (ISO19115, ISO19139, FGDC and Dublin Core). Finally you should select the Group as main group in charge of the metadata and the Category that you want to assign to your metadata. By clicking the Insert button the metadata is imported into the system; please note that all links to external files, for instance to thumbnails or data for download, have to be removed from the metadata input, to avoid any conflict within the data repository.
If your metadata is already in ISO19115 format, the main actions to be performed are the following:
- Paste the XML file that contains the metadata information in the Metadata text area;
- Select Metadata as type of record that you are going to create
- Select the metadata schema ISO19139 that will be the final destination schema;
- Select the validate check box if you want your metadata to be validated according to the related schema.
- Select the group in charge of the metadata from the drop down list;
- Select Maps and Graphics from the list of categories;
- Click the Insert button and the metadata will be imported into the system.