Back to IMesh Toolkit Home Page
Back to IMesh Toolkit Homepage
Subject Gateway Requirements
Technology Review
Work In Hand
  Personalization
Annotation
Reading Lists
OAI  Normalization tools
Metadata Exchange
RDF queries
Evaluation
Dissemination
Project Documentation
Related Links
Project Partners
IMesh Home Page

The IMesh Toolkit

[ Work In Hand > Components> Metadata Exchange ]

Metadata Exchange tools


Martin Hamilton has provided a number of tools to exchange metadata between different systems such as ROADS and the Scout Portal Toolkit (SPT). The approach is based on well-defined standards which were reviewed in the IMesh Toolkit Technology review (please note that this review was carried out in late 2000 and does not cover recent developments).

Here is a short description of the scripts (written in Perl). You can read more about them on the documentation pages before downloading the package.

  • dcbot.pl - Robot to harvest Dublin Core metadata
    dcbot.pl is a Perl program to generate Dublin Core elements in various formats from the metadata embedded in a nominated HTML page. It was derived from the original UKOLN DC-dot program, which is intended to run as a CGI script under harness to a Web server. By removing the Web functionality the resulting code can be used trivially in a batch scripting environment, e.g. to harvest large volumes of Dublin Core metadata for later indexing.
  • spt2ldif.pl - Munge an SPT export into LDIF
    The spt2ldif.pl program takes a bulk export produced by the Scout Portal Toolkit (SPT) software, and rewrites it as a series of LDIF records suitable for importing into an LDAP server. An updated version of the LDIF (unqualified) Dublin Core schema originally produced by the ROADS project is used. The schema and the output of this utility have been tested for compatibility with OpenLDAP 2.0.23, and is included with the imeshtk-utils distribution archive for convenience.
  • iafa2spt.pl - Munge a collection of IAFA (ROADS) templates into SPT format
    The iafa2spt.pl program accepts one or more IAFA templates (as used by the ROADS software), and uses them as the basis for new records created in the Scout Portal Toolkit (SPT) bulk import/export format for merging into an SPT database. This provides a potential migration path from ROADS to the SPT software, and an easy way to offer service using both packages in parallel.
  • ldif2spt.pl - Munge a collection of LDIF records into SPT format
    The ldif2spt.pl program accepts one or more LDIF records in the Dublin Core schema (included in the support subdirectory of this distribution), and uses them as the basis for new records created in the Scout Portal Toolkit (SPT) bulk import/export format for merging into an SPT database. This provides a potential migration path from LDAP based subject gateways to the SPT software, and an easy way to offer service using both packages in parallel.
  • spt2centroid.pl - Munge an SPT export into a WHOIS++ centroid
    The spt2centroid.pl program takes a bulk export produced by the Scout Portal Toolkit (SPT) software, and uses it to generate an RFC 1913 style WHOIS++ ``centroid''. Centroids are the WHOIS++ forward knowledge summary mechanism, and are supported by default in the ROADS software's cross-searching subsystem.
  • spt2cip.pl - Munge an SPT export into a CIP Tagged Index Object
    The spt2cip.pl program takes a bulk export produced by the Scout Portal Toolkit (SPT) software, and uses it to generate an RFC 2654 style Tagged Index Object, for use with the Common Indexing Protocol (see RFCs 2651 and 2652). TIOs are one of the forward knowledge summary mechanisms supported by CIP, and are supported by default in the ROADS software's cross-searching subsystem.
  • spt2iafa.pl - Munge an SPT export into IAFA (ROADS) templates
    The spt2iafa.pl program takes a bulk export produced by the Scout Portal Toolkit (SPT) software, and rewrites it as a series of IAFA templates suitable for loading into a ROADS server.
  • spt2txt.pl - Munge an SPT export into plain text
    The spt2txt.pl program takes a bulk export produced by the Scout Portal Toolkit (SPT) software, and rewrites in a simple attribute value text format, suitable for indexing by an arbtirary full text searching package.

Online Documentation Links
Download the package