hands on session the amga metadata catalogue n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Hands on session: the AMGA Metadata Catalogue PowerPoint Presentation
Download Presentation
Hands on session: the AMGA Metadata Catalogue

Loading in 2 Seconds...

play fullscreen
1 / 12

Hands on session: the AMGA Metadata Catalogue - PowerPoint PPT Presentation


  • 80 Views
  • Uploaded on

Hands on session: the AMGA Metadata Catalogue. Riccardo Bruno - INFN Madrid, 07-11/05/2007. Access the Metadata Catalog. Copy a template of config file for the MDC: $ cp $GLITE_LOCATION/etc/mdclient.config \ $HOME/.mdclient.config Start up the Metadata Catalog Client with $ mdclient

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Hands on session: the AMGA Metadata Catalogue' - bertha-reid


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
hands on session the amga metadata catalogue

Hands on session: the AMGA Metadata Catalogue

Riccardo Bruno - INFN

Madrid, 07-11/05/2007

access the metadata catalog
Access the Metadata Catalog
  • Copy a template of config file for the MDC:

$ cp $GLITE_LOCATION/etc/mdclient.config \

$HOME/.mdclient.config

  • Start up the Metadata Catalog Client with

$ mdclient

  • Once logged in, you can list the available commands, typing help.

Connected to amga.ct.infn.it:8822

ARDA Metadata Server 1.2.0

Query> help

>> >help [topic]<

>> >Displays help on a command or a topic.<

>> >Valid topics are: help metadata metadata-optional directory entry group acl index schema sequence user view ticket commands<

  • Commands are grouped by topic. You can get the list of valid commands for each topic, typing:help [topic]
  • Example: help entry
amga list of topics help
Valid topics:

help

metadata

metadata-optional

directory

replication

entry

group

acl

index

schema

sequence

user

view

ticket

commands

AMGA: List of topics (HELP)
mdclient generic commands
>> createdir <path> [options]

Make a new folder. It can inherit the schema assosciated to the upper level folder

>> rm pattern

Remove items corresponding to the given pattern

>> link <file>

Make a link to another file or to a external URL

>> dir <directory>

List the content of a directory

>> listentries <directory>

List the items (not the collections) of a directory

>> stat <filepattern>

Show the statistic information about a directory

>> chown <file> <owner>

Changhe the ownership of a file or a directory

>> chmod <file> <rights>

Change the access rights to a file or a directory

>> rmdir <directory>

Remove a directory

>> dump <directory>

Make a recursive dump startung from a given directory, (the default is: ‘/’)

mdclient: Generic Commands
mdc directory related commands
MDC directory related commands
  • Browse the contents of a directory
    • dir [path] / ls [path]

Returns the name of all subdirectories and files in the given pathor in the current directory if not specified

  • Print the current working directory
    • pwd
  • Change the current working directory
    • cd directory

Example: cd /gilda/madrid

  • Directory creation
    • createdir /parentdir/dir

Creates the directory dir if it does not yet exist but parentdir already does

Example: createdir /gilda/Madrid/madridXX (XX=01…40)

  • Directory removal
    • rmdir path

Removes the directory given by path

mdc handling attributes
MDC: Handling attributes
  • Schema population
    • addattr dir attr type

Adds a new attribute to the schema of a directory. Type is the name of an SQL datatype which will translated (if necessary) into a data type understood by the back end DB.

Examples of valid datatypes are int, float, varchar(n), timestamp, text, numeric(p,s)

Examples:addattr /gilda/Madrid/madridXX id int

addattr /gilda/Madrid/madridXX name varchar(32)

addattr /gilda/Madrid/madridXX remark varchar(128)

  • Attribute listing
    • listattr path

Returns a list of all attributes of the given file/direcory

  • Attribute Removal
    • removeattr dir attribute

Removes an attribute from a directory if it is not used by any entry in the directory

mdc managing entries
MDC: managing entries
  • Entry creation
    • addentry entry (attribute value)+

Add a new entry and initializes some attributes

Example: addentry /gilda/Madrid/madridXX/entry_01 id 1 name ‘name 01’ remark ‘remark of entry 01’

  • Setting attribute values
    • setattr entry (attribute value)+

Sets one or more attributes of an entry to given values

Example: setattr /gilda/Madrid/madridXX/entry_01 id 100

  • Getting attribute values
    • getattr pattern (attribute)+

Returns the entries and all the attributes for every file matching pattern

Example: getattr /gilda/Madrid/madridXX/* name

  • Entry deletion
    • rm pattern

Removes all entries matching pattern

Example: rm /gilda/…/entry_*

metadata queries
Metadata Queries
  • find pattern ‘query_condition’

Returns all entries matching pattern for which query_condition is true

Examples:find /gilda/Madrid/madridXX ‘id > 10’find /gilda/Madrid/madridXX ‘like(name, “P%”)’find /gilda/Madrid/madridXX ‘like(name, “P%”) AND id > 10’

  • selectattr attr... condition

Returns the values of given attributes for all files matching condition

Example:

cd /gilda/Madrid/madrid

selectattr .:id .:name ‘id > 10'

hands on session
Hands-on Session

Exercise:

  • Log into the Metadata Catalog
  • Create a directory with your surname into the /grid/gilda/Madrid/madridXX directory
  • Add some attributes (id int, name varchar(32), remark varchar(128)) to the directory just created
  • Add some entries, you may use any name or the LFNs you uploaded and registered into the File Catalog during the DMS hands-on session
  • Fill the attribute fields for the inserted entries
  • Look for the entries having ‘id’ > 50
solution
Solution

Query> createdir madrid40

Query> pwd

>> /gilda/Madrid/madrid40/

Query> addattr /gilda/Madrid/madrid40/ id int

Query> addattr /gilda/Madrid/madrid40/ name varchar(32)

Query> addattr /gilda/Madrid/madrid40/ remark varchar(128)

Query> addentry /gilda/Madrid/madrid40/entry_01 id 1 name ‘name 1' remark ‘remark 1‘

Query> addentry /gilda/Madrid/madrid40/entry_0n id n name ‘name n' remark ‘remark n‘

Query> getattr /gilda/Madrid/madrid40/* id name remark

Query> find /gilda/Madrid/madrid40/ ‘id >= k‘ (k=1…n)

gilda wiki pages
GILDA wiki pages
  • Introduction to AMGA
    • https://grid.ct.infn.it/twiki/bin/view/GILDA/AMGAHandsOn
  • AMGA Advanced usage
    • https://grid.ct.infn.it/twiki/bin/view/GILDA/AMGAAdv