1 / 12

International data management: The experience of the Auger Collaboration S. J. Sciutto

International data management: The experience of the Auger Collaboration S. J. Sciutto Departamento de Física and IFLP/CONICET Universidad Nacional de La Plata La Plata, Argentina. LISHEP2004 Rio de Janeiro, February 2004. The Auger Collaboration. 2 Observatories 19 Countries

anoush
Download Presentation

International data management: The experience of the Auger Collaboration S. J. Sciutto

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. International data management: The experience of the Auger Collaboration S. J. Sciutto Departamento de Física and IFLP/CONICET Universidad Nacional de La Plata La Plata, Argentina LISHEP2004 Rio de Janeiro, February 2004

  2. The Auger Collaboration • 2 Observatories • 19 Countries • 50+ Institutions • 300+ People Northern hemisphere: Millard county Utah, USA Southern hemisphere: Malargüe Mendoza, Argentina

  3. The Auger hybrid detector • 3000 km2 surface array. • 4 fluorescence eyes. • Detector cross calibration with hybrid events.

  4. Comms.antenna GPSantenna Three 8” PM Tubes Solar panel and electronics box Battery box White light diffusing liner 12 m3 of de-ionized water Plastic tank SD local station SD array: • Hexagonal grid of 1600 stations • 1500 m between neighbour stations

  5. Fluorescence detectors 33 telescope units. 3.4 meter diameter mirrors. 440 PMTs per camera. Operate in clear moonless nights (10% duty cycle)

  6. AUGERnet @ Malargüe LS LS LS LS Inet – I2 R FD Ethernet R 34Mbs R SD Ethernet LSX Private IP CLASS B 192.168.x.x BSU R Campus Ethernet Pm official IP CLASS C High Speed Switch Fd Non-IP traffic gateway CDAS cluster Non-Routable IP traffic Routable IP traffic (René Bilhaut LAL & SJS)

  7. Auger southern observatory networks • SD digital radio links • FD and SD microwave links • CDAS and campus LAN • Link Malargüe – Buenos Aires • Access to Internet • Access to Internet 2 Designed, built and maintained by Auger Provided by RETINA

  8. Mirror at Fermilab, USA Primary mirror at Lyon, France 1 Mbps link Malargüe-Buenos Aires AMPATH link Argentina-USA CDAS at Malargüe Observatory RETINA (Buenos Aires) Auger data mirroring system Auger countries

  9. Malargüe Observatory gets connected Before 2001.Dial-up connection via a long distance call (e-mail and basic services only). Survey of available alternatives for an Internet link. Main difficulty: The last mile. 2001.Comissioning of 128 kbps full duplex dedicated satellite link with RETINA (Buenos Aires): Full internet services become available at Malargüe. 2002.The Engineering array prototype starts taking data. The mirroring system enters in operation. 2003.Upgrading domestic link to 1 Mbps (Microwave + fiber optics). Auger enters Internet 2. Now. Data mirroring system in production phase (120 GB transmitted so far). Current data flow (50 MB/day) is low (only 10% of the SD detectors operative) and expected to grow in the future to 1 TB/yr. Users’ requirements increase continously.

  10. Computer simulations and data analysis • Computer simulations are essential for interpreting the real data. • Large CPU and storage requirements. • Basic simulated data is generated and stored at Fermilab and Lyon. Approximately 200 CPU years have already been used to produce about 6 TB of data. • Analysis of simulated data performed at the production centers.

  11. 1 TB across the Atlantic, steered from Argentina The excercise: Copy 25,000 individual data sets of mean size 40 MB (total size 1 TB) from FNAL’s MSS to Lyon. Operations performed from La Plata, Argentina.

  12. International data management at the Auger CollaborationConclusions • The task of providing a reliable internet connection to a location like the Auger Southern Observatory was carried up successfully. • The major difficulty was related to the last mile issue. • The link proved to be essential for the development of the Observatory. • The quality of the communications with institutions within I2 is, at present, very good; but the links to some institutions in developing countries need to be improved.

More Related