230 likes | 375 Views
Join the MPA Institute seminar discussing ambitious extensions for Millennium simulations. Explore advancements in simulation techniques including FOF groups, subhalos, and mock images. Discover how synthetic galaxies and particle density fields enhance our understanding of cosmic structures. We will delve into practical applications like database visualizations and environmental queries. Engage with cutting-edge tools like MoMaF and SAM online, and learn about improvements in galaxy image realism that address weak and strong lensing. Let's envision the future of cosmic structure research! ###
E N D
Millennium Data Dissemination possible extensions how ambitious can/should we be? MPA institute seminar
FOF groups and Subhalos Mock images Raw data: Particles Density fields Subhalo merger trees Synthetic galaxies (SAM) Mock catalogues Millennium Workshop
MRObs Scaling Simulation Particles FOF Groups (Sub-)Halos Halo Merger Trees FOF Group Finder SUBFIND Tree Builder Gadget SAM SSP SExtractor SkyMaker’ MoMaF’ SAM Galaxies SExtractor Catalogues Synthetic Images Light-cone Galaxies IGM PSF, Noise, Background Millennium Workshop
Raw data • Serve particles from Millennium simulations • 10 billion/snapshot, ~25TB • from database? • with spatial queries • links to halos/FOF groups • through JobRunner services • cutout • gridding + FFTs etc MPA institute seminar
Other simulations? • Hydro Example: • http://gavo.mpa-garching.mpg.de/HydroClusters • online visualisation: http://galformod.mpa-garching.mpg.de/phoxybrowser • Others • Millennium+gas? • Eagle • … • How? • In DB ok for objects • Visualisation support for “fluffy things” MPA institute seminar
MRObs Scaling Simulation Particles FOF Groups (Sub-)Halos Halo Merger Trees FOF Group Finder SUBFIND Tree Builder Gadget SAM SSP SExtractor SkyMaker’ MoMaF’ SAM Galaxies SExtractor Catalogues Synthetic Images Light-cone Galaxies IGM PSF, Noise, Background Millennium Workshop
Group catalogs • Have • FOF • SUBFIND subhalos • Mhalo merger trees • Dhalo merger trees • More properties • shapes, density profiles (ala AIP, or ala MR-XXL): good for lensing • others? • More? • BDM, NEXUS, ORIGAMI, … • All of Knebeetal • LSS objects? • Voids, filaments, walls in the DB • “more precise” environmental queries possible • per grid cell or as object (“stacking voids”) MPA institute seminar
MRObs Scaling Simulation Particles FOF Groups (Sub-)Halos Halo Merger Trees FOF Group Finder SUBFIND Tree Builder Gadget SAM SSP SExtractor SkyMaker’ MoMaF’ SAM Galaxies SExtractor Catalogues Synthetic Images Light-cone Galaxies IGM PSF, Noise, Background Millennium Workshop
SAM catalogues • More models • Durham, MPA • Complete MR-XXL? • ~200x Millennium, 80TB • Extensions MPA institute seminar
SFH-s • Allows SEDs from post-processing • how to store? • rows vs arrays (in SQLServer) • functions (easy in SQLServer): • create spectra • “exact” observer frame bands • PCA amplitudes in the database • find nearby galaxies for given observed spectrum MPA institute seminar
SAM online • GALFORM online !!! • http://galformod.mpa-garching.mpg.de/dev/jobrunner/ • on millimil • Do we want others? • Galacticus? • Need constraints, validated models. • How afraid should we be of “bad science”? • SAM online on Millennium? • input to MRObs pipeline MPA institute seminar
MRObs Scaling Simulation Particles FOF Groups (Sub-)Halos Halo Merger Trees FOF Group Finder SUBFIND Tree Builder Gadget SAM SSP SkyMaker’ SExtractor MoMaF’ SAM Galaxies SExtractor Catalogues Synthetic Images Light-cone Galaxies IGM PSF, Noise, Background Millennium Workshop
Light cones • In Database: not just from MPA! • common model • linked to SAMs • More • deep: new code for Millennium-II • all sky: MR-XXL • with scaling! • What properties needed? • who wants them? • what for (lensing?)? • Light cone building online • Will soon make our MoMaF available on JobRunner • new code in preparation (for MR-II etc) MPA institute seminar
MRObs Scaling Simulation Particles FOF Groups (Sub-)Halos Halo Merger Trees FOF Group Finder SUBFIND Tree Builder Gadget SAM SSP SExtractor MoMaF’ SkyMaker’ Light-cone Galaxies SAM Galaxies SExtractor Catalogues Synthetic Images IGM PSF, Noise, Background Millennium Workshop
MRObs • Store of images will keep growing • Overzier! • Create images on demand • telescope models custom? • Post processing as well? • Sextractor • other? • Improvement galaxy images • realistic structure (weak lensing systematics, strong lensing structure) • from simulations ? • form observations? MPA institute seminar
MRObs Scaling Simulation Particles FOF Groups (Sub-)Halos Halo Merger Trees SUBFIND FOF Group Finder Tree Builder Gadget SAM SSP Lensing SExtractor MoMaF’ SkyMaker’ Light-cone Galaxies SAM Galaxies SExtractor Catalogues Synthetic Images IGM PSF, Noise, Background Millennium Workshop
Lensing • Under construction • with Ben Metcalf • Online? • Why not, JobRunner will handle it. • How much? • what is required for weak lensing? MPA institute seminar
Even more • L-Galaxies online++ • updating physics modules? • MCMC mode? • Dark matter light cones? • for lensing • what do we need? particles, fields? • Interface • dashboard (M.Egger) • improve SQL interface (Roys talk) MPA institute seminar
Galformod infrastructure • Currently • 12+1 12-core nodes • 180 TB raw storage • 20TB DB storage • What do others have? • AIP ~500TB • JHU ~5PB (?) • What do we want? 100 billion … MPA institute seminar
What do we wantneed? • Depends on answers to all previous questions • What can we afford? • Where can we get the money? • Where do we put “it”? • RZG? • Pool our resources together? • beyond mirror • distributed over Virgo nodes? • Larger scale collaborations (EUDat)? • see Hermann’s talk MPA institute seminar