16–19 Oct 2016
Copenhagen University
Europe/Copenhagen timezone

Data management system of China Spallation Neutron Source

17 Oct 2016, 17:00
1h 30m
Marble Hall (Copenhagen University)

Marble Hall

Copenhagen University

Thorvaldsensvej 40
Board: 34
Poster Posters

Speaker

Mr Ming Tang (Institute of High Energy Physics)

Description

The design philosophy of data management system for China Spallation Neutron Source (CSNS) is data safety, user convenience, and big-data sharing. Under the considerations, the four main parts are covered: data transfer, data storage, metadata catalogue, and data access. The high-speed and highly reliable data transfer service is developed. It will handle with the data delivery among several locations: local beamlines, computing center on site, remote mirrors for disaster backup or supercomputing. It will favor the high-performance computing and big-data analysis. Meanwhile, multi-level hierarchies including hot/cold/backup zones are introduced in data storage, in order to apply the different data retrieval policies and grant permissions. The metadata catalogue is completed based on ICAT (http://www.icatproject.org/). A load-balanced ICAT cluster with read/write splitting is used to ensure safety and stability of database. The web-based data portal will provide users data access every time and everywhere, including metadata indexing, data download/upload, NeXus data browser and visualization in one-stop.

Primary author

Mr Ming Tang (Institute of High Energy Physics)

Co-authors

Dr Haolai Tian (Institute of High Energy Physics, Chinese Academy of Sciences) Dr JUNRONG ZHANG (Institute of High Energy Physics, Chinese Academy of Sciences) Mrs Lili Yan (Institute of High Energy Physics, Chinese Academy of Sciences) Dr Rong Du (China Spallation Neutron Source, Institute of High Energy Physics)

Presentation materials

There are no materials yet.