16–19 Oct 2016
Copenhagen University
Europe/Copenhagen timezone

The Design of Distributed data processing at CSNS

17 Oct 2016, 17:00
1h 30m
Marble Hall (Copenhagen University)

Marble Hall

Copenhagen University

Thorvaldsensvej 40
Board: 2
Poster Posters

Speaker

Dr Rong Du (China Spallation Neutron Source, Institute of High Energy Physics)

Description

A high-extendable distributed data processing suit for neutron experiments (DroNE) is developed in C++, which will server for the online data manipulation and analysis of neutron scattering instruments. The loosely-coupled distributed architecture is used to meet multi-discipline research demands at China Spallation Neutron Source (CSNS). The software provides flexible Python/Java APIs, and allows a wide variety of interfaces to run the experiment. In the implementation, the online data streaming is received by DIM from Data Acquisition System (DAQ), and the real-time process variables are logged by EPICS from slow control system. Synchronously, a complete chain of reconstruction algorithms will be trigged to decompose the time-of-fight (TOF) neutron events. A communication layer is also developed and open to all distributed components. The physical histogram and meta-data related to certain run will be kept in-memory data structure store with time series durability. It will allow the direct access of the data reduction package, Mantid. In addition, the data visualization software is built in client/server model, to satisfy the quick response needs of online data manipulation.

Primary author

Dr Rong Du (China Spallation Neutron Source, Institute of High Energy Physics)

Co-authors

Dr Haolai Tian (China Spallation Neutron Source, Institute of High Energy Physics) Dr JUNRONG ZHANG (Institute of High Energy Physics, Chinese Academy of Sciences) Mrs Lili Yan (China Spallation Neutron Source, Institute of High Energy Physics) Mr Ming Tang (Institute of High Energy Physics)

Presentation materials

There are no materials yet.