16–19 Oct 2016
Copenhagen University
Europe/Copenhagen timezone

DonkiOrchestra: a scalable system for data collection and experiment management based on ZeroMQ distributed messaging

18 Oct 2016, 16:00
20m
Marble Hall (Copenhagen University)

Marble Hall

Copenhagen University

Thorvaldsensvej 40
Oral Contribution Contributions 6

Speaker

Mr Roberto Borghes (Elettra Sincrotrone Trieste)

Description

Synchrotron and Free Electron Laser beamlines consist of a complex network of devices. Such devices can be sensors, detectors, motors, but also computational resources. The setup is not static and is often upgraded. The data acquisition systems are constantly challenged by such continues changes and upgrades, so a constant evolution of software technologies is necessary. DonkiOrchestra is a TANGO based framework developed at Elettra Sincrotrone Trieste that takes full advantage of the ZeroMQ distributed messaging system and supports both data acquisition and experiment control. In the DonkiOrchestra approach, a TANGO device referred to as Director, provides the logical organization of the experiment as a sequential workflow relying on triggers. Each software trigger activates a set of Actors that can be hierarchically organized according to different priority levels. This allows for concurrency and map-reduce strategies. Data acquired by the Actors is tagged with the trigger number and sent back to the Director which stores it in suitably structured HDF5 archives. The intrinsic asynchronicity of ZeroMQ maximizes the opportunity of performing parallel operations and sensor readouts. This paper describes the software architecture behind DonkiOrchestra, which is fully configurable and scalable, so it can be reused on multiple endstations and facilities. Furthermore, experimental applications, performance results and future developments are presented and discussed.

Primary author

Mr Roberto Borghes (Elettra Sincrotrone Trieste)

Co-author

Dr Georgios Kourousias (Elettra - Sincrotrone Trieste)

Presentation materials

Peer reviewing

Paper