16–19 Oct 2016
Copenhagen University
Europe/Copenhagen timezone

Development, testing and deployment of the ESS data aggregation and streaming software

17 Oct 2016, 17:00
1h 30m
Marble Hall (Copenhagen University)

Marble Hall

Copenhagen University

Thorvaldsensvej 40
Board: 38
Poster Posters

Speaker

Afonso Mukai (European Spallation Source ERIC)

Description

A data aggregation and streaming software system is being developed at the ESS Data Management and Software Centre as part of the BrightnESS project, with ISIS as an in-kind partner. Data produced by sources such as detector event formation systems, sample environment, motion control and choppers will be aggregated by the system, to be consumed by software performing tasks including live data reduction and file writing. The design is based on Apache Kafka, using Google FlatBuffers for serialisation. An integration laboratory where equipment and software can be deployed is available at ESS. We will present our approach to the development and automated testing and deployment of the multiple system components.

Primary authors

Afonso Mukai (European Spallation Source ERIC) Dominik Werder (Paul Scherrer Institute) Dr Frederick Akeroyd (STFC) Dr Mark Koennecke (Paul Scherrer Institute) Dr Matt Clarke (Science and Technology Facilities Council) Matthew Jones (ISIS/RAL) Dr Michele Brambilla (Paul Scherrer Institut) Tobias Richter (European Spallation Source ERIC)

Presentation materials