Dr. Brian Ritchie (RAL - STFC)
The ICAT Job Portal (IJP) allows users to create and submit jobs to HPC resources or compute farms, taking as inputs datasets and datafiles selected using ICAT catalog searches, with jobs using the ICAT Data Service for data access. Jobs are specified via Job Types, where each Job Type defines: whether a job is interactive or can be run as a batch job; the dataset types for which a job may be run; whether a single job instance can be applied to multiple entities (datasets and/or datafiles); and other options and parameters to be passed to job instances. An IJP installation includes one or more *batch connectors*, which the IJP uses to submit jobs to batch processing systems. When the user selects multiple entities for a batch job, they are given the option of submitting multiple instances of the job (one per entity) to the batch system. The portal allows users to monitor the progress and status of ongoing and completed jobs. We describe the broad architecture of the IJP and cover recent developments, including work to integrate the IJP and TopCAT, and on design modifications to meet specific requirements of the Octopus facility at the UK Science & Technology Facility Council's Central Laser Facility.