Updated 21 May 2020
This article provides users with information about work currently underway to:
As stated in previous announcements, we are in the process of implementing a gradual transition of all "sci" servers and the LOTUS cluster to CentOS7.
Additionally, we will replace the existing batch scheduler (Platform LSF) with SLURM. We have chosen SLURM because it is a cost-effective alternative which is widely-used by other academic/scientific institutions (such as the UK Met Office).
Work is underway to provide a new delivery method for the “JASMIN Analysis Platform” software, which is the stack of software currently maintained and deployed across the scientific analysis servers, the LOTUS batch processing clusterand a number of bespoke VMs which have been deployed.
The new system, known as “JASPY”, will be based around the "conda" system for creating the core Python environments in Python 2.7 and Python 3.7. JASPY is documented here.
The JAP replacement takes the form of 2 new software components:
We have drafted documentation about the changes to software on JASMIN. The documentation is currently provided as a single web-based document (PDF). Please consult the documentation here:
Please let us know about your experience of using these CentOS7 machines, by e-mailing CEDA Support email@example.com including "centos7 support" in the subject line. Please send us both your positive and negative feedback so that we can gauge the response and react to problems. If you have any specific feedback regarding the documentation then please also let us know.
The CEDA and JASMIN team is busy working on this activity which should be largely transparent to users. Where individual project VMs are affected, projects have been contacted and plans are in preparation for the redeployment of those hosts with CentOS7 equivalents.
The CentOS7 queues managed by SLURM and the CentOS7 SLURM submission node will be available for users to use by mid-May 2020. Documentation for this is now available but further details are still being added.
Users are encouraged to consult this documentation now and to consider what changes they will need to make to their workflows, in advance of the current LOTUS batch scheduler system becoming unavailable from the end of June 2020.
A webinar to demonstrate usage of the new SLURM-based cluster will be announced shortly: this will take place in mid-June 2020.
sci5-test.jasmin.ac.uk. Further information about the “sci” servers can be found here
sci[4,5].jasmin.ac.uk. Further details on the copy service can be found here
Information about the new CentOS7 login, sci and xfer server is available here.
Plans for updates to
jasmin-cylc servers are currently taking shape. More information about the new configurations will be provided in future communications.
Thank you for your attention and please look out for further updates as this work progresses.
CEDA and JASMIN Team