[Bio-Linux] Biolinux8 - Best job scheduler for small cluster?

[Tony Travis]

On 05/02/15 07:16, Xavier Martínez Serrano wrote:
> Hi,
>
> We have 4 computers with ~20CPU each in a hospital research group  and
> we would like to set a cluster with them. Which is the best suitable job
> scheduler for us if we are running Biolinux7 in three of them and
> Biolinux8 in the other?
>
> We have been looking at common job schedulers like: Slurm, SGE, Condor,
> Torque, ... but we wonder which best suits for our small resources, to
> make it as easy as possible.
>
> What can you recommend us?

Hi, Xavi.

I've run SGE under Bio-Linux 7, but I would not advocate running a
mixture of Bio-Linux 7 and 8. Tim's Bio-Linux 7-8 upgrade script works
very well and I would recommend upgrading your Bio-Linux 7 machines to
Bio-Linux 8. One thing you might consider looking at is Qlustar:

  https://qlustar.com/

They have made some commitment to support Debian/Med and I demo'ed a
version with a Bio-Linux 'Front-end' at last year's Debian-Med Sprint:

  https://qlustar.com/news/qlustar-demo-debianmed-sprint

Q-Leap gave a presentation at the recent Debian-Med Sprint, which I
watched on Skype because I couldn't attend the meeting:

  https://wiki.debian.org/Sprints/2015/DebianMed2015

Maybe Tim can tell you more because he was there. It's pay-for software,
and I have some reservations about their licensing model, but from what
I've seen of it Qlustar is very good cluster software. Q-Leap support
Slurm in particular, but do consider Amdahl's Law:

  http://en.wikipedia.org/wiki/Amdahl's_law

I'm working with Luca Clivio to install a Qlustar cluster with a
Bio-Linux Front-end at MNI (Mario Negri Institute) in Milan:

  http://www.marionegri.it/mn/it/index.html

Please contact Luca directly if you are interested in this project.

HTH,

  Tony.

--
Dr. A.J.Travis, University of Aberdeen, Institute of Biological and
Environmental Sciences, Cruickshank Building, St. Machar Drive, Aberdeen
AB24 3UU, Scotland, UK. tel +44(0)1224 272700, fax +44 (0)1224 272 396
http://www.abdn.ac.uk, mailto:tony.travis at abdn.ac.uk, skype:ajtravis


The University of Aberdeen is a charity registered in Scotland, No SC013683.
Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.