Page 1 of 1

Queued on SLURM cluster

Posted: Mon Oct 30, 2023 3:03 pm
by deyvidpi
Sorry I keep posting here, I feel like I'm the only one bothering you around there...

I've had a few jobs stuck on "Queued on SLURM cluster" for over 4 days. Is this a known issue?
I saw this My job is stuck in "Waiting for server" FAQ, but I am not sure it is related.

As always, thanks for your help!

Re: Queued on SLURM cluster

Posted: Mon Oct 30, 2023 4:21 pm
by keenon
Feel free to hit "Force reprocess" if your job waits for more than a day. This shouldn't ever happen, but sometimes our cluster gets out of sync and jobs that think they're queued end up getting lost.

Re: Queued on SLURM cluster

Posted: Tue Oct 31, 2023 3:59 am
by deyvidpi
Thanks for your answer. I hit "Force reprocess" last night on my last 6 jobs, it hasn't been quite a full day but for now they are still stuck at the same stage.

Re: Queued on SLURM cluster

Posted: Wed Nov 01, 2023 9:27 am
by deyvidpi
Am I the only one experiencing this issue?
After force reprocessing, and even creating a new profile, this is still Queued on SLURM cluster.

My trial has nothing overly specific, I use the default OpenSim model, and I tried using both opensim .trc and vicon .c3d files.

Sorry if I sound pushy, I understand very well that there are a lot of adjustments to go through when you first release a new tool!

Re: Queued on SLURM cluster

Posted: Wed Nov 08, 2023 3:51 am
by jc876
Hi all,

I am in a similar situation as David as I have two jobs Queued on SLURM cluster. Both were originally uploaded at a similar time as David (~30th Oct). My problem is fairly simple, just two trials per job (as .trc files) and a model file (Lai2017). These data are kinematics only hence do not have accompanying force data.

I forced reprocessing on both after reading Keenon's response but this did not make a difference. I tried force reprocessing again yesterday as it had been a couple of weeks, but unfortunately it still remains stuck Queued on SLURM cluster.

Has this been resolved yet? Or is there something else we could try?

Cheers,

James

Re: Queued on SLURM cluster

Posted: Sun Nov 12, 2023 6:29 pm
by mfakhar
I have the same issue and force reprocessing gets me back to the same SLURM cluster. In the short window I had between "looking for a server" and "queued on the SLURM cluster", I pressed "see what the servers are working on" and they were all marked as "waiting for a proof of life" or something similar!
I wonder if something is wrong with the servers or if I'm doing it wrong.
I appreciate it if someone could respond.
Bests.