Queued on SLURM cluster

Pagnon David · Post by **Pagnon David** » Mon Oct 30, 2023 3:03 pm

Sorry I keep posting here, I feel like I'm the only one bothering you around there...

I've had a few jobs stuck on "Queued on SLURM cluster" for over 4 days. Is this a known issue?
I saw this My job is stuck in "Waiting for server" FAQ, but I am not sure it is related.

As always, thanks for your help!

Keenon Werling · Post by **Keenon Werling** » Mon Oct 30, 2023 4:21 pm

Feel free to hit "Force reprocess" if your job waits for more than a day. This shouldn't ever happen, but sometimes our cluster gets out of sync and jobs that think they're queued end up getting lost.

Pagnon David · Post by **Pagnon David** » Tue Oct 31, 2023 3:59 am

Thanks for your answer. I hit "Force reprocess" last night on my last 6 jobs, it hasn't been quite a full day but for now they are still stuck at the same stage.

Pagnon David · Post by **Pagnon David** » Wed Nov 01, 2023 9:27 am

Am I the only one experiencing this issue?
After force reprocessing, and even creating a new profile, this is still Queued on SLURM cluster.

My trial has nothing overly specific, I use the default OpenSim model, and I tried using both opensim .trc and vicon .c3d files.

Sorry if I sound pushy, I understand very well that there are a lot of adjustments to go through when you first release a new tool!

James Cowburn · Post by **James Cowburn** » Wed Nov 08, 2023 3:51 am

Hi all,

I am in a similar situation as David as I have two jobs Queued on SLURM cluster. Both were originally uploaded at a similar time as David (~30th Oct). My problem is fairly simple, just two trials per job (as .trc files) and a model file (Lai2017). These data are kinematics only hence do not have accompanying force data.

I forced reprocessing on both after reading Keenon's response but this did not make a difference. I tried force reprocessing again yesterday as it had been a couple of weeks, but unfortunately it still remains stuck Queued on SLURM cluster.

Has this been resolved yet? Or is there something else we could try?

Cheers,

James

Maliheh Fakhar · Post by **Maliheh Fakhar** » Sun Nov 12, 2023 6:29 pm

I have the same issue and force reprocessing gets me back to the same SLURM cluster. In the short window I had between "looking for a server" and "queued on the SLURM cluster", I pressed "see what the servers are working on" and they were all marked as "waiting for a proof of life" or something similar!
I wonder if something is wrong with the servers or if I'm doing it wrong.
I appreciate it if someone could respond.
Bests.

Queued on SLURM cluster

Queued on SLURM cluster

Re: Queued on SLURM cluster

Re: Queued on SLURM cluster

Re: Queued on SLURM cluster

Re: Queued on SLURM cluster

Re: Queued on SLURM cluster