[VoxBo] Many vbbatch sequences in the queue

[Eduardo Europa]

What's interesting is that sometimes this behavior occurs and sometimes it doesn't. As I mentioned previously, I ran the same number and type of jobs the day after I got the error initially and was not able to generate the error again.

We were running anywhere between 11-65 simultaneous jobs, that each dispatched 1-4 (normally 3-4) vbbatch sequences. Each sequence had roughly 37 or 47 jobs.

Eddie

____________________
Eduardo Europa, B.A.
Research Assistant
EuropaEd at einstein.edu

Moss Rehabilitation Research Institute
Albert Einstein Healthcare Network
60 E. Township Line Road
Elkins Park, PA 19027
215-663-6871 (Tue)

Center for Functional Neuroimaging
Hospital at the University of Pennsylvania
3400 Spruce Street
Philadelphia, PA 19104
215-615-4764 (Mon, Wed-Fri)
>>> Daniel Kimberg <kimberg at mail.med.upenn.edu> 03/19/09 9:50 PM >>>
Eddie wrote:
> vbbatch: error telling scheduler about the new sequence

It looks like the VoxBo scheduler was getting overwhelmed with the number of requests to submit new jobs in a short period of time.  Part of this is desired behavior -- there's a limit on the number of simultaneous connections based on what I thought was reasonable normal use.  A related issue is that the scheduler handles incoming requests serially, and sometimes if the wait gets too long, some will time out before they're handled.  This is a stupid issue I've been meaning to fix for a long time, but I don't know if I'll get to it soon.  The files for the sequences that generated those error messages do stick around, and I could probably get the scheduler to pick them out and run them.  If I get a chance, I'll see if I can do that soon.  You'd still get the error message, but the jobs would run.

About how many jobs do you have that each dispatch 3-4 vbbatch sequences?  And then how many jobs are in each of those vbbatch sequences, roughly?

dan



This message is intended for the use of the person or entity to which it is addressed and may contain information that is privileged and confidential, the disclosure of which is governed by applicable law.  If you are not the intended recipient, or the employee or agent responsible to deliver it to the intended recipient, you are hereby notified that any disclosure, copying, or distribution of this information is strictly prohibited.  If you have received this message by error, please notify the sender immediately to arrange for return or destruction of these documents.