Number of Tasks in Distributed Computing
in [Matlab]
|
From: Amir Homayoun on 10 Jan 2010 03:51 Hi everyone :-) I want to run more than 4 jobs at a time but I can't. My code is as following. MATLAB runs 4 job instances on the first step and afterwards it runs another one as the 5th job. sched = findResource('scheduler', 'type', 'local'); j = createJob(sched); for CountTask = 1:5 createTask(j, @Permutation, 1, {Input1 Input2}); end submit(j); waitForState(j); Result = getAllOutputArguments(j); I tried distcompdemoconfig to change the number of Maximum tasks as following distcompdemoconfig('NumTasks', 20); But still it doesn't work. When I call distcomp_helper_getDefaults, it gives me 20 for the third value, NumTasks. I wonder what I should do. Very many thanks :-) Have a good time Amir
From: Edric M Ellis on 11 Jan 2010 03:19 "Amir Homayoun " <a.h.javadi(a)gmail.com> writes: > I want to run more than 4 jobs at a time but I can't. My code is as > following. MATLAB runs 4 job instances on the first step and afterwards it > runs another one as the 5th job. > > sched = findResource('scheduler', 'type', 'local'); You should check the property "ClusterSize" for the scheduler object. If you have a 4-core machine, that defaults to 4, and that limits the number of simultaneous tasks that can be executed. You can change this value (either at the command-line, or using the Configuration Manager UI) - but running more tasks than you have cores may lead to things slowing down. Cheers, Edric.
From: Amir Homayoun on 11 Jan 2010 03:49 Dear Edric Thanks a lot for your reply. I'm afraid I couldn't manage to change it. I actually couldn't find the property "CluserSize" which you mentioned. I setup the scheduler as below. But it won't have property by the name "ClusterSize" sched = findResource('scheduler', 'type', 'local'); It would be great if you give me more clues. I'd like to be able to change these properties using command line. I didn't know that there is user interface for these setting. Thanks. I'll check it out. Now. I'm a little bit confused. What is the difference between simple Job and Parallel Job which are created by createJob and createParallelJob, respectively? My machine has 2 x Quad-Core Interl Xeon so it is 8 cores I believe. Thanks again. Have a good time, Amir Edric M Ellis <eellis(a)mathworks.com> wrote in message <ytwfx6dcaui.fsf(a)uk-eellis-deb5-64.mathworks.co.uk>... > "Amir Homayoun " <a.h.javadi(a)gmail.com> writes: > > > I want to run more than 4 jobs at a time but I can't. My code is as > > following. MATLAB runs 4 job instances on the first step and afterwards it > > runs another one as the 5th job. > > > > sched = findResource('scheduler', 'type', 'local'); > > You should check the property "ClusterSize" for the scheduler object. If you > have a 4-core machine, that defaults to 4, and that limits the number of > simultaneous tasks that can be executed. You can change this value (either at > the command-line, or using the Configuration Manager UI) - but running more > tasks than you have cores may lead to things slowing down. > > Cheers, > > Edric.
From: Edric M Ellis on 11 Jan 2010 05:52 "Amir Homayoun " <a.h.javadi(a)gmail.com> writes: > Thanks a lot for your reply. I'm afraid I couldn't manage to change it. I > actually couldn't find the property "CluserSize" which you mentioned. I setup > the scheduler as below. But it won't have property by the name "ClusterSize" > > sched = findResource('scheduler', 'type', 'local'); > > It would be great if you give me more clues. I'd like to be able to change > these properties using command line. What release of MATLAB / PCT are you using? Cheers, Edric.
From: Titus Edelhofer on 11 Jan 2010 05:58
Hi Amir, if you are using R2009a or before, you are limited to 4 workers (that's a limitation of the Parallel Computing Toolbox). If you need more than this, you will need the MATLAB Distributed Computing Server. This limit of 4 has been changed to 8 in the current release (R2009b). Titus "Amir Homayoun " <a.h.javadi(a)gmail.com> schrieb im Newsbeitrag news:hieolv$peb$1(a)fred.mathworks.com... > Dear Edric > > Thanks a lot for your reply. I'm afraid I couldn't manage to change it. I > actually couldn't find the property "CluserSize" which you mentioned. I > setup the scheduler as below. But it won't have property by the name > "ClusterSize" > > sched = findResource('scheduler', 'type', 'local'); > > It would be great if you give me more clues. I'd like to be able to change > these properties using command line. > I didn't know that there is user interface for these setting. Thanks. I'll > check it out. Now. I'm a little bit confused. What is the difference > between simple Job and Parallel Job which are created by createJob and > createParallelJob, respectively? > > My machine has 2 x Quad-Core Interl Xeon so it is 8 cores I believe. > Thanks again. > > Have a good time, > Amir > > > Edric M Ellis <eellis(a)mathworks.com> wrote in message > <ytwfx6dcaui.fsf(a)uk-eellis-deb5-64.mathworks.co.uk>... >> "Amir Homayoun " <a.h.javadi(a)gmail.com> writes: >> >> > I want to run more than 4 jobs at a time but I can't. My code is as >> > following. MATLAB runs 4 job instances on the first step and afterwards >> > it >> > runs another one as the 5th job. >> > >> > sched = findResource('scheduler', 'type', 'local'); >> >> You should check the property "ClusterSize" for the scheduler object. If >> you >> have a 4-core machine, that defaults to 4, and that limits the number of >> simultaneous tasks that can be executed. You can change this value >> (either at >> the command-line, or using the Configuration Manager UI) - but running >> more >> tasks than you have cores may lead to things slowing down. >> >> Cheers, >> >> Edric. > |