SRBase not following sub project preferences
log in

Advanced search

Message boards : Number crunching : SRBase not following sub project preferences

Author Message
Woodles
Send message
Joined: 12 Dec 14
Posts: 12
Credit: 255,908,208
RAC: 0
Message 2080 - Posted: 19 Nov 2015, 9:10:21 UTC
Last modified: 19 Nov 2015, 9:13:55 UTC

I have one of my hosts (#468) set to request only Riesel base, Riesel base short and Sierpinski / Riesel Base - average2 WUs. I also have the 'accept work from other projects if no work is available' box ticked.

Granted, two of these sub projects have no work at the moment but there are (currently) 304,270 Reisel base short WUs available.

My problem is that over the last couple of days, I have repeatedly been sent Sierpinski / Riesel Base - average3, Sierpinski / Riesel Base - average, Sierpinski / Riesel Base - long and Sierpinski Base - short WUs.

I can just about understand the Sierpinski / Riesel Base - averageN WUs being sent if the selection isn't quite specific enough but not the others.

Should I untick the 'accept work from other projects if no work is available' box or is there something else I should adjust? It's becoming a bit of a pain to continually check and abort WUs.

Profile rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 2 Jan 13
Posts: 7479
Credit: 43,686,081
RAC: 42,669
Message 2081 - Posted: 19 Nov 2015, 17:12:55 UTC - in response to Message 2080.

I have one of my hosts (#468) set to request only Riesel base, Riesel base short and Sierpinski / Riesel Base - average2 WUs. I also have the 'accept work from other projects if no work is available' box ticked.

Granted, two of these sub projects have no work at the moment but there are (currently) 304,270 Reisel base short WUs available.

My problem is that over the last couple of days, I have repeatedly been sent Sierpinski / Riesel Base - average3, Sierpinski / Riesel Base - average, Sierpinski / Riesel Base - long and Sierpinski Base - short WUs.

I can just about understand the Sierpinski / Riesel Base - averageN WUs being sent if the selection isn't quite specific enough but not the others.

Should I untick the 'accept work from other projects if no work is available' box or is there something else I should adjust? It's becoming a bit of a pain to continually check and abort WUs.


I have never tested it but all sub project WUs have the same priority. You should uncheck the work from other projects if no work is available and enable only the projects what you want to run.

Woodles
Send message
Joined: 12 Dec 14
Posts: 12
Credit: 255,908,208
RAC: 0
Message 2085 - Posted: 20 Nov 2015, 15:02:48 UTC - in response to Message 2081.
Last modified: 20 Nov 2015, 15:09:19 UTC

Hi Reb,

That's (almost) what I had. I had Reisel base short, Riesel base and Sierpinski / Riesel Base - average2 selected.

Reisel base short had work available, Riesel base and Sierpinski / Riesel Base - average2 didn't.

I had Sierpinski / Riesel Base - average3, Sierpinski / Riesel Base - average, Sierpinski / Riesel Base - long and Sierpinski Base - short all unselected.

I still got sent work for them.

Does the 'accept work from other projects' apply to each individual sub-project?

So if even one of the sub-projects I have selected has no work, I'll be sent random work from all the sub-projects regardless of whether any other of my selections have work?

If I have to uncheck a sub-project every time it runs out of work just to make sure that I get the work I selected then this project is going to take a lot of babysitting!

Profile rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 2 Jan 13
Posts: 7479
Credit: 43,686,081
RAC: 42,669
Message 2086 - Posted: 20 Nov 2015, 18:01:09 UTC - in response to Message 2085.
Last modified: 20 Nov 2015, 18:01:22 UTC

Hi Reb,

That's (almost) what I had. I had Reisel base short, Riesel base and Sierpinski / Riesel Base - average2 selected.

Reisel base short had work available, Riesel base and Sierpinski / Riesel Base - average2 didn't.

I had Sierpinski / Riesel Base - average3, Sierpinski / Riesel Base - average, Sierpinski / Riesel Base - long and Sierpinski Base - short all unselected.

I still got sent work for them.

Does the 'accept work from other projects' apply to each individual sub-project?

So if even one of the sub-projects I have selected has no work, I'll be sent random work from all the sub-projects regardless of whether any other of my selections have work?

If I have to uncheck a sub-project every time it runs out of work just to make sure that I get the work I selected then this project is going to take a lot of babysitting!


Thats how to designed, get only work for sub projects which are not selected.

Woodles
Send message
Joined: 12 Dec 14
Posts: 12
Credit: 255,908,208
RAC: 0
Message 2093 - Posted: 23 Nov 2015, 9:17:36 UTC - in response to Message 2086.
Last modified: 23 Nov 2015, 9:27:25 UTC

The selection box is labelled as "If no work for selected applications is available, accept work from other applications?"

ie. "If no work for selected applications is available ..."

I expected it to send work from other sub projects only if all the selected ones were without work.

So what you're saying is that if I select a few of the shorter sub projects (since the host goes off frequently) and any one of them doesn't have work then instead of switching to other WUs that I have selected to work on, I'll waste time crunching the longer sub projects that I have no chance of finishing?! Unless of course, I immediately change my preferences to exclude the sub project that's ran out of work! Or I could of course, only select one sub project at a time and not do any work at all when it runs out!

That might work if the sub projects had work for a decent length of time but with them changing nearly daily, it's going to mean almost hourly micro management.

Another solution would be to download a lot of work at a time and build up a stock of the work I want to do ... only SRBase sets a low limit on the amount of tasks you can stockpile.

I would like to add that I'm in no way criticising the project or the work that you've done, just trying to clarify how it works and find a way to get it to fit in with my requirements.

Profile rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 2 Jan 13
Posts: 7479
Credit: 43,686,081
RAC: 42,669
Message 2094 - Posted: 23 Nov 2015, 17:37:08 UTC - in response to Message 2093.
Last modified: 23 Nov 2015, 19:36:10 UTC

The selection box is labelled as "If no work for selected applications is available, accept work from other applications?"

ie. "If no work for selected applications is available ..."

I expected it to send work from other sub projects only if all the selected ones were without work.

So what you're saying is that if I select a few of the shorter sub projects (since the host goes off frequently) and any one of them doesn't have work then instead of switching to other WUs that I have selected to work on, I'll waste time crunching the longer sub projects that I have no chance of finishing?! Unless of course, I immediately change my preferences to exclude the sub project that's ran out of work! Or I could of course, only select one sub project at a time and not do any work at all when it runs out!

That might work if the sub projects had work for a decent length of time but with them changing nearly daily, it's going to mean almost hourly micro management.

Another solution would be to download a lot of work at a time and build up a stock of the work I want to do ... only SRBase sets a low limit on the amount of tasks you can stockpile.

I would like to add that I'm in no way criticising the project or the work that you've done, just trying to clarify how it works and find a way to get it to fit in with my requirements.


Iam trying to keep constantly work for app 1,2,3,4,7,8 (one of them). You should enable all these apps + 1 average app. The runtimes for the short up to normal apps are 43s-12min on a 3.8Ghz AVX CPU.

Woodles
Send message
Joined: 12 Dec 14
Posts: 12
Credit: 255,908,208
RAC: 0
Message 2098 - Posted: 24 Nov 2015, 9:02:32 UTC - in response to Message 2094.

Iam trying to keep constantly work for app 1,2,3,4,7,8 (one of them). You should enable all these apps + 1 average app. The runtimes for the short up to normal apps are 43s-12min on a 3.8Ghz AVX CPU.


But that's what I'm trying to say (badly!)

I had a selection of suitable WUs chosen, at least one of which always had work available but unless ALL of them had work, I got sent WUs from other sub-projects that I hadn't selected and couldn't work on.

For now, I'm only selecting one application at a time and not ticking the box. I'll stop crunching when the work for that sub-project runs out but other Boinc projects will pick up the slack until I notice. Not ideal but at least there won't be wasted work.

Profile rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 2 Jan 13
Posts: 7479
Credit: 43,686,081
RAC: 42,669
Message 2099 - Posted: 24 Nov 2015, 9:36:11 UTC - in response to Message 2080.

I have one of my hosts (#468) set to request only Riesel base, Riesel base short and Sierpinski / Riesel Base - average2 WUs. I also have the 'accept work from other projects if no work is available' box ticked.

Granted, two of these sub projects have no work at the moment but there are (currently) 304,270 Reisel base short WUs available.

My problem is that over the last couple of days, I have repeatedly been sent Sierpinski / Riesel Base - average3, Sierpinski / Riesel Base - average, Sierpinski / Riesel Base - long and Sierpinski Base - short WUs.

I can just about understand the Sierpinski / Riesel Base - averageN WUs being sent if the selection isn't quite specific enough but not the others.

Should I untick the 'accept work from other projects if no work is available' box or is there something else I should adjust? It's becoming a bit of a pain to continually check and abort WUs.


ok I see, I will enable debug logs later today to see where the problem comes from.

Woodles
Send message
Joined: 12 Dec 14
Posts: 12
Credit: 255,908,208
RAC: 0
Message 2100 - Posted: 24 Nov 2015, 13:41:32 UTC - in response to Message 2099.

ok I see, I will enable debug logs later today to see where the problem comes from.


Thanks Reb, sorry to be a nuisance.

Should I re-enable other sub-projects for your testing?

Profile rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 2 Jan 13
Posts: 7479
Credit: 43,686,081
RAC: 42,669
Message 2101 - Posted: 24 Nov 2015, 14:49:24 UTC - in response to Message 2100.

ok I see, I will enable debug logs later today to see where the problem comes from.


Thanks Reb, sorry to be a nuisance.

Should I re-enable other sub-projects for your testing?


I will test it at first by my own and let you know if I need some help to find the bug.

Profile rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 2 Jan 13
Posts: 7479
Credit: 43,686,081
RAC: 42,669
Message 2102 - Posted: 24 Nov 2015, 16:41:18 UTC

I have read all the posts again and try to figure out what is selected. So if you only select sub projects and "If no work for selected applications is available, accept work from other applications?" you will get work from non selected apps where work is available. If the last box is unselected and one sub project is enable but no work you will get no work at all, right? Or do you mean you will get also get work?

In my test I have enable "If no work for selected applications is available, accept work from other applications?" and one sub project where work is available and only getting work from this sub project. This is how it should be working. If you have the same then its ok.

Woodles
Send message
Joined: 12 Dec 14
Posts: 12
Credit: 255,908,208
RAC: 0
Message 2105 - Posted: 25 Nov 2015, 9:07:08 UTC - in response to Message 2102.
Last modified: 25 Nov 2015, 9:12:57 UTC

Hi Reb,

I have read all the posts again and try to figure out what is selected. So if you only select sub projects and "If no work for selected applications is available, accept work from other applications?" you will get work from non selected apps where work is available. If the last box is unselected and one sub project is enable but no work you will get no work at all, right? Or do you mean you will get also get work?

That's correct.

In my test I have enable "If no work for selected applications is available, accept work from other applications?" and one sub project where work is available and only getting work from this sub project. This is how it should be working. If you have the same then its ok.

That works for me too but only if the sub-project with work is the only one selected. If I also have another sub-project selected that doesn't have work then I get work from any sub-project with work.

To clarify (hopefully)

If I have just one sub-project selected which has work available then I get work for only that sub project whether I have the "accept work from other applications" option ticked or not - Correct operation.

If I have a selection of sub-projects selected that all have work then I get work for only those sub-projects whether I have the "accept work from other applications" option ticked or not - Correct operation.

If I have a selection of sub-projects selected, one or more of them don't have work available and I don't have the "accept work from other applications" option ticked then I only get work for the sub-projects that have work - Correct operation

If I have a selection of sub-projects selected, one or more of them doesn't have work available and I do have the "accept work from other applications" option ticked then I get work for any sub-projects that has work whether I've selected it or not - Incorrect operation.

It's almost as if the scheduler picks one of my selected sub-project then either sends work if there's some available for that sub-project or (if the option is selected) sends work from other sub-projects without checking to see if any other of my selected sub-project has work.

Profile rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 2 Jan 13
Posts: 7479
Credit: 43,686,081
RAC: 42,669
Message 2106 - Posted: 25 Nov 2015, 17:32:12 UTC - in response to Message 2105.
Last modified: 25 Nov 2015, 20:57:31 UTC

If I have a selection of sub-projects selected, one or more of them doesn't have work available and I do have the "accept work from other applications" option ticked then I get work for any sub-projects that has work whether I've selected it or not - Incorrect operation.


This is working for me. 2,3,4,7 selected and "If no work for selected applications is available, accept work from other applications?". Got only work for 7 and nothing else.

Can you PM me your sched_reply_srbase.myfirewall.org_sr5.xml file?

Woodles
Send message
Joined: 12 Dec 14
Posts: 12
Credit: 255,908,208
RAC: 0
Message 2112 - Posted: 26 Nov 2015, 13:38:25 UTC - in response to Message 2106.

Hi Reb,

I have been crunching just one sub-project with the box unticked so I've changed it to multiple sub-projects (some of which don't have work) and ticked the box.

All working fine so far but I'll let you know if it goes wrong again.

Thanks for looking into this.

Woodles
Send message
Joined: 12 Dec 14
Posts: 12
Credit: 255,908,208
RAC: 0
Message 2116 - Posted: 27 Nov 2015, 16:22:50 UTC - in response to Message 2112.
Last modified: 27 Nov 2015, 16:23:06 UTC

Hi Reb,

I've left it running for 24 hours and there's no incorrect WUs been sent. Looks like it's working as it should now.

I don't know what the problem was previously but it seems to have gone away. Thanks for your investigating and patience.

Profile rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 2 Jan 13
Posts: 7479
Credit: 43,686,081
RAC: 42,669
Message 2119 - Posted: 27 Nov 2015, 18:49:26 UTC - in response to Message 2116.

Hi Reb,

I've left it running for 24 hours and there's no incorrect WUs been sent. Looks like it's working as it should now.

I don't know what the problem was previously but it seems to have gone away. Thanks for your investigating and patience.


Good to hear :)

Thalus
Send message
Joined: 7 Mar 17
Posts: 34
Credit: 2,584,831
RAC: 0
Message 3352 - Posted: 27 Mar 2017, 14:16:13 UTC
Last modified: 27 Mar 2017, 14:59:33 UTC

Sorry for "grave-digging" but I got the same problem. Randomly I keep getting Sierpinski Base WUs. I enabled "get work for other applications if none of the selected are available" but still it's strange. There are definitly WUs available for "Sierpinski Base - short".
I noticed that kind of behavior a few days ago but thought I accidently checked a wrong box.
My current preferences are

Sierpinski / Riesel Base: no
Riesel Base: no
Sierpinski Base: no
Sierpinski / Riesel Base - short: no
Sierpinski / Riesel Base - long: no
Sierpinski / Riesel Base - average: yes
Riesel Base - short: yes
Sierpinski Base - short: yes
Sierpinski / Riesel Base - average2: yes
Sierpinski / Riesel Base - average3: yes
Sierpinski / Riesel Base - long2: no
Sierpinski / Riesel Base - long3: no

Last changes made ~5hrs ago, no Sierpinski Base where in cache at this point of time. Now I got 59 WUs here.

Edit:
This "erro" just occures when a bigger amount of WUs is downloaded. So after switching from, lets say, long WUsto sgort ones. A bigger amount is downloaded, here around 200, in multiple junks. After the first junk boinc thinks there are no more available and downloads some others, next junks are the "right" WUs again, next one again some I have not checked. And so on.
I guess there is no real workaround since this is some kind of error handling of boinc?

Profile rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 2 Jan 13
Posts: 7479
Credit: 43,686,081
RAC: 42,669
Message 3353 - Posted: 27 Mar 2017, 16:30:14 UTC - in response to Message 3352.

Sorry for "grave-digging" but I got the same problem. Randomly I keep getting Sierpinski Base WUs. I enabled "get work for other applications if none of the selected are available" but still it's strange. There are definitly WUs available for "Sierpinski Base - short".
I noticed that kind of behavior a few days ago but thought I accidently checked a wrong box.
My current preferences are

Sierpinski / Riesel Base: no
Riesel Base: no
Sierpinski Base: no
Sierpinski / Riesel Base - short: no
Sierpinski / Riesel Base - long: no
Sierpinski / Riesel Base - average: yes
Riesel Base - short: yes
Sierpinski Base - short: yes
Sierpinski / Riesel Base - average2: yes
Sierpinski / Riesel Base - average3: yes
Sierpinski / Riesel Base - long2: no
Sierpinski / Riesel Base - long3: no

Last changes made ~5hrs ago, no Sierpinski Base where in cache at this point of time. Now I got 59 WUs here.

Edit:
This "erro" just occures when a bigger amount of WUs is downloaded. So after switching from, lets say, long WUsto sgort ones. A bigger amount is downloaded, here around 200, in multiple junks. After the first junk boinc thinks there are no more available and downloads some others, next junks are the "right" WUs again, next one again some I have not checked. And so on.
I guess there is no real workaround since this is some kind of error handling of boinc?


There is a feeder cache defined in the config.xml of the server. This means the server is generating a certainly amount of work for every app. If a lot of hosts asking for new work for different app you will not getting anything from these apps. Iam a bit disappointed to not define Resource shares for any app to make sure to get more work from your favourite app.

Thalus
Send message
Joined: 7 Mar 17
Posts: 34
Credit: 2,584,831
RAC: 0
Message 3354 - Posted: 27 Mar 2017, 17:11:37 UTC - in response to Message 3353.

Thats kinda disappointing... I want to get work for a specifi app, but dont want to turn off the "Get anything if nothing is available for the selected" cause then it could happen, that I dont have any work at all...

Thalus
Send message
Joined: 7 Mar 17
Posts: 34
Credit: 2,584,831
RAC: 0
Message 3355 - Posted: 27 Mar 2017, 18:54:13 UTC

Still happens sometimes, randomly i get WUs i have not checked in the menu. Even tough I am just getting around 1-2 WUs each request... not what I wanted but it's ok.
Keep crunching! ;)


Post to thread

Message boards : Number crunching : SRBase not following sub project preferences


Main page · Your account · Message boards


Copyright © 2014-2024 BOINC Confederation / rebirther