TF on GPUs works sometimes, and sometimes does nothing for hours

Author	Message
Mr P Hucker Send message Joined: 30 Sep 17 Posts: 36 Credit: 16,105,684 RAC: 5	Message 8878 - Posted: 20 May 2023, 18:36:27 UTC
I have Tahiti and Fury GPUs. They randomly finish a task in an hour, or not at all, no % GPU usage, just sit there. Not sure how long I should leave them. No CPU being used either. I'm now trying 8 at a time on the GPUs so they can work on another when one has dozed off. The cards are NOT incompatible, because I have successfully finished many tasks on them all.
ID: 8878 · Rating: 0 · rate: / Reply Quote

rebirther Volunteer moderator Project administrator Project developer Project tester Project scientist Send message Joined: 2 Jan 13 Posts: 7257 Credit: 42,729,227 RAC: 1	Message 8879 - Posted: 20 May 2023, 18:57:42 UTC - in response to Message 8878. Last modified: 20 May 2023, 19:00:41 UTC
I have Tahiti and Fury GPUs. They randomly finish a task in an hour, or not at all, no % GPU usage, just sit there. Not sure how long I should leave them. No CPU being used either. I'm now trying 8 at a time on the GPUs so they can work on another when one has dozed off. The cards are NOT incompatible, because I have successfully finished many tasks on them all. Should be a problem with multi-GPU, the app doesnt have multi-GPU support, there must be a fix somehow but dont know yet. Excluding a card doesnt help either because you have the same multi-GPU setup. Its a real BOINC client issue, need one GPU WU on every card separatily.
ID: 8879 · Rating: 0 · rate: / Reply Quote

Mr P Hucker Send message Joined: 30 Sep 17 Posts: 36 Credit: 16,105,684 RAC: 5	Message 8884 - Posted: 21 May 2023, 20:55:08 UTC - in response to Message 8879.
You have a point there, my triple GPU machines are the two failing. The others work fine, they have single GPUs. I couldn't put my finger on it because I was looking at card models instead. Is there some way you can prevent them going out to multi GPU setups? Inform the user, etc? They seem to work then mostly fail or sit idle for ages. By the way, I didn't get an email to inform me of your reply.
ID: 8884 · Rating: 0 · rate: / Reply Quote

rebirther Volunteer moderator Project administrator Project developer Project tester Project scientist Send message Joined: 2 Jan 13 Posts: 7257 Credit: 42,729,227 RAC: 1	Message 8885 - Posted: 21 May 2023, 22:28:15 UTC - in response to Message 8884.
You have a point there, my triple GPU machines are the two failing. The others work fine, they have single GPUs. I couldn't put my finger on it because I was looking at card models instead. Is there some way you can prevent them going out to multi GPU setups? Inform the user, etc? They seem to work then mostly fail or sit idle for ages. By the way, I didn't get an email to inform me of your reply. Do you have an app_config? I sent you a PM with a SPAM filter notice from your provider, you must setup your config there.
ID: 8885 · Rating: 0 · rate: / Reply Quote

Mr P Hucker Send message Joined: 30 Sep 17 Posts: 36 Credit: 16,105,684 RAC: 5	Message 8887 - Posted: 23 May 2023, 1:37:08 UTC - in response to Message 8885.
You have a point there, my triple GPU machines are the two failing. The others work fine, they have single GPUs. I couldn't put my finger on it because I was looking at card models instead. Is there some way you can prevent them going out to multi GPU setups? Inform the user, etc? They seem to work then mostly fail or sit idle for ages. By the way, I didn't get an email to inform me of your reply. Do you have an app_config? Yes I know how to use those. What are you suggesting I do with it? I sent you a PM with a SPAM filter notice from your provider, you must setup your config there. Ah, yes it does that sometimes, it's run by my ISP. But if it's turned off, I get 50 spams a day. Can you tell me the address it will be coming from please? I can simply add a whitelist exception like "microsoft.com" - for now I'll assume it's my-firewall.org (which to be fair on my ISP filter does look dodgy!)
ID: 8887 · Rating: 0 · rate: / Reply Quote

rebirther Volunteer moderator Project administrator Project developer Project tester Project scientist Send message Joined: 2 Jan 13 Posts: 7257 Credit: 42,729,227 RAC: 1	Message 8888 - Posted: 23 May 2023, 6:17:07 UTC - in response to Message 8887.
You have a point there, my triple GPU machines are the two failing. The others work fine, they have single GPUs. I couldn't put my finger on it because I was looking at card models instead. Is there some way you can prevent them going out to multi GPU setups? Inform the user, etc? They seem to work then mostly fail or sit idle for ages. By the way, I didn't get an email to inform me of your reply. Do you have an app_config? Yes I know how to use those. What are you suggesting I do with it? I sent you a PM with a SPAM filter notice from your provider, you must setup your config there. Ah, yes it does that sometimes, it's run by my ISP. But if it's turned off, I get 50 spams a day. Can you tell me the address it will be coming from please? I can simply add a whitelist exception like "microsoft.com" - for now I'll assume it's my-firewall.org (which to be fair on my ISP filter does look dodgy!) nope, srbase@outlook.de
ID: 8888 · Rating: 0 · rate: / Reply Quote

Mr P Hucker Send message Joined: 30 Sep 17 Posts: 36 Credit: 16,105,684 RAC: 5	Message 8890 - Posted: 23 May 2023, 11:47:26 UTC - in response to Message 8888.
Thanks. What were you asking earlier about my app config?
ID: 8890 · Rating: 0 · rate: / Reply Quote

rebirther Volunteer moderator Project administrator Project developer Project tester Project scientist Send message Joined: 2 Jan 13 Posts: 7257 Credit: 42,729,227 RAC: 1	Message 8891 - Posted: 23 May 2023, 11:51:44 UTC - in response to Message 8890. Last modified: 23 May 2023, 13:25:22 UTC
Thanks. What were you asking earlier about my app config? Can you post it here? You can try this... <cc_config> <options> <exclude_gpu> <url>http://srbase.my-firewall.org/sr5/</url> <type>ATI</type> <device_num>1</device_num> <device_num>2</device_num> <app>TF</app> </exclude_gpu> <use_all_gpus>1</use_all_gpus> </options> </cc_config>
ID: 8891 · Rating: 0 · rate: / Reply Quote

Mr P Hucker Send message Joined: 30 Sep 17 Posts: 36 Credit: 16,105,684 RAC: 5	Message 8893 - Posted: 24 May 2023, 10:41:15 UTC Last modified: 24 May 2023, 10:41:59 UTC
I'm confused now. Earlier you said "Excluding a card doesn't help either because you have the same multi-GPU setup", but now you are suggesting (I think) I can keep SRbase off all but one GPU and it would work?
ID: 8893 · Rating: 0 · rate: / Reply Quote

rebirther Volunteer moderator Project administrator Project developer Project tester Project scientist Send message Joined: 2 Jan 13 Posts: 7257 Credit: 42,729,227 RAC: 1	Message 8894 - Posted: 24 May 2023, 14:32:10 UTC - in response to Message 8893.
I'm confused now. Earlier you said "Excluding a card doesn't help either because you have the same multi-GPU setup", but now you are suggesting (I think) I can keep SRbase off all but one GPU and it would work? Exclude the cards is easier if its working so running only device 0 (card 1) and disable the other both for other projects.
ID: 8894 · Rating: 0 · rate: / Reply Quote

Mr P Hucker Send message Joined: 30 Sep 17 Posts: 36 Credit: 16,105,684 RAC: 5	Message 8897 - Posted: 24 May 2023, 17:15:16 UTC - in response to Message 8894.
Cool! That seems to be working. Although I changed it to: <exclude_gpu> <url>https://srbase.my-firewall.org/sr5/</url> <device_num>2</device_num> </exclude_gpu> <exclude_gpu> <url>https://srbase.my-firewall.org/sr5/</url> <device_num>1</device_num> </exclude_gpu> Because the project is attached with https, and it doesn't seem to take two device numbers in one instruction.
ID: 8897 · Rating: 0 · rate: / Reply Quote

Author

Message

Send message
Joined: 30 Sep 17
Posts: 36
Credit: 16,105,684
RAC: 5
10M in project total credit

I have Tahiti and Fury GPUs. They randomly finish a task in an hour, or not at all, no % GPU usage, just sit there. Not sure how long I should leave them. No CPU being used either. I'm now trying 8 at a time on the GPUs so they can work on another when one has dozed off. The cards are NOT incompatible, because I have successfully finished many tasks on them all.

ID: 8878 · Rating: 0 · rate:

Reply Quote

rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 2 Jan 13
Posts: 7257
Credit: 42,729,227
RAC: 1
2M in Sierpinski / Riesel Base credit

5M in Sierpinski / Riesel Base - short credit

1M in Sierpinski / Riesel Base - long credit

500k in Sierpinski / Riesel Base - average credit

I have Tahiti and Fury GPUs. They randomly finish a task in an hour, or not at all, no % GPU usage, just sit there. Not sure how long I should leave them. No CPU being used either. I'm now trying 8 at a time on the GPUs so they can work on another when one has dozed off. The cards are NOT incompatible, because I have successfully finished many tasks on them all.

Should be a problem with multi-GPU, the app doesnt have multi-GPU support, there must be a fix somehow but dont know yet. Excluding a card doesnt help either because you have the same multi-GPU setup. Its a real BOINC client issue, need one GPU WU on every card separatily.

ID: 8879 · Rating: 0 · rate:

Reply Quote

Mr P Hucker
Avatar

Send message
Joined: 30 Sep 17
Posts: 36
Credit: 16,105,684
RAC: 5
10M in project total credit

You have a point there, my triple GPU machines are the two failing. The others work fine, they have single GPUs. I couldn't put my finger on it because I was looking at card models instead.

Is there some way you can prevent them going out to multi GPU setups? Inform the user, etc? They seem to work then mostly fail or sit idle for ages.

By the way, I didn't get an email to inform me of your reply.

ID: 8884 · Rating: 0 · rate:

Reply Quote

rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 2 Jan 13
Posts: 7257
Credit: 42,729,227
RAC: 1
2M in Sierpinski / Riesel Base credit

You have a point there, my triple GPU machines are the two failing. The others work fine, they have single GPUs. I couldn't put my finger on it because I was looking at card models instead.

Is there some way you can prevent them going out to multi GPU setups? Inform the user, etc? They seem to work then mostly fail or sit idle for ages.

By the way, I didn't get an email to inform me of your reply.

Do you have an app_config?

I sent you a PM with a SPAM filter notice from your provider, you must setup your config there.

ID: 8885 · Rating: 0 · rate:

Reply Quote

Mr P Hucker
Avatar

Send message
Joined: 30 Sep 17
Posts: 36
Credit: 16,105,684
RAC: 5
10M in project total credit

You have a point there, my triple GPU machines are the two failing. The others work fine, they have single GPUs. I couldn't put my finger on it because I was looking at card models instead.

Is there some way you can prevent them going out to multi GPU setups? Inform the user, etc? They seem to work then mostly fail or sit idle for ages.

By the way, I didn't get an email to inform me of your reply.

Do you have an app_config?

Yes I know how to use those. What are you suggesting I do with it?

I sent you a PM with a SPAM filter notice from your provider, you must setup your config there.

Ah, yes it does that sometimes, it's run by my ISP. But if it's turned off, I get 50 spams a day. Can you tell me the address it will be coming from please? I can simply add a whitelist exception like "microsoft.com" - for now I'll assume it's my-firewall.org (which to be fair on my ISP filter does look dodgy!)

ID: 8887 · Rating: 0 · rate:

Reply Quote

rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 2 Jan 13
Posts: 7257
Credit: 42,729,227
RAC: 1
2M in Sierpinski / Riesel Base credit

You have a point there, my triple GPU machines are the two failing. The others work fine, they have single GPUs. I couldn't put my finger on it because I was looking at card models instead.

Is there some way you can prevent them going out to multi GPU setups? Inform the user, etc? They seem to work then mostly fail or sit idle for ages.

By the way, I didn't get an email to inform me of your reply.

Do you have an app_config?

Yes I know how to use those. What are you suggesting I do with it?

I sent you a PM with a SPAM filter notice from your provider, you must setup your config there.

Ah, yes it does that sometimes, it's run by my ISP. But if it's turned off, I get 50 spams a day. Can you tell me the address it will be coming from please? I can simply add a whitelist exception like "microsoft.com" - for now I'll assume it's my-firewall.org (which to be fair on my ISP filter does look dodgy!)

nope, srbase@outlook.de

ID: 8888 · Rating: 0 · rate:

Reply Quote

Mr P Hucker
Avatar

Send message
Joined: 30 Sep 17
Posts: 36
Credit: 16,105,684
RAC: 5
10M in project total credit

Thanks. What were you asking earlier about my app config?

ID: 8890 · Rating: 0 · rate:

Reply Quote

rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 2 Jan 13
Posts: 7257
Credit: 42,729,227
RAC: 1
2M in Sierpinski / Riesel Base credit

Thanks. What were you asking earlier about my app config?

Can you post it here?

You can try this...

<cc_config> <options> <exclude_gpu> <url>http://srbase.my-firewall.org/sr5/</url> <type>ATI</type> <device_num>1</device_num> <device_num>2</device_num> <app>TF</app> </exclude_gpu> <use_all_gpus>1</use_all_gpus> </options> </cc_config>

ID: 8891 · Rating: 0 · rate:

Reply Quote

Mr P Hucker
Avatar

Send message
Joined: 30 Sep 17
Posts: 36
Credit: 16,105,684
RAC: 5
10M in project total credit

I'm confused now. Earlier you said "Excluding a card doesn't help either because you have the same multi-GPU setup", but now you are suggesting (I think) I can keep SRbase off all but one GPU and it would work?

ID: 8893 · Rating: 0 · rate:

Reply Quote

rebirther
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 2 Jan 13
Posts: 7257
Credit: 42,729,227
RAC: 1
2M in Sierpinski / Riesel Base credit

I'm confused now. Earlier you said "Excluding a card doesn't help either because you have the same multi-GPU setup", but now you are suggesting (I think) I can keep SRbase off all but one GPU and it would work?

Exclude the cards is easier if its working so running only device 0 (card 1) and disable the other both for other projects.

ID: 8894 · Rating: 0 · rate:

Reply Quote

Mr P Hucker
Avatar

Send message
Joined: 30 Sep 17
Posts: 36
Credit: 16,105,684
RAC: 5
10M in project total credit

Cool! That seems to be working. Although I changed it to:

<exclude_gpu>
<url>https://srbase.my-firewall.org/sr5/</url>
<device_num>2</device_num>
</exclude_gpu>
<exclude_gpu>
<url>https://srbase.my-firewall.org/sr5/</url>
<device_num>1</device_num>
</exclude_gpu>

Because the project is attached with https, and it doesn't seem to take two device numbers in one instruction.

ID: 8897 · Rating: 0 · rate:

Reply Quote