Message boards : Graphics cards (GPUs) : Multiple GPU clients on device 0
| Author | Message |
|---|---|
|
I'm running v6.6.37 of the boinc software and 185.18.36 nVidia drivers. I have a machine with 6 GPU's (3x GTX295). When it starts the acemd_6.66_x86_64-pc-linux-gnu__cuda process, they all are passed the arg, '--device 0'. 3 error immediately, while 3 continue to run on GPU 0. What do I need to do to fix this? I've tried putting the use_all_gpus option in a cc_config.xml. Makes no difference. | |
ID: 12498 | Rating: 0 | rate:
 /   Reply
Quote
| |
|
Problem solved with 6.10.4. See Multi-gpu support is broken in linux. | |
| ID: 12501 | Rating: 0 | rate:
/ Reply
Quote
| |
 [AF>Libristes>Jip] Elgran... Send message Joined: 16 Jul 08 Posts: 45 Credit: 78,618,001 RAC: 0 Level  Scientific publications       | |
|
Problem solved with 6.6.40 boinc linux client too. | |
| ID: 12794 | Rating: 0 | rate:
/ Reply
Quote
| |
robertmiles  Send message Joined: 16 Apr 09 Posts: 503 Credit: 729,045,933 RAC: 46,221 Level  Scientific publications | |
Problem solved with 6.6.40 boinc linux client too. What directory should the cc_config.xml file be in for 64-bit Windows Vista, and is anything else needed to create one if none is there already? A downloadable version of one with the most common settings needed for GPUGRID could be useful. Also, which are now the best BOINC and GPU driver versions to use under Windows Vista? | |
| ID: 12804 | Rating: 0 | rate:
/ Reply
Quote
| |
|
robertmiles Send message Joined: 16 Apr 09 Posts: 503 Credit: 729,045,933 RAC: 46,221 Level Scientific publications | |
|
I found instructions for creating a cc_config.xml file for Vista in this thread, but so far without the line needed to enable use of the GPU under 6.6.36: | |
| ID: 12817 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Paul D. Buck Send message Joined: 9 Jun 08 Posts: 1050 Credit: 37,321,185 RAC: 0 Level  Scientific publications  | |
|
The "use all GPU" is only needed if you have two or more GPUs and BOINC does not "see" all of them. I forget which version occasioned the need and which where the inserted that new flag ... | |
| ID: 12818 | Rating: 0 | rate:
/ Reply
Quote
| |
|
robertmiles Send message Joined: 16 Apr 09 Posts: 503 Credit: 729,045,933 RAC: 46,221 Level Scientific publications | |
|
I need mainly the line used to enable GPU use at all, since it was apparantly created between the version I found cc_config.xml instructions for and 6.6.36. | |
| ID: 12819 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Paul D. Buck Send message Joined: 9 Jun 08 Posts: 1050 Credit: 37,321,185 RAC: 0 Level Scientific publications | |
I need mainly the line used to enable GPU use at all, since it was apparantly created between the version I found cc_config.xml instructions for and 6.6.36. There is no line that will enable GPU use, just one that will disable it. If you have a GPU and it is detected and is of the appropriate version it will show up in the start up data ... The messages are slightly different depending on the GPU but, This means no GPU found: 29-Aug-2009 02:17:15 [---] Can't load library nvcuda.dll 29-Aug-2009 02:17:15 [---] No CAL Runtime Libraries installed. 29-Aug-2009 02:17:15 [---] No coprocessors This means no Nvidia card found, but ATI card was: 29-Aug-2009 07:11:01 [---] Can't load library nvcuda.dll 29-Aug-2009 07:11:01 [---] ATI GPU 0: RV770 (CAL version , 512MB, 1232GFLOPS) And this, the 4 cores on my two GTX 295 cards: 9/14/2009 10:07:22 AM CUDA device: GeForce GTX 295 (driver version 19062, compute capability 1.3, 896MB, est. 106GFLOPS) 9/14/2009 10:07:22 AM CUDA device: GeForce GTX 295 (driver version 19062, compute capability 1.3, 896MB, est. 106GFLOPS) 9/14/2009 10:07:22 AM CUDA device: GeForce GTX 295 (driver version 19062, compute capability 1.3, 896MB, est. 106GFLOPS) 9/14/2009 10:07:22 AM CUDA device: GeForce GTX 295 (driver version 19062, compute capability 1.3, 896MB, est. 106GFLOPS) {edit - add} The messages may be slightly different in 6.10.9 and later I think they messed about a little bit there. If the BOINC Client is not seeing the card then MOST LIKELY the drivers are wrong, or you installed as a service where the GPU cannot be used ... Post the start up messages ... :) | |
| ID: 12823 | Rating: 0 | rate:
/ Reply
Quote
| |
Yes, descriptions are a tiny bit different. This is what a log looks from 6.10.9 .... (not quite sure what's going on there with driver version.) Sun 27 Sep 2009 03:19:16 AM BST NVIDIA GPU 0: GeForce GTX 295 (driver version 0, CUDA version 2020, compute capability 1.3, 895MB, est. 127GFLOPS) Sun 27 Sep 2009 03:19:16 AM BST NVIDIA GPU 1: GeForce GTX 295 (driver version 0, CUDA version 2020, compute capability 1.3, 896MB, est. 127GFLOPS) Sun 27 Sep 2009 03:19:16 AM BST NVIDIA GPU 2: GeForce GTX 295 (driver version 0, CUDA version 2020, compute capability 1.3, 896MB, est. 127GFLOPS) Sun 27 Sep 2009 03:19:16 AM BST NVIDIA GPU 3: GeForce GTX 295 (driver version 0, CUDA version 2020, compute capability 1.3, 896MB, est. 127GFLOPS) EDIT: the display driver version number is only populated on Window$. ____________ Crunching on Linux: Fedora 11 x86_64 / nVidia 185.18.36 driver / CUDA 2.2  | |
| ID: 12828 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Paul D. Buck Send message Joined: 9 Jun 08 Posts: 1050 Credit: 37,321,185 RAC: 0 Level Scientific publications | |
|
Interesting ... I take it the other was from Linux ... I guess I am going to post that because if they cannot recover the driver version number correctly in Linux they should say "Unknown" rather than zero ... or not print it at all ... | |
| ID: 12832 | Rating: 0 | rate:
/ Reply
Quote
| |
|
robertmiles Send message Joined: 16 Apr 09 Posts: 503 Credit: 729,045,933 RAC: 46,221 Level Scientific publications | |
I need mainly the line used to enable GPU use at all, since it was apparantly created between the version I found cc_config.xml instructions for and 6.6.36. WITH a local preferences file that enables GPU use: 9/25/2009 9:06:30 PM Starting BOINC client version 6.6.36 for windows_x86_64 9/25/2009 9:06:30 PM log flags: task, file_xfer, sched_ops 9/25/2009 9:06:30 PM Libraries: libcurl/7.19.4 OpenSSL/0.9.8j zlib/1.2.3 9/25/2009 9:06:30 PM Data directory: C:\ProgramData\BOINC 9/25/2009 9:06:30 PM Running under account Robert 9/25/2009 9:06:34 PM Processor: 4 GenuineIntel Intel(R) Core(TM)2 Quad CPU Q9650 @ 3.00GHz [Intel64 Family 6 Model 23 Stepping 10] 9/25/2009 9:06:34 PM Processor features: fpu tsc pae nx sse sse2 pni 9/25/2009 9:06:34 PM OS: Microsoft Windows Vista: Home Premium x64 Edition, Service Pack 2, (06.00.6002.00) 9/25/2009 9:06:34 PM Memory: 8.00 GB physical, 16.05 GB virtual 9/25/2009 9:06:34 PM Disk: 919.67 GB total, 739.27 GB free 9/25/2009 9:06:34 PM Local time is UTC -5 hours 9/25/2009 9:06:37 PM CUDA device: GeForce 9800 GT (driver version 19038, compute capability 1.1, 1024MB, est. 60GFLOPS) 9/25/2009 9:06:37 PM Not using a proxy 9/25/2009 9:06:37 PM rosetta@home URL: http://boinc.bakerlab.org/rosetta/; Computer ID: 1134208; location: home; project prefs: home 9/25/2009 9:06:37 PM boincsimap URL: http://boinc.bio.wzw.tum.de/boincsimap/; Computer ID: 154267; location: home; project prefs: home 9/25/2009 9:06:37 PM malaria URL: http://boinc.cs.uct.ac.za/malaria/; Computer ID: 4986; location: home; project prefs: default 9/25/2009 9:06:37 PM Poem@Home URL: http://boinc.fzk.de/poem/; Computer ID: 53474; location: work; project prefs: default 9/25/2009 9:06:37 PM The Lattice Project URL: http://boinc.umiacs.umd.edu/; Computer ID: 36965; location: work; project prefs: default 9/25/2009 9:06:37 PM superlinkattechnion URL: http://cbl-boinc-server2.cs.technion.ac.il/superlinkattechnion/; Computer ID: 61273; location: work; project prefs: default 9/25/2009 9:06:37 PM Docking@Home URL: http://docking.cis.udel.edu/; Computer ID: 42504; location: home; project prefs: default 9/25/2009 9:06:37 PM QMC@HOME URL: http://qah.uni-muenster.de/; Computer ID: 151350; location: work; project prefs: default 9/25/2009 9:06:37 PM ralph@home URL: http://ralph.bakerlab.org/; Computer ID: 19368; location: work; project prefs: work 9/25/2009 9:06:37 PM ibercivis URL: http://registro.ibercivis.es/; Computer ID: 110117; location: work; project prefs: default 9/25/2009 9:06:37 PM GPUGRID URL: http://www.gpugrid.net/; Computer ID: 48221; location: (none); project prefs: default 9/25/2009 9:06:37 PM malariacontrol.net URL: http://www.malariacontrol.net/; Computer ID: 132584; location: home; project prefs: home 9/25/2009 9:06:37 PM World Community Grid URL: http://www.worldcommunitygrid.org/; Computer ID: 1032086; location: work; project prefs: work 9/25/2009 9:06:37 PM World Community Grid General prefs: from World Community Grid (last modified 22-Sep-2009 07:02:14) 9/25/2009 9:06:37 PM World Community Grid Computer location: work 9/25/2009 9:06:37 PM General prefs: using separate prefs for work 9/25/2009 9:06:37 PM Reading preferences override file 9/25/2009 9:06:37 PM Preferences limit memory usage when active to 3276.16MB 9/25/2009 9:06:37 PM Preferences limit memory usage when idle to 3276.16MB 9/25/2009 9:06:37 PM Preferences limit disk usage to 30.00GB 9/25/2009 9:06:37 PM Suspending computation - user request WITHOUT the local preferences file, no GPU workunits will run. I do not have a matching set of messages for that condition. I need to be able to run without a local preferences file in order to allow certain items to vary between projects from different sites, as controlled by their different computer location settings. | |
| ID: 12843 | Rating: 0 | rate:
/ Reply
Quote
| |
|
robertmiles Send message Joined: 16 Apr 09 Posts: 503 Credit: 729,045,933 RAC: 46,221 Level Scientific publications | |
|
(duplicate; GPUGRID could use making messages just posted visible faster) | |
| ID: 12844 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Paul D. Buck Send message Joined: 9 Jun 08 Posts: 1050 Credit: 37,321,185 RAC: 0 Level Scientific publications | |
|
This message: 9/25/2009 9:06:37 PM CUDA device: GeForce 9800 GT (driver version 19038, compute capability 1.1, 1024MB, est. 60GFLOPS) Says that you have a Nvidia GPU though towards the lower end. As long as that message appears you can run GPU tasks if the tasks available match the Compute Capability and the minimum driver version. I am way behind on what the GPU Grid minimums are anymore though I have a 9800 GT and it is running work for GPU Grid though I will be retiring it soon. As far as I can see there is zero need for any flags in the CC config file as you do not have two GPUs. Is that the local preferences file you refer to? I am sorely confused ... what is the contents of that preferences file? Maybe ETA can see something I am missing... My only other suggestion is to try one or more of SaH, SaH Beta, or Collatz to see if you can get GPU work there and if it is processed correctly. But, as I said, I can see no reason why you should not be getting GPU Grid work ... | |
| ID: 12848 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Richard Haselgrove Send message Joined: 11 Jul 09 Posts: 1576 Credit: 5,979,711,851 RAC: 11,778,756 Level  Scientific publications | |
WITHOUT the local preferences file, no GPU workunits will run. I do not have a matching set of messages for that condition. As others have said, you need to be clear whether you are talking about a configuration file or a preferences file. There is no setting, in either file, which will create or enable a CUDA card if BOINC doesn't see one at normal startup. The only thing you can do is disable all cards, or force BOINC to use ALL cards (if you have several), rather than just the most powerful one. In the part of your message that I've quoted, you use the words no GPU workunits will run. That suggests that BOINC sees that the card is present, and downloads the tasks, but goes no further. If that is your situation, then it is indeed a preferences issue, but you can solve it without creating a local preferences file. Go to your computing preferences page on this website. Change the third item on the page, "Suspend GPU work while computer is in use?", to "no". Repeat for any other 'venue' preference groups you've set up. When all changes have been saved, open your local BOINC Manager, select GPUGrid on the projects tab, and click 'update'. | |
| ID: 12853 | Rating: 0 | rate:
/ Reply
Quote
| |
|
robertmiles Send message Joined: 16 Apr 09 Posts: 503 Credit: 729,045,933 RAC: 46,221 Level Scientific publications | |
WITHOUT the local preferences file, no GPU workunits will run. I do not have a matching set of messages for that condition. The part of the BOINC manager I use to create these files calls them preferences, and says they are specific to the machine they're created on. I have only one GPU card on each machine; CUDA type on each of them. When I try changing the school or work profile on that site, it tells me that I have a bad value that it's marking in red, but it doesn't mark anything in red. These preferences apply to all the BOINC projects in which you participate. Unable to update preferences. The values marked in red below were out of range or not numeric. Exception: If I fill in 3.0 for the previously blank 'In use' value, it finally accepts the change. Previously, there were already enough GPUGRID workunits downloaded that it didn't need to download any more, but it wouldn't let any of them run while there was no local preferences file. I didn't keep it in this condition long enough to see if it it would still download GPUGRID workunits if needed. Now, your method changes things enough to allow GPUGRID workunits to continue running even with no local preferences file. I'm currently draining the queue to prepare to install BOINC 6.10.3, so I have all downloads disabled for now and will have the check if GPU downloads are disabled later. Just re-enabled World Community Grid downloads long enough to see if this method is compatible with using their method of using different selections of their projects on different devices; it appears that it is, but I'll check again for BOINC 6.10.3 later. | |
| ID: 12865 | Rating: 0 | rate:
/ Reply
Quote
| |
Message boards : Graphics cards (GPUs) : Multiple GPU clients on device 0
