Advanced search

Message boards : Server and website : Why are Downloads So Slow

Author Message
Profile bcavnaugh
Send message
Joined: 8 Nov 13
Posts: 40
Credit: 346,426,230
RAC: 100,592
Level
Asp
Scientific publications
watwatwatwatwatwatwat
Message 44368 - Posted: 1 Sep 2016 | 3:07:24 UTC

It seems that for a 2.5MB taking 20 minutes do download is a little odd.
It downloads at 138KBps for 2% Stops and waits then another 2%.
What is going on? as this has been going on all year now.
Thanks
____________
Crunching@EVGA The Number One Team in the BOINC Community.
Folding@EVGA The Number One Team in the Folding@Home Community.

Profile caffeineyellow5
Avatar
Send message
Joined: 30 Jul 14
Posts: 225
Credit: 2,658,976,345
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwat
Message 44371 - Posted: 1 Sep 2016 | 9:14:18 UTC - in response to Message 44368.

This has happened a few times over the past few days and is not a normal thing for the year or for the servers. If this has been happening to you all year it may be on your end. Tasks take about 3 minutes at most to normally download for me and about 8-10 minutes to upload at most. Only the past few days since the ADRIA OPEN and CLOSED tasks were on high failure rate did the servers start to stutter for up and downloads. In the case where they do that stutter, they need to time out and restart. None have been slow and stuttering the way you describe moving 2% at a time or not needing a timeout to restart.
____________
1 Corinthians 9:16 "For though I preach the gospel, I have nothing to glory of: for necessity is laid upon me; yea, woe is unto me, if I preach not the gospel!"
Ephesians 6:18-20, please ;-)
http://tbc-pa.org

Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1073
Credit: 4,496,456,504
RAC: 414,796
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 44374 - Posted: 1 Sep 2016 | 14:26:26 UTC - in response to Message 44368.
Last modified: 1 Sep 2016 | 14:28:06 UTC

It seems that for a 2.5MB taking 20 minutes do download is a little odd. It downloads at 138KBps for 2% Stops and waits then another 2%.

This pausing while downloading has also been happening here for a long long time. I have to start BOINC from the command line to manage this phenomenon:

boinc.exe" --pers_retry_delay_max 60

Also in the cc_config I have to have the line:

<http_transfer_timeout>60</http_transfer_timeout>

Only then will downloads complete in around 10 minutes. This "stuttering" happens with no other projects and never happens with any other downloads of any kind. The ever increasing in size uploads are also slow but do not "stutter". The UL slowness is due to low bandwidth caused by the predatory monopoly ISP that's the only choice in this area (centurylink).

Predatory monopolies run by the tax avoiding billionaire bunch that control them, the corrupt politicians that they own and the sheeple via the media. Gotta love it. Where's a new Teddy Roosevelt when you need him? Oh yeah, Bernie got blindsided (by the above)...

The whole DL/UL slowness is kind of frustrating as for instance I've had many WUs in the last day complete in under 24 hours yet by the time the DL/UL time is added in they miss the 1 day bonus deadline.

Killersocke
Send message
Joined: 18 Oct 13
Posts: 41
Credit: 134,973,970
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwat
Message 44577 - Posted: 24 Sep 2016 | 19:08:45 UTC

Oups,
got 2 in 1 WU ?

Task 15301276
WU 11735257
Name e13s1_e6s23p0f367-GERARD_CXCL12VOLKYMON_44978491_2-0-1-RND0489_0

Task 15301271
WU 11735253
Name e13s19_e2s15p0f128-GERARD_CXCL12VOLKYMON_4181455_2-0-1-RND8767_0

On my PC WU 11735257 is a Ghost
Only the 2nd WU is really crunching on my PC

Log View:
24-Sep-2016 20:37:11 [GPUGRID] Temporarily failed download of e13s19_e2s15p0f128-GERARD_CXCL12VOLKYMON_4181455_2-0-pdb_file: transient HTTP error
24-Sep-2016 20:37:11 [GPUGRID] Backing off 00:02:38 on download of e13s19_e2s15p0f128-GERARD_CXCL12VOLKYMON_4181455_2-0-pdb_file
24-Sep-2016 20:37:12 [---] Project communication failed: attempting access to reference site

24-Sep-2016 20:38:03 [GPUGRID] Finished upload of e11s9_e2s20p0f405-GERARD_CXCL12VOLKYDIM_69492022_2-0-1-RND0090_0_9
24-Sep-2016 20:38:05 [GPUGRID] Sending scheduler request: To report completed tasks.
24-Sep-2016 20:38:05 [GPUGRID] Reporting 1 completed tasks
24-Sep-2016 20:38:05 [GPUGRID] Not requesting tasks: some download is stalled
24-Sep-2016 20:38:06 [GPUGRID] Scheduler request completed
24-Sep-2016 20:38:32 [GPUGRID] Started download of e13s19_e2s15p0f128-GERARD_CXCL12VOLKYMON_4181455_2-0-pdb_file
24-Sep-2016 20:38:41 [GPUGRID] Finished download of e13s19_e2s15p0f128-GERARD_CXCL12VOLKYMON_4181455_2-0-pdb_file

----------

Profile bcavnaugh
Send message
Joined: 8 Nov 13
Posts: 40
Credit: 346,426,230
RAC: 100,592
Level
Asp
Scientific publications
watwatwatwatwatwatwat
Message 44978 - Posted: 28 Oct 2016 | 17:36:03 UTC - in response to Message 44374.
Last modified: 28 Oct 2016 | 17:56:28 UTC

It seems that for a 2.5MB taking 20 minutes do download is a little odd. It downloads at 138KBps for 2% Stops and waits then another 2%.

This pausing while downloading has also been happening here for a long long time. I have to start BOINC from the command line to manage this phenomenon:

boinc.exe" --pers_retry_delay_max 60

Also in the cc_config I have to have the line:

<http_transfer_timeout>60</http_transfer_timeout>

Only then will downloads complete in around 10 minutes. This "stuttering" happens with no other projects and never happens with any other downloads of any kind. The ever increasing in size uploads are also slow but do not "stutter". The UL slowness is due to low bandwidth caused by the predatory monopoly ISP that's the only choice in this area (centurylink).

Predatory monopolies run by the tax avoiding billionaire bunch that control them, the corrupt politicians that they own and the sheeple via the media. Gotta love it. Where's a new Teddy Roosevelt when you need him? Oh yeah, Bernie got blindsided (by the above)...

The whole DL/UL slowness is kind of frustrating as for instance I've had many WUs in the last day complete in under 24 hours yet by the time the DL/UL time is added in they miss the 1 day bonus deadline.


I understand this but what I do not understand is when at download stops a new task starts and even delay the first one even longer and now a 3rd starting to download as yet the first is still not completed.
It is a great Project to run as to Folding@Home but is starting to be a real frustrating Project to run.
Either we no projects or we get projects that download but you only give us half the download and are at a stand still.
____________
Crunching@EVGA The Number One Team in the BOINC Community.
Folding@EVGA The Number One Team in the Folding@Home Community.

Profile bcavnaugh
Send message
Joined: 8 Nov 13
Posts: 40
Credit: 346,426,230
RAC: 100,592
Level
Asp
Scientific publications
watwatwatwatwatwatwat
Message 44995 - Posted: 29 Oct 2016 | 2:39:08 UTC - in response to Message 44978.

It seems that for a 2.5MB taking 20 minutes do download is a little odd. It downloads at 138KBps for 2% Stops and waits then another 2%.

This pausing while downloading has also been happening here for a long long time. I have to start BOINC from the command line to manage this phenomenon:

boinc.exe" --pers_retry_delay_max 60

Also in the cc_config I have to have the line:

<http_transfer_timeout>60</http_transfer_timeout>

Only then will downloads complete in around 10 minutes. This "stuttering" happens with no other projects and never happens with any other downloads of any kind. The ever increasing in size uploads are also slow but do not "stutter". The UL slowness is due to low bandwidth caused by the predatory monopoly ISP that's the only choice in this area (centurylink).

Predatory monopolies run by the tax avoiding billionaire bunch that control them, the corrupt politicians that they own and the sheeple via the media. Gotta love it. Where's a new Teddy Roosevelt when you need him? Oh yeah, Bernie got blindsided (by the above)...

The whole DL/UL slowness is kind of frustrating as for instance I've had many WUs in the last day complete in under 24 hours yet by the time the DL/UL time is added in they miss the 1 day bonus deadline.


I understand this but what I do not understand is when at download stops a new task starts and even delay the first one even longer and now a 3rd starting to download as yet the first is still not completed.
It is a great Project to run as to Folding@Home but is starting to be a real frustrating Project to run.
Either we no projects or we get projects that download but you only give us half the download and are at a stand still.


Invalid command --pers_retry_delay_max 60
____________
Crunching@EVGA The Number One Team in the BOINC Community.
Folding@EVGA The Number One Team in the Folding@Home Community.

Profile skgiven
Volunteer moderator
Project tester
Volunteer tester
Avatar
Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,834,518,624
RAC: 292,156
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 44997 - Posted: 29 Oct 2016 | 7:53:34 UTC - in response to Message 44995.

boinc.exe --pers_retry_delay_max 60
____________
FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help

Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1073
Credit: 4,496,456,504
RAC: 414,796
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45001 - Posted: 29 Oct 2016 | 12:52:57 UTC - in response to Message 44995.

Invalid command --pers_retry_delay_max 60

As stated it's command line BOINC. For Windows (depending on your BOINC location):

"C:\Program Files\BOINC\boinc.exe" --pers_retry_delay_max 60

Profile bcavnaugh
Send message
Joined: 8 Nov 13
Posts: 40
Credit: 346,426,230
RAC: 100,592
Level
Asp
Scientific publications
watwatwatwatwatwatwat
Message 45002 - Posted: 29 Oct 2016 | 13:48:54 UTC - in response to Message 45001.
Last modified: 29 Oct 2016 | 14:27:40 UTC

Invalid command --pers_retry_delay_max 60

As stated it's command line BOINC. For Windows (depending on your BOINC location):

"C:\Program Files\BOINC\boinc.exe" --pers_retry_delay_max 60


What is this command doing? --pers_retry_delay_max 60

No Biggie and I might be dropping this project because I spend more time downloading then running tasks. It is causing WCG CPU issues with starting and stopping over and over because I cannot keep the this project running.

boinc.exe --pers_retry_delay_max 60

D:\Program Files\BOINC>boinc.exe --pers_retry_delay_max 60
29-Oct-2016 08:08:49 Another instance of BOINC is running.
GLE: Cannot create a file when that file already exists.
(0xb7)

Have to exit and start over. the command does not work a shortcut.
So this means I would be running without a client tool.
No Client Interface no point for me, But thanks anyway
I cannot take it out of " Suspending computation - user request
" the client never comes up and the command never ends

D:\Program Files\BOINC>boinc.exe --pers_retry_delay_max 60
29-Oct-2016 08:12:02 [---] Starting BOINC client version 7.6.22 for windows_x86_64
29-Oct-2016 08:12:02 [---] log flags: file_xfer, sched_ops, task
29-Oct-2016 08:12:02 [---] Libraries: libcurl/7.45.0 OpenSSL/1.0.2d zlib/1.2.8
29-Oct-2016 08:12:02 [---] Data directory: D:\ProgramData\BOINC
29-Oct-2016 08:12:02 [---] Running under account User
29-Oct-2016 08:12:03 [---] CUDA: NVIDIA GPU 0: GeForce GTX 1080 (driver version 373.06, CUDA version 8.0, compute capabi
lity 6.1, 4096MB, 3044MB available, 8876 GFLOPS peak)
29-Oct-2016 08:12:03 [---] CUDA: NVIDIA GPU 1: GeForce GTX 1080 (driver version 373.06, CUDA version 8.0, compute capabi
lity 6.1, 4096MB, 3044MB available, 8876 GFLOPS peak)
29-Oct-2016 08:12:03 [---] OpenCL: NVIDIA GPU 0: GeForce GTX 1080 (driver version 373.06, device version OpenCL 1.2 CUDA
, 8192MB, 3044MB available, 8876 GFLOPS peak)
29-Oct-2016 08:12:03 [---] OpenCL: NVIDIA GPU 1: GeForce GTX 1080 (driver version 373.06, device version OpenCL 1.2 CUDA
, 8192MB, 3044MB available, 8876 GFLOPS peak)
29-Oct-2016 08:12:03 [---] Host name: BoincFolder
29-Oct-2016 08:12:03 [---] Processor: 56 GenuineIntel Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz [Family 6 Model 79 Stepp
ing 1]
29-Oct-2016 08:12:03 [---] Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 c
lflush dts acpi mmx fxsr sse sse2 ss htt tm pni ssse3 fma cx16 sse4_1 sse4_2 movebe popcnt aes f16c rdrandsyscall nx lm
avx avx2 vmx smx tm2 dca pbe fsgsbase bmi1 hle smep bmi2
29-Oct-2016 08:12:03 [---] OS: Microsoft Windows Server 2012 R2: Standard x64 Edition, (06.03.9600.00)
29-Oct-2016 08:12:03 [---] Memory: 95.78 GB physical, 111.41 GB virtual
29-Oct-2016 08:12:03 [---] Disk: 217.08 GB total, 192.21 GB free
29-Oct-2016 08:12:03 [---] Local time is UTC -6 hours
29-Oct-2016 08:12:03 [---] VirtualBox version: 5.0.26
29-Oct-2016 08:12:03 [ATLAS@home] Found app_config.xml
29-Oct-2016 08:12:03 [Collatz Conjecture] Found app_config.xml
29-Oct-2016 08:12:03 [Einstein@Home] Found app_config.xml
29-Oct-2016 08:12:03 [GPUGRID] Found app_config.xml
29-Oct-2016 08:12:03 [Milkyway@Home] Found app_config.xml
29-Oct-2016 08:12:03 [Moo! Wrapper] Found app_config.xml
29-Oct-2016 08:12:03 [Poem@Home] Found app_config.xml
29-Oct-2016 08:12:03 [PrimeGrid] Found app_config.xml
29-Oct-2016 08:12:03 [SETI@home] Found app_config.xml
29-Oct-2016 08:12:03 [---] Config: report completed tasks immediately
29-Oct-2016 08:12:03 [ATLAS@home] URL http://atlasathome.cern.ch/; Computer ID 58530; resource share 100
29-Oct-2016 08:12:03 [Citizen Science Grid] URL http://csgrid.org/csg/; Computer ID 41771; resource share 100
29-Oct-2016 08:12:03 [Collatz Conjecture] URL https://boinc.thesonntags.com/collatz/; Computer ID 804980; resource share
100
29-Oct-2016 08:12:03 [Cosmology@Home] URL http://www.cosmologyathome.org/; Computer ID 292623; resource share 100
29-Oct-2016 08:12:03 [Einstein@Home] URL http://einstein.phys.uwm.edu/; Computer ID 12437501; resource share 100
29-Oct-2016 08:12:03 [Enigma@Home] URL http://www.enigmaathome.net/; Computer ID 196959; resource share 100
29-Oct-2016 08:12:03 [GoofyxGrid@Home] URL http://goofyxgridathome.net/; Computer ID 62406; resource share 100
29-Oct-2016 08:12:03 [GPUGRID] URL http://www.gpugrid.net/; Computer ID 379625; resource share 100
29-Oct-2016 08:12:03 [Leiden Classical] URL http://boinc.gorlaeus.net/; Computer ID 143583; resource share 100
29-Oct-2016 08:12:03 [LHC@home 1.0] URL https://lhcathome.cern.ch/lhcathome/; Computer ID 10403113; resource share 100
29-Oct-2016 08:12:03 [Milkyway@Home] URL http://milkyway.cs.rpi.edu/milkyway/; Computer ID 705518; resource share 100
29-Oct-2016 08:12:03 [Moo! Wrapper] URL http://moowrap.net/; Computer ID 651416; resource share 100
29-Oct-2016 08:12:03 [NumberFields@home] URL http://numberfields.asu.edu/NumberFields/; Computer ID 33087; resource shar
e 100
29-Oct-2016 08:12:03 [Poem@Home] URL http://boinc.fzk.de/poem/; Computer ID 1793658; resource share 100
29-Oct-2016 08:12:03 [pogs] URL http://pogs.theskynet.org/pogs/; Computer ID 743647; resource share 100
29-Oct-2016 08:12:03 [PrimeGrid] URL http://www.primegrid.com/; Computer ID 524550; resource share 100
29-Oct-2016 08:12:03 [rosetta@home] URL http://boinc.bakerlab.org/rosetta/; Computer ID 3112116; resource share 100
29-Oct-2016 08:12:03 [SETI@home] URL http://setiathome.berkeley.edu/; Computer ID 8105972; resource share 100
29-Oct-2016 08:12:03 [SRBase] URL http://srbase.my-firewall.org/sr5/; Computer ID 6978; resource share 100
29-Oct-2016 08:12:03 [vdwnumbers.org: Van Der Waerden Numbers] URL http://www.vdwnumbers.org/; Computer ID 4366; resourc
e share 100
29-Oct-2016 08:12:03 [VGTU project@Home] URL http://boinc.vgtu.lt/vtuathome/; Computer ID 12442; resource share 100
29-Oct-2016 08:12:03 [VirtualLHC@home] URL http://lhcathome2.cern.ch/vLHCathome/; Computer ID 98681; resource share 100
29-Oct-2016 08:12:03 [World Community Grid] URL http://www.worldcommunitygrid.org/; Computer ID 3660300; resource share
100
29-Oct-2016 08:12:03 [WUProp@Home] URL http://wuprop.boinc-af.org/; Computer ID 122164; resource share 100
29-Oct-2016 08:12:03 [World Community Grid] General prefs: from World Community Grid (last modified 26-Oct-2016 08:38:16
)
29-Oct-2016 08:12:03 [World Community Grid] Computer location: work
29-Oct-2016 08:12:03 [---] General prefs: using separate prefs for work
29-Oct-2016 08:12:03 [---] Reading preferences override file
29-Oct-2016 08:12:03 [---] Preferences:
29-Oct-2016 08:12:03 [---] max memory usage when active: 88274.08MB
29-Oct-2016 08:12:03 [---] max memory usage when idle: 93178.19MB
29-Oct-2016 08:12:03 [---] max disk usage: 187.60GB
29-Oct-2016 08:12:04 [---] max CPUs used: 46
29-Oct-2016 08:12:04 [---] (to change preferences, visit a project web site or select Preferences in the Manager)
29-Oct-2016 08:12:04 Initialization completed
29-Oct-2016 08:12:04 [---] Suspending computation - user request
29-Oct-2016 08:13:09 [GoofyxGrid@Home] Sending scheduler request: Requested by project.
29-Oct-2016 08:13:09 [GoofyxGrid@Home] Not requesting tasks
29-Oct-2016 08:13:11 [GoofyxGrid@Home] Scheduler request completed
____________
Crunching@EVGA The Number One Team in the BOINC Community.
Folding@EVGA The Number One Team in the Folding@Home Community.

Profile bcavnaugh
Send message
Joined: 8 Nov 13
Posts: 40
Credit: 346,426,230
RAC: 100,592
Level
Asp
Scientific publications
watwatwatwatwatwatwat
Message 45004 - Posted: 29 Oct 2016 | 14:33:22 UTC

Retrying now it sits on This computer has reached a limit on tasks in progress


D:\Program Files\BOINC>boinc.exe --pers_retry_delay_max 60
29-Oct-2016 08:35:38 [---] Starting BOINC client version 7.6.22 for windows_x86_64
29-Oct-2016 08:35:38 [---] log flags: file_xfer, sched_ops, task
29-Oct-2016 08:35:38 [---] Libraries: libcurl/7.45.0 OpenSSL/1.0.2d zlib/1.2.8
29-Oct-2016 08:35:38 [---] Data directory: D:\ProgramData\BOINC
29-Oct-2016 08:35:38 [---] Running under account User
29-Oct-2016 08:35:39 [---] CUDA: NVIDIA GPU 0: GeForce GTX 1080 (driver version 373.06, CUDA version 8.0, compute capabi
lity 6.1, 4096MB, 3044MB available, 8876 GFLOPS peak)
29-Oct-2016 08:35:39 [---] CUDA: NVIDIA GPU 1: GeForce GTX 1080 (driver version 373.06, CUDA version 8.0, compute capabi
lity 6.1, 4096MB, 3044MB available, 8876 GFLOPS peak)
29-Oct-2016 08:35:39 [---] OpenCL: NVIDIA GPU 0: GeForce GTX 1080 (driver version 373.06, device version OpenCL 1.2 CUDA
, 8192MB, 3044MB available, 8876 GFLOPS peak)
29-Oct-2016 08:35:39 [---] OpenCL: NVIDIA GPU 1: GeForce GTX 1080 (driver version 373.06, device version OpenCL 1.2 CUDA
, 8192MB, 3044MB available, 8876 GFLOPS peak)
29-Oct-2016 08:35:39 [---] Host name: BoincFolder
29-Oct-2016 08:35:39 [---] Processor: 56 GenuineIntel Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz [Family 6 Model 79 Stepp
ing 1]
29-Oct-2016 08:35:39 [---] Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 c
lflush dts acpi mmx fxsr sse sse2 ss htt tm pni ssse3 fma cx16 sse4_1 sse4_2 movebe popcnt aes f16c rdrandsyscall nx lm
avx avx2 vmx smx tm2 dca pbe fsgsbase bmi1 hle smep bmi2
29-Oct-2016 08:35:39 [---] OS: Microsoft Windows Server 2012 R2: Standard x64 Edition, (06.03.9600.00)
29-Oct-2016 08:35:39 [---] Memory: 95.78 GB physical, 111.41 GB virtual
29-Oct-2016 08:35:39 [---] Disk: 217.08 GB total, 192.64 GB free
29-Oct-2016 08:35:39 [---] Local time is UTC -6 hours
29-Oct-2016 08:35:39 [---] VirtualBox version: 5.0.26
29-Oct-2016 08:35:39 [ATLAS@home] Found app_config.xml
29-Oct-2016 08:35:39 [Collatz Conjecture] Found app_config.xml
29-Oct-2016 08:35:39 [Einstein@Home] Found app_config.xml
29-Oct-2016 08:35:39 [GPUGRID] Found app_config.xml
29-Oct-2016 08:35:39 [Milkyway@Home] Found app_config.xml
29-Oct-2016 08:35:39 [Moo! Wrapper] Found app_config.xml
29-Oct-2016 08:35:39 [Poem@Home] Found app_config.xml
29-Oct-2016 08:35:39 [PrimeGrid] Found app_config.xml
29-Oct-2016 08:35:39 [SETI@home] Found app_config.xml
29-Oct-2016 08:35:39 [---] Config: report completed tasks immediately
29-Oct-2016 08:35:39 [ATLAS@home] URL http://atlasathome.cern.ch/; Computer ID 58530; resource share 100
29-Oct-2016 08:35:39 [Citizen Science Grid] URL http://csgrid.org/csg/; Computer ID 41771; resource share 100
29-Oct-2016 08:35:39 [Collatz Conjecture] URL https://boinc.thesonntags.com/collatz/; Computer ID 804980; resource share
100
29-Oct-2016 08:35:39 [Cosmology@Home] URL http://www.cosmologyathome.org/; Computer ID 292623; resource share 100
29-Oct-2016 08:35:39 [Einstein@Home] URL http://einstein.phys.uwm.edu/; Computer ID 12437501; resource share 100
29-Oct-2016 08:35:39 [Enigma@Home] URL http://www.enigmaathome.net/; Computer ID 196959; resource share 100
29-Oct-2016 08:35:39 [GoofyxGrid@Home] URL http://goofyxgridathome.net/; Computer ID 62406; resource share 100
29-Oct-2016 08:35:39 [GPUGRID] URL http://www.gpugrid.net/; Computer ID 379625; resource share 100
29-Oct-2016 08:35:39 [Leiden Classical] URL http://boinc.gorlaeus.net/; Computer ID 143583; resource share 100
29-Oct-2016 08:35:39 [LHC@home 1.0] URL https://lhcathome.cern.ch/lhcathome/; Computer ID 10403113; resource share 100
29-Oct-2016 08:35:39 [Milkyway@Home] URL http://milkyway.cs.rpi.edu/milkyway/; Computer ID 705518; resource share 100
29-Oct-2016 08:35:39 [Moo! Wrapper] URL http://moowrap.net/; Computer ID 651416; resource share 100
29-Oct-2016 08:35:39 [NumberFields@home] URL http://numberfields.asu.edu/NumberFields/; Computer ID 33087; resource shar
e 100
29-Oct-2016 08:35:39 [Poem@Home] URL http://boinc.fzk.de/poem/; Computer ID 1793658; resource share 100
29-Oct-2016 08:35:39 [pogs] URL http://pogs.theskynet.org/pogs/; Computer ID 743647; resource share 100
29-Oct-2016 08:35:39 [PrimeGrid] URL http://www.primegrid.com/; Computer ID 524550; resource share 100
29-Oct-2016 08:35:39 [rosetta@home] URL http://boinc.bakerlab.org/rosetta/; Computer ID 3112116; resource share 100
29-Oct-2016 08:35:39 [SETI@home] URL http://setiathome.berkeley.edu/; Computer ID 8105972; resource share 100
29-Oct-2016 08:35:39 [SRBase] URL http://srbase.my-firewall.org/sr5/; Computer ID 6978; resource share 100
29-Oct-2016 08:35:39 [vdwnumbers.org: Van Der Waerden Numbers] URL http://www.vdwnumbers.org/; Computer ID 4366; resourc
e share 100
29-Oct-2016 08:35:39 [VGTU project@Home] URL http://boinc.vgtu.lt/vtuathome/; Computer ID 12442; resource share 100
29-Oct-2016 08:35:39 [VirtualLHC@home] URL http://lhcathome2.cern.ch/vLHCathome/; Computer ID 98681; resource share 100
29-Oct-2016 08:35:39 [World Community Grid] URL http://www.worldcommunitygrid.org/; Computer ID 3660300; resource share
100
29-Oct-2016 08:35:39 [WUProp@Home] URL http://wuprop.boinc-af.org/; Computer ID 122164; resource share 100
29-Oct-2016 08:35:39 [World Community Grid] General prefs: from World Community Grid (last modified 26-Oct-2016 08:38:16
)
29-Oct-2016 08:35:39 [World Community Grid] Computer location: work
29-Oct-2016 08:35:39 [---] General prefs: using separate prefs for work
29-Oct-2016 08:35:39 [---] Reading preferences override file
29-Oct-2016 08:35:39 [---] Preferences:
29-Oct-2016 08:35:39 [---] max memory usage when active: 88274.08MB
29-Oct-2016 08:35:39 [---] max memory usage when idle: 93178.19MB
29-Oct-2016 08:35:39 [---] max disk usage: 187.60GB
29-Oct-2016 08:35:39 [---] max CPUs used: 46
29-Oct-2016 08:35:39 [---] (to change preferences, visit a project web site or select Preferences in the Manager)
29-Oct-2016 08:35:39 Initialization completed
29-Oct-2016 08:35:39 [GPUGRID] Started download of e19s7_e18s6p0f8-SDOERR_CASP0X_crystal_ss_5ns_a3D_0-0-psf_file
29-Oct-2016 08:35:39 [GPUGRID] Started download of e24s6_e19s7p0f8-SDOERR_CASP0X_crystal_contacts_1ns_ntl9_0-0-pdb_file
29-Oct-2016 08:35:40 [GPUGRID] Sending scheduler request: To fetch work.
29-Oct-2016 08:35:40 [GPUGRID] Requesting new tasks for NVIDIA GPU
29-Oct-2016 08:35:43 [GPUGRID] Scheduler request completed: got 0 new tasks
29-Oct-2016 08:35:43 [GPUGRID] No tasks sent
29-Oct-2016 08:35:43 [GPUGRID] This computer has reached a limit on tasks in progress

____________
Crunching@EVGA The Number One Team in the BOINC Community.
Folding@EVGA The Number One Team in the Folding@Home Community.

Profile bcavnaugh
Send message
Joined: 8 Nov 13
Posts: 40
Credit: 346,426,230
RAC: 100,592
Level
Asp
Scientific publications
watwatwatwatwatwatwat
Message 45005 - Posted: 29 Oct 2016 | 14:40:51 UTC
Last modified: 29 Oct 2016 | 14:49:01 UTC

Thanks for tying to help me out but it seem to still have download issues and I cannot manage any other BOINC projects in this mode nor can I make changes and so on without a Client Interface. If I had a system that ONLY ran this Project then maybe it would be worth looking more in to the Command Line way of Running BOINC but that for me is not an easy task to learn.

I did somewhat get this to all work and even have the BOINC Manager run but the downloads still stop and start so even this trick is not working.


Maybe GPUGrid will re-review the download issues or maybe that is how they want it I do not know as they are not saying.
____________
Crunching@EVGA The Number One Team in the BOINC Community.
Folding@EVGA The Number One Team in the Folding@Home Community.

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 1844
Credit: 10,627,187,944
RAC: 9,830,358
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45011 - Posted: 29 Oct 2016 | 18:05:01 UTC

Perhaps this download issue will be less frustrating when the Pascal app will be assigned to the long queue also, as the long tasks take 4-8-12 hours to finish. This is probably long enough to complete the download of the next task, even if it gets halted a couple of times.
Besides, the very short tasks we have now result in frequent requests to the scheduler, apparently causing network traffic issues for some users (especially those who have otherwise substandard internet connection, and/or located geographically far from Barcelona)

Richard Haselgrove
Send message
Joined: 11 Jul 09
Posts: 788
Credit: 1,422,060,845
RAC: 1,410,932
Level
Met
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45015 - Posted: 29 Oct 2016 | 18:44:13 UTC - in response to Message 45011.

Perhaps this download issue will be less frustrating when the Pascal app will be assigned to the long queue also, as the long tasks take 4-8-12 hours to finish. This is probably long enough to complete the download of the next task, even if it gets halted a couple of times.
Besides, the very short tasks we have now result in frequent requests to the scheduler, apparently causing network traffic issues for some users (especially those who have otherwise substandard internet connection, and/or located geographically far from Barcelona)

The tasks were even shorter when they errored out immediately ;-)

I've seen fewer stalled downloads since we got the Pascal app running.

Profile bcavnaugh
Send message
Joined: 8 Nov 13
Posts: 40
Credit: 346,426,230
RAC: 100,592
Level
Asp
Scientific publications
watwatwatwatwatwatwat
Message 45017 - Posted: 29 Oct 2016 | 19:09:34 UTC - in response to Message 45011.
Last modified: 29 Oct 2016 | 19:12:42 UTC

Perhaps this download issue will be less frustrating when the Pascal app will be assigned to the long queue also, as the long tasks take 4-8-12 hours to finish. This is probably long enough to complete the download of the next task, even if it gets halted a couple of times.
Besides, the very short tasks we have now result in frequent requests to the scheduler, apparently causing network traffic issues for some users (especially those who have otherwise substandard internet connection, and/or located geographically far from Barcelona)


Well I think it would be even longer as it will not download a new task until the old task is completed and uploaded from what I have been watching the few days. Because the File Size are Larger than the Short Runs I see it being even worse.
The bad part is when it stop other projects from running and playing the Waiting to run game.
I do prefer the long tasks over the short one, I only ran the Short for this Beta Testing on the Pascal Cards.
____________
Crunching@EVGA The Number One Team in the BOINC Community.
Folding@EVGA The Number One Team in the Folding@Home Community.

Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1073
Credit: 4,496,456,504
RAC: 414,796
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45020 - Posted: 29 Oct 2016 | 20:10:34 UTC - in response to Message 45002.

As stated it's command line BOINC. For Windows (depending on your BOINC location):

"C:\Program Files\BOINC\boinc.exe" --pers_retry_delay_max 60

What is this command doing? --pers_retry_delay_max 60

It's telling the client to only back off a maximum of 60 seconds on the stalled DL, otherwise sometimes it will not retry for hours. Going less than 60 seconds gave me erratic results.

As far as the GUI, you can make a shortcut to start the commandline client, THEN start the GUI. Better yet use BoincTasks and you'll really be able to see and control your clients.

Profile bcavnaugh
Send message
Joined: 8 Nov 13
Posts: 40
Credit: 346,426,230
RAC: 100,592
Level
Asp
Scientific publications
watwatwatwatwatwatwat
Message 45022 - Posted: 29 Oct 2016 | 20:28:17 UTC - in response to Message 45020.

As stated it's command line BOINC. For Windows (depending on your BOINC location):

"C:\Program Files\BOINC\boinc.exe" --pers_retry_delay_max 60

What is this command doing? --pers_retry_delay_max 60

It's telling the client to only back off a maximum of 60 seconds on the stalled DL, otherwise sometimes it will not retry for hours. Going less than 60 seconds gave me erratic results.

As far as the GUI, you can make a shortcut to start the commandline client, THEN start the GUI. Better yet use BoincTasks and you'll really be able to see and control your clients.


Cool,

It gave my MacAfee erratic results as well.
____________
Crunching@EVGA The Number One Team in the BOINC Community.
Folding@EVGA The Number One Team in the Folding@Home Community.

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 1844
Credit: 10,627,187,944
RAC: 9,830,358
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45023 - Posted: 29 Oct 2016 | 20:30:34 UTC - in response to Message 45015.
Last modified: 29 Oct 2016 | 20:30:54 UTC

The tasks were even shorter when they errored out immediately ;-)

Yes, but those hosts got their daily quota reduced, and it (hopefully) made the BOINC manager to try less often.

I've seen fewer stalled downloads since we got the Pascal app running.

Me too, and the error rate on the server status page is also shows significantly more green (=lower, below 25%) numbers.

Stefan
Volunteer moderator
Project developer
Project scientist
Send message
Joined: 5 Mar 13
Posts: 258
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 45061 - Posted: 31 Oct 2016 | 9:00:54 UTC

As I said in the other thread we are trying to look into the downloading problem. Once I have some news I'll update you. Sorry for the inconvenience.

Profile bcavnaugh
Send message
Joined: 8 Nov 13
Posts: 40
Credit: 346,426,230
RAC: 100,592
Level
Asp
Scientific publications
watwatwatwatwatwatwat
Message 45418 - Posted: 28 Nov 2016 | 19:31:20 UTC - in response to Message 45061.

As I said in the other thread we are trying to look into the downloading problem. Once I have some news I'll update you. Sorry for the inconvenience.


Stefan thank you for looking into this.
It has been 30 days now and still no change.
____________
Crunching@EVGA The Number One Team in the BOINC Community.
Folding@EVGA The Number One Team in the Folding@Home Community.

gianni
Send message
Joined: 11 Jul 08
Posts: 16
Credit: 105,098
RAC: 0
Level

Scientific publications
watwatwat
Message 45427 - Posted: 29 Nov 2016 | 8:45:19 UTC - in response to Message 45418.

What is the situation with the downloads? Please keep reporting if you have problems and better if you can quantify them.

We have contacted the network admin but they find no issues, so we need to be able to show it.

gdf

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 1844
Credit: 10,627,187,944
RAC: 9,830,358
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45465 - Posted: 1 Dec 2016 | 0:07:17 UTC - in response to Message 45427.

The server status page is still loads halfway, then stops for a while, then completes.

Toni
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 9 Dec 08
Posts: 591
Credit: 4,273,184
RAC: 0
Level
Ala
Scientific publications
watwatwatwat
Message 45522 - Posted: 2 Dec 2016 | 8:49:05 UTC - in response to Message 45465.

We tweaked some web and db parameters, let's see if anything improves.

Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1073
Credit: 4,496,456,504
RAC: 414,796
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45557 - Posted: 3 Dec 2016 | 3:27:39 UTC - in response to Message 45465.

The server status page is still loads halfway, then stops for a while, then completes.

Toni (re: Zoltan's post), the tweaks didn't help (sadly). Also, downloading WUs is the worst it's ever been.

Toni
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 9 Dec 08
Posts: 591
Credit: 4,273,184
RAC: 0
Level
Ala
Scientific publications
watwatwatwat
Message 45574 - Posted: 3 Dec 2016 | 18:52:30 UTC - in response to Message 45557.

Yes, those download speeds are hard to explain. It has become a long thread in the news. I am inclined to think that they are suffering from the same problem as before, probably not related to the server itself, now aggravated by the increased traffic due to 1 day of stop.

T

Erich56
Send message
Joined: 1 Jan 15
Posts: 371
Credit: 1,670,144,977
RAC: 2,991,705
Level
His
Scientific publications
watwatwat
Message 45578 - Posted: 3 Dec 2016 | 19:29:35 UTC - in response to Message 45465.

The server status page is still loads halfway, then stops for a while, then completes.

any solution for this to be expected soon?

WPrion
Send message
Joined: 30 Apr 13
Posts: 56
Credit: 593,748,219
RAC: 817,988
Level
Lys
Scientific publications
watwatwatwatwatwatwatwat
Message 45587 - Posted: 4 Dec 2016 | 14:33:21 UTC
Last modified: 4 Dec 2016 | 14:58:32 UTC

I've read many posts on this issue but I'm sure I've missed a lot, so my apologies in advance if this is a dumb or repeat question.

Is the slow download issue experienced from within the GPUGRID local area network? I mean, don't the GPUGRID folks have some PCs/Workstations running BOINC/GPUGRID to crunch WUs? Are any of these PCs/Workstations connected directly to the same local area network of GPUGRID servers? If so, what do they experience re: download hangs??

Win

Jim1348
Send message
Joined: 28 Jul 12
Posts: 460
Credit: 1,130,761,180
RAC: 18,722
Level
Met
Scientific publications
watwatwatwatwatwatwatwatwat
Message 45589 - Posted: 4 Dec 2016 | 16:02:10 UTC - in response to Message 45587.
Last modified: 4 Dec 2016 | 16:14:51 UTC

Is the slow download issue experienced from within the GPUGRID local area network?

The problem is not seen within Spain, but appears to be with their connections to the outside world, as Richard Haselgrove reports see #45570).
http://www.gpugrid.net/forum_thread.php?id=4442&nowrap=true#45570

klepel
Send message
Joined: 23 Dec 09
Posts: 136
Credit: 1,829,755,020
RAC: 1,443,951
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45597 - Posted: 5 Dec 2016 | 15:15:37 UTC

Just like to inform, the problem with stalled downloads still exists for me after the server up-grade.

Profile skgiven
Volunteer moderator
Project tester
Volunteer tester
Avatar
Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,834,518,624
RAC: 292,156
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45606 - Posted: 6 Dec 2016 | 20:12:56 UTC - in response to Message 45574.

Yes, those download speeds are hard to explain. It has become a long thread in the news. I am inclined to think that they are suffering from the same problem as before, probably not related to the server itself, now aggravated by the increased traffic due to 1 day of stop.

T


Toni, did you upgrade the NAS storage as well, or just the server?
____________
FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help

Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1073
Credit: 4,496,456,504
RAC: 414,796
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45609 - Posted: 7 Dec 2016 | 7:40:52 UTC - in response to Message 45574.

Yes, those download speeds are hard to explain. It has become a long thread in the news. I am inclined to think that they are suffering from the same problem as before, probably not related to the server itself, now aggravated by the increased traffic due to 1 day of stop.

T

Now there's hardly any work moving up or down and the DL stalling is worse than its ever been.

Rich
Send message
Joined: 27 Nov 14
Posts: 1
Credit: 571,451,681
RAC: 443,242
Level
Lys
Scientific publications
watwatwat
Message 45623 - Posted: 8 Dec 2016 | 17:32:07 UTC

I haven't had any problems uploading the results to the server but downloads are the worst I have ever seen. Almost everyone is stalling, like the packet has been lost and it sits there waiting to time out. Most of the time it takes 3 or more retries before completing it. While trying to disable and then re-enable the network communications it took over a dozen times before one file was downloaded. Then the next file the same thing. I understand not having work units to process but the downloading problem, well that is another story.

Profile caffeineyellow5
Avatar
Send message
Joined: 30 Jul 14
Posts: 225
Credit: 2,658,976,345
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwat
Message 45632 - Posted: 8 Dec 2016 | 21:51:57 UTC

I think there is value looking into the "inside Spain vs outside Spain" angle. Many of these traceroutes have an increase in ping time starting when the connection gets from some ISP or backbone to the Spanish ISP or backbone. Also the user who reports no issues at all is the one inside Spain. I would be interested in seeing if the internal network computers running alpha, beta, regular, or testing units are seeing any issues like we are seeing. I would also be interested in seeing if any of the students or members of staff (etc) have PCs at home in Spain that could test the "inside Spain" theory for us outside of the local network. And perhaps it is the ISP within Spain that is just not good at the handoff to other ISPs through the backbones or some filtering method being used on the Spanish ISP networks for packet capture and analyzation. I would think that would more prevalent in places like Turkey, China, and Pakistan where it is a known issue that the government is tracking all the traffic in and out of the country to censor it, but maybe Spain has something in place that does something for some reason having this effect on our connections to the project???

I also do see different sounding reports from users within the same country, but on different ISPs or areas of that country. Some Comcast users in remote areas seeing increased issues than Comcast users in populated ares, but still reporting the issues are only with this project. I would wonder if some of those with the worst download and upload issues are also getting a greater number of failed tasks due to files that had dropped packets and seemed complete, but had some issue that caused the failures.

I will try the traceroute and downloading that file in both Firefox and BitCommet to see if there is any difference, failures, or interruptive delays.

One added thing I will add as an observation though is the increased reports of tasks that are listed for machines that do not have those tasks. I have one that has a delivery date of today on it to a computer that does not have that task on it. http://www.gpugrid.net/workunit.php?wuid=12186647 I wonder if this and the connection issue is also related, as a "tried to send" issue that one side (server) thinks it was sent and received while the other side (client) knows it got no such WU?
____________
1 Corinthians 9:16 "For though I preach the gospel, I have nothing to glory of: for necessity is laid upon me; yea, woe is unto me, if I preach not the gospel!"
Ephesians 6:18-20, please ;-)
http://tbc-pa.org

CodeRedDewd
Send message
Joined: 11 Nov 09
Posts: 27
Credit: 4,523,174
RAC: 53,825
Level
Ala
Scientific publications
watwatwatwat
Message 45647 - Posted: 10 Dec 2016 | 2:44:28 UTC

Everyone is saying it's the speed, but it's not my case in the US. I download fairly quickly....maybe 300KBps, then it totally stops after a few seconds. It's so bad that I can't even keep the work going. The downloads get exponentially longer retries then project backoff.

Another question... Why can I connect to a speed test website in Barcelona to check my speed and download several Megs? Hmmm

CodeRedDewd
Send message
Joined: 11 Nov 09
Posts: 27
Credit: 4,523,174
RAC: 53,825
Level
Ala
Scientific publications
watwatwatwat
Message 45648 - Posted: 10 Dec 2016 | 2:52:25 UTC - in response to Message 45632.

I think there is value looking into the "inside Spain vs outside Spain" angle. Many of these traceroutes have an increase in ping time starting when the connection gets from some ISP or backbone to the Spanish ISP or backbone. Also the user who reports no issues at all is the one inside Spain. I would be interested in seeing if the internal network computers running alpha, beta, regular, or testing units are seeing any issues like we are seeing. I would also be interested in seeing if any of the students or members of staff (etc) have PCs at home in Spain that could test the "inside Spain" theory for us outside of the local network. And perhaps it is the ISP within Spain that is just not good at the handoff to other ISPs through the backbones or some filtering method being used on the Spanish ISP networks for packet capture and analyzation. I would think that would more prevalent in places like Turkey, China, and Pakistan where it is a known issue that the government is tracking all the traffic in and out of the country to censor it, but maybe Spain has something in place that does something for some reason having this effect on our connections to the project???

I also do see different sounding reports from users within the same country, but on different ISPs or areas of that country. Some Comcast users in remote areas seeing increased issues than Comcast users in populated ares, but still reporting the issues are only with this project. I would wonder if some of those with the worst download and upload issues are also getting a greater number of failed tasks due to files that had dropped packets and seemed complete, but had some issue that caused the failures.

I will try the traceroute and downloading that file in both Firefox and BitCommet to see if there is any difference, failures, or interruptive delays.

One added thing I will add as an observation though is the increased reports of tasks that are listed for machines that do not have those tasks. I have one that has a delivery date of today on it to a computer that does not have that task on it. http://www.gpugrid.net/workunit.php?wuid=12186647 I wonder if this and the connection issue is also related, as a "tried to send" issue that one side (server) thinks it was sent and received while the other side (client) knows it got no such WU?



Why is it that I can connect to the Speedtest.net server in Barcelona, a few of them, and get 8.7Mbps that takes several seconds to measure, so it must be a larger file than most I would get from the project server. My ping is 222ms. The test seems to go well without interruption. Is this testing anything relevant?

Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1073
Credit: 4,496,456,504
RAC: 414,796
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45654 - Posted: 10 Dec 2016 | 15:57:07 UTC - in response to Message 45647.
Last modified: 10 Dec 2016 | 16:03:43 UTC

Everyone is saying it's the speed, but it's not my case in the US. I download fairly quickly....maybe 300KBps, then it totally stops after a few seconds. It's so bad that I can't even keep the work going. The downloads get exponentially longer retries then project backoff.

Not sure who everyone is, but if they're saying that it's the speed they're wrong. It's not the speed. Personally I think the server is misconfigured. It's interesting that the stalling got much worse when the new server was installed. Hint, hint...

The 3rd post in this thread has some tips that will help a little by reducing the timeout between retries and the transfer timeout:

https://www.gpugrid.net/forum_thread.php?id=4373&nowrap=true#44374

Also, for those who have been saying it's due to high traffic volume. It's not. Even when there's hardly any work available (so barely any UL/DL going on) the stalling is just as bad when we do happen to receive a WU. And again: uploads are not affected, only downloads.

WPrion
Send message
Joined: 30 Apr 13
Posts: 56
Credit: 593,748,219
RAC: 817,988
Level
Lys
Scientific publications
watwatwatwatwatwatwatwat
Message 45762 - Posted: 16 Dec 2016 | 22:39:35 UTC

Jeebus! I have a download that is as of this writing stuck for 4.5 hours - and still clocking!! That's a record for me. Usually the stuck downloads clear out in not more than 1.5-2 hours.

Win

Profile caffeineyellow5
Avatar
Send message
Joined: 30 Jul 14
Posts: 225
Credit: 2,658,976,345
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwat
Message 45764 - Posted: 16 Dec 2016 | 23:25:48 UTC - in response to Message 45762.

I have a download that is as of this writing stuck for 4.5 hours - and still clocking!! That's a record for me. Usually the stuck downloads clear out in not more than 1.5-2 hours.

In the line
<http_transfer_timeout></http_transfer_timeout>
inside the cc_config.xml file which is located (on a Win7/8/10 machine) in the C:\ProgramData\BOINC folder, change the value to 60. That will decrease the amount of time before it determines a timeout, then will try a new connection continuing from the same point in the file. That SHOULD help some of the time length you are seeing there.
____________
1 Corinthians 9:16 "For though I preach the gospel, I have nothing to glory of: for necessity is laid upon me; yea, woe is unto me, if I preach not the gospel!"
Ephesians 6:18-20, please ;-)
http://tbc-pa.org

WPrion
Send message
Joined: 30 Apr 13
Posts: 56
Credit: 593,748,219
RAC: 817,988
Level
Lys
Scientific publications
watwatwatwatwatwatwatwat
Message 45770 - Posted: 17 Dec 2016 | 3:42:48 UTC - in response to Message 45764.
Last modified: 17 Dec 2016 | 3:45:32 UTC


In the line
<http_transfer_timeout></http_transfer_timeout>
inside the cc_config.xml file which is located (on a Win7/8/10 machine) in the C:\ProgramData\BOINC folder, change the value to 60.


I already have that parameter and it is set to 45. Would 60 be an improvement?

While the first hang was in progress, a second WU came in and downloaded "normally", around an hour or so. The slow WU finished downloading after about 5 hours.

OBTW - I now have something I haven't seen in a while - two long runs running concurrently ;-) Yaaaa!!

Thanks

Profile caffeineyellow5
Avatar
Send message
Joined: 30 Jul 14
Posts: 225
Credit: 2,658,976,345
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwat
Message 45774 - Posted: 17 Dec 2016 | 11:00:32 UTC - in response to Message 45770.

I already have that parameter and it is set to 45. Would 60 be an improvement?

From what I have read here, yes, it would be. Apparently anything under 60 has results that are rather unpredictable to counter-productive. 60 seconds is apparently the lowest amount you can enter that will actually be consistently accurate at its set amount.
a second WU came in and downloaded "normally", around an hour or so.

I am not sure I am reading that correctly. Are you saying that to download a WU it normally takes you an hour just to download it? My downloads are usually less than 5 minutes for a WU and that is with a 60 second hang or two on a file or two. Sometimes it can be as long as 7-10 minutes to download if there are several 60 second hangs. Uploads can take at most 20 minutes, but are usually around 10-12 minutes. If a download of a single WU took an hour for me, I would think there was something severely wrong with something.

When the download is actually moving, what speed registers? I get between 300 and 1000 KBps. I find that the faster it registers, the more likely it is to hang. I once did an experiment by self regulating the speed at which BOINC can download to 250 KBps and it didn't hang on any WU downloads at all for that whole week. For the larger files, it was better to have them not hang, but for the smaller files, it ended up taking longer overall for the whole WU. But for an hour to download, that is quite over the top excessive according to my results in good and in bad connection times. So I hope I am reading it incorrectly and you are just saying that after an hour of the other one hanging excessively, this new one downloaded fast.

Let us know. You may have other issues yet to be dealt with or maybe you are just on a dial up modem and we are expecting broadband results from everyone in this day and age. ???

WPrion
Send message
Joined: 30 Apr 13
Posts: 56
Credit: 593,748,219
RAC: 817,988
Level
Lys
Scientific publications
watwatwatwatwatwatwatwat
Message 45775 - Posted: 17 Dec 2016 | 13:08:24 UTC - in response to Message 45774.

Sometimes they download as you described. Sometimes one file downloads continuously but very slowly - a few bytes at a time - for around an hour. Yesterday's 5 hour dl was a one-off.

Jesse Viviano
Send message
Joined: 9 Jan 15
Posts: 8
Credit: 60,467,787
RAC: 157,161
Level
Thr
Scientific publications
wat
Message 45782 - Posted: 18 Dec 2016 | 4:00:01 UTC

Has anyone tried increasing the network interface controller's number of receive buffers to the maximum? I am located in the USA, and I noticed that downloads from LHC@home in Switzerland to me sped up from kilobytes per second to near instant downloads when I bumped up the number of transmit and receive buffers from their default numbers to my NIC's maximum of 2048 buffers for both transmit and receive. Also, access to this website (which is in Spain) seemed vastly improved. Could it be that the default number of receive buffers your NIC is set to use be insufficient for efficient long distance communication over the Internet? It could be that our NICs are dropping packets due to not having enough buffers which forces timeouts and retransmissions, and increasing the number of buffers mitigates the problem. See http://www.intel.com/content/www/us/en/support/network-and-i-o/ethernet-products/000005593.html for some documentation on Intel NICs regarding this setting.

Profile skgiven
Volunteer moderator
Project tester
Volunteer tester
Avatar
Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,834,518,624
RAC: 292,156
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45783 - Posted: 18 Dec 2016 | 12:46:24 UTC - in response to Message 45782.

Given the limited info I have to go on, this download issue is an internal network problem at their end but probably beyond the control of the research group. It's probably not the server (replaced). More likely to be a mapped IP to mac address on a L2 switch or router, bad pointer record or something obtuse like insufficient memory in a router, bandwidth caps or just old backbone kit.
Boinc missed an opportunity to integrate with/replicate distributed sharing many years ago, but a lot of good suggestions were never implemented. I wouldn't mind another UK GPUGrid cruncher being able to download an encrypted GPUGrid file from my system, or even for some files to backup to my system. 5 or 10 unpaid people developing in their spare time for dozens of new projects/year and probably over a million users doesn't make much sense to me.
____________
FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help

Jesse Viviano
Send message
Joined: 9 Jan 15
Posts: 8
Credit: 60,467,787
RAC: 157,161
Level
Thr
Scientific publications
wat
Message 45787 - Posted: 18 Dec 2016 | 19:05:55 UTC - in response to Message 45782.

In my previous message, I should have written "Have any of the users tried increasing their network interface controllers' number of receive buffers to the maximum number allowed by their drivers?" instead of "Has anyone tried increasing the network interface controller's number of receive buffers to the maximum?".

Profile caffeineyellow5
Avatar
Send message
Joined: 30 Jul 14
Posts: 225
Credit: 2,658,976,345
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwat
Message 45791 - Posted: 19 Dec 2016 | 6:53:06 UTC - in response to Message 45787.

In my previous message, I should have written "Have any of the users tried increasing their network interface controllers' number of receive buffers to the maximum number allowed by their drivers?" instead of "Has anyone tried increasing the network interface controller's number of receive buffers to the maximum?".

I changed the Transmit buffers and the Receive Buffers on the laptop to see if it makes a difference. Worth a try.

Profile caffeineyellow5
Avatar
Send message
Joined: 30 Jul 14
Posts: 225
Credit: 2,658,976,345
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwat
Message 45793 - Posted: 19 Dec 2016 | 19:55:58 UTC - in response to Message 45791.

I just got a Gerrard Long on my laptop and watched it download completely in less than 30 seconds! It is running now. Hmmmmmmm.......

Stefan
Volunteer moderator
Project developer
Project scientist
Send message
Joined: 5 Mar 13
Posts: 258
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 45809 - Posted: 21 Dec 2016 | 9:57:57 UTC

Don't worry, it's not just you. This issue is driving us all nuts. We have a publication which depends on us providing a stable webserver and it's not even possible to get that... I have no clue what's going on but it's beyong my control.

Profile Zarck
Send message
Joined: 16 Aug 08
Posts: 135
Credit: 238,817,093
RAC: 11,429
Level
Leu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45828 - Posted: 22 Dec 2016 | 0:56:53 UTC

Solution ?

http://www.ybrikman.com/writing/2014/04/14/got-fast-download-but-slow-upload/

@+
*_*

Peter Ingham
Send message
Joined: 24 Jun 09
Posts: 2
Credit: 9,398,720
RAC: 0
Level
Ser
Scientific publications
watwatwatwatwatwat
Message 45847 - Posted: 22 Dec 2016 | 21:43:23 UTC - in response to Message 44995.

I also had errors with the stated command line. Boinc 7.6.33 x64

Got it to work with:

"C:\Program Files\BOINC\boincmgr.exe" /b "--pers_retry_delay_max 60"

Peter Ingham
Send message
Joined: 24 Jun 09
Posts: 2
Credit: 9,398,720
RAC: 0
Level
Ser
Scientific publications
watwatwatwatwatwat
Message 45849 - Posted: 22 Dec 2016 | 21:49:31 UTC - in response to Message 45809.
Last modified: 22 Dec 2016 | 22:24:52 UTC

Over the last few days, this has got REALLY bad for me.

One download was at about 1MB after 2 days (default parameters).

Not seeing any packet loss with a ping test.

Coming from New Zealand, I have high latency (350ms) which might be contributing if the cause of the problem in that the throughput is initially perceived as too low and triggering the timeout condition.

Hangup is usually occurring after 2-3 seconds of transfer activity.

I have now made changes to the suggested parameters (even more aggressive than suggested - 30sec timeout, 60 sec max retry) and now getting approx 2KB per second, average.

Another guess as to the cause: TCP "Slow start" or flow control parameters??

As my requests come from a static IP address, this may be helpful in diagnosing the problem.

Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1073
Credit: 4,496,456,504
RAC: 414,796
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45870 - Posted: 23 Dec 2016 | 17:15:43 UTC - in response to Message 45847.

I also had errors with the stated command line. Boinc 7.6.33 x64

Got it to work with:

"C:\Program Files\BOINC\boincmgr.exe" /b "--pers_retry_delay_max 60"

That's because you were trying to start boincmgr.exe instead of boinc.exe. In your case the Windows shortcut would contain:

"C:\Program Files\BOINC\boinc.exe" --pers_retry_delay_max 60

Tomas Brada
Send message
Joined: 3 Nov 15
Posts: 37
Credit: 1,934,925
RAC: 293
Level
Ala
Scientific publications
wat
Message 45889 - Posted: 24 Dec 2016 | 10:21:27 UTC

There are too many threads about this problem that it is hard to decide where to post, but here are most replies.

The downloads are slow even here on telecom.sk . The trick with suspending and resuming network helps: download speed approaches my wifi speed but in few seconds drops to 10kBs^-1.
I noticed in Wiresharsk that the TCP connection is degraded to data-ack. There are tons of duplicate Acks. Incoming packet size is rock stable at 1420 bytes.

What amazes me that the files are transferred without compression! The files are plain text with decimal encoded numbers and lot's of whitespace (visible in wireshark). Why not use gzip/deflate on it?

Here is my traceroute. The last duplicated lines look very suspicious to me.

traceroute to 84.89.134.145 (84.89.134.145), 30 hops max, 60 byte packets
1 192.168.0.1 (192.168.0.1) 2.416 ms 3.636 ms 4.878 ms
2 st-static-bckb-189.213-81-234.telecom.sk (213.81.234.189) 7.483 ms 10.608 ms 11.073 ms
3 st-static-bckb-165.213-81-237.telecom.sk (213.81.237.165) 17.225 ms 17.328 ms 17.434 ms
4 st-static-srk97.87-197-196.telecom.sk (87.197.196.97) 23.263 ms 28.461 ms 30.906 ms
5 80.156.160.98 (80.156.160.98) 30.904 ms 31.256 ms 31.588 ms
6 ae-1-3101.bar1.Madrid2.Level3.net (4.69.210.222) 72.930 ms 56.966 ms 53.664 ms
7 * ae-1-3101.bar1.Madrid2.Level3.net (4.69.210.222) 57.905 ms 61.126 ms
8 213.242.113.78 (213.242.113.78) 58.332 ms 57.116 ms 59.481 ms
9 TELMAD.AE4.uv.rt1.val.red.rediris.es (130.206.245.89) 61.419 ms 63.012 ms 63.987 ms
10 anella-val1-router.red.rediris.es (130.206.211.70) 70.758 ms 71.479 ms 74.027 ms
11 * * *
12 grosso.upf.edu (84.89.134.145) 67.483 ms 65.117 ms 67.104 ms
13 grosso.upf.edu (84.89.134.145) 68.139 ms 69.536 ms 68.875 ms
14 grosso.upf.edu (84.89.134.145) 69.612 ms !X 67.994 ms !X 71.975 ms !X


And traceoute to another host on your net:
traceroute to 84.89.134.149 (84.89.134.149), 30 hops max, 60 byte packets
1 192.168.0.1 (192.168.0.1) 2.383 ms 2.414 ms 2.758 ms
2 st-static-bckb-189.213-81-234.telecom.sk (213.81.234.189) 7.282 ms 8.930 ms 9.332 ms
3 st-static-bckb-165.213-81-237.telecom.sk (213.81.237.165) 12.443 ms 12.806 ms 13.816 ms
4 st-static-srk22.87-197-198.telecom.sk (87.197.198.22) 21.475 ms 21.942 ms 22.798 ms
5 80.156.160.98 (80.156.160.98) 20.297 ms 20.648 ms 22.916 ms
6 ae-1-3101.bar1.Madrid2.Level3.net (4.69.210.222) 68.372 ms 57.487 ms 53.777 ms
7 ae-1-3101.bar1.Madrid2.Level3.net (4.69.210.222) 56.167 ms 57.161 ms 57.497 ms
8 213.242.113.78 (213.242.113.78) 54.067 ms 55.685 ms 58.480 ms
9 TELMAD.AE4.uv.rt1.val.red.rediris.es (130.206.245.89) 62.530 ms 62.889 ms 63.361 ms
10 anella-val1-router.red.rediris.es (130.206.211.70) 70.073 ms 76.882 ms 77.247 ms
11 * * *
12 capablanca.upf.edu (84.89.134.149) 59.068 ms 59.149 ms 59.735 ms
13 capablanca.upf.edu (84.89.134.149) 62.916 ms 59.670 ms 60.177 ms
14 capablanca.upf.edu (84.89.134.149) 62.880 ms !X 64.946 ms !X 65.670 ms !X



____________

Profile bcavnaugh
Send message
Joined: 8 Nov 13
Posts: 40
Credit: 346,426,230
RAC: 100,592
Level
Asp
Scientific publications
watwatwatwatwatwatwat
Message 45896 - Posted: 24 Dec 2016 | 17:13:58 UTC
Last modified: 24 Dec 2016 | 17:25:46 UTC

Can we pay for a DVD with 100 Tasks ready to load on a few computers?

It now takes over an hour for one task to download.
Turning off and On the network works for on 1%.
After 30 minutes going on and off I did get it downloaded.
____________
Crunching@EVGA The Number One Team in the BOINC Community.
Folding@EVGA The Number One Team in the Folding@Home Community.

Killersocke
Send message
Joined: 18 Oct 13
Posts: 41
Credit: 134,973,970
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwat
Message 45905 - Posted: 25 Dec 2016 | 1:31:52 UTC
Last modified: 25 Dec 2016 | 1:33:04 UTC

Dear Masters of Desaster,

I would like to crunch your WU's

But i will not waiting hours of hours for a Error-Free Download.

So i will make a breake until the problem is solved.

Merry Chrismas and a happy new Year @all

Michael
Send message
Joined: 29 Apr 16
Posts: 3
Credit: 58,158,959
RAC: 6,478
Level
Thr
Scientific publications
wat
Message 45910 - Posted: 25 Dec 2016 | 12:08:43 UTC

Same problem here, coming from Australia. It's not about speed, it's about connection being dropped. It downloads fast for about 1 or 2 seconds, and then stops.

I had to babysit a download now suspending and resuming the network activity a billion times until it downloaded. Setting for no more tasks - I'll do this one and let me GPU do something else. Or maybe nothing at all, it's pretty hot this time of year Down Under.

This has nothing to do with the users - this is purely a server or ISP configuration problem on GPUGRID's side.

Profile caffeineyellow5
Avatar
Send message
Joined: 30 Jul 14
Posts: 225
Credit: 2,658,976,345
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwat
Message 45925 - Posted: 26 Dec 2016 | 2:38:58 UTC - in response to Message 45910.
Last modified: 26 Dec 2016 | 2:43:19 UTC

This has nothing to do with the users - this is purely a server or ISP configuration problem on GPUGRID's side.

Some things on the user end have helped. Like on the Intel cards, changing the Receive Buffers and Transmit Buffers to max helps get more before it does that timeout. (I cannot figure out how to do this to my Wireless Broadcom 802.11ac Network Adapter, so my main system is still having the issue harder than my laptop now.) That are other things that help like changing the BOINC timeout setting to 60 seconds helps. But yes, the main issue is some misconfiguration at the lab, at the school, or at the ISP, or maybe even at the backbone going into Spain. There is a user inside Spain that says there is no problems for his downloads, but not much follow-up has been done asking that user to test different things for confirmation.

Bedrich Hajek
Send message
Joined: 28 Mar 09
Posts: 340
Credit: 3,819,818,009
RAC: 929,462
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45926 - Posted: 26 Dec 2016 | 4:18:08 UTC

Right now, not only am I getting slow WUs downloads on both computers, but the project web pages are loading slowly, and I have 2 ghost WU:

http://www.gpugrid.net/workunit.php?wuid=12226979

http://www.gpugrid.net/workunit.php?wuid=12226371



Profile Zarck
Send message
Joined: 16 Aug 08
Posts: 135
Credit: 238,817,093
RAC: 11,429
Level
Leu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 45930 - Posted: 26 Dec 2016 | 18:02:10 UTC
Last modified: 26 Dec 2016 | 18:03:16 UTC

Router Security problems ?

http://kb.netgear.com/000036386/CVE-2016-582384

@+
*_*
____________

[CSF] Aleksey Belkov
Avatar
Send message
Joined: 26 Dec 13
Posts: 28
Credit: 383,650,651
RAC: 541,126
Level
Asp
Scientific publications
watwatwatwatwatwat
Message 45931 - Posted: 27 Dec 2016 | 0:17:07 UTC

Maybe this dump of traffic will help your network staff in determining the problem segment of network.
I'm not an expert on TCP, but judging by the repeated transmission of the same data segments, packets acknowledging receipt of the data simply do not reach the server.
http://forum.rosesguild.com/get.php?id=lmcs9XfG9Kf-6FLcKqMe92

Alan
Send message
Joined: 22 Oct 16
Posts: 1
Credit: 12,078,450
RAC: 36,903
Level
Pro
Scientific publications
wat
Message 45933 - Posted: 27 Dec 2016 | 5:30:55 UTC

Hello.The server downloads remain very slow using Boinc on windows, Get a few seconds of fast download then download stops and need to retry download.
Thank you

Profile MJH
Project administrator
Project developer
Project scientist
Send message
Joined: 12 Nov 07
Posts: 696
Credit: 27,266,655
RAC: 0
Level
Val
Scientific publications
watwat
Message 45975 - Posted: 30 Dec 2016 | 10:26:36 UTC

I think we have this problem solved now.

Matt

Jim1348
Send message
Joined: 28 Jul 12
Posts: 460
Credit: 1,130,761,180
RAC: 18,722
Level
Met
Scientific publications
watwatwatwatwatwatwatwatwat
Message 45976 - Posted: 30 Dec 2016 | 10:30:36 UTC - in response to Message 45975.

I just downloaded one without a hitch. I think you did it.

Profile caffeineyellow5
Avatar
Send message
Joined: 30 Jul 14
Posts: 225
Credit: 2,658,976,345
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwat
Message 46031 - Posted: 1 Jan 2017 | 6:14:14 UTC - in response to Message 45975.

I think we have this problem solved now.

Matt

Care to elaborate on how? :-)
____________
1 Corinthians 9:16 "For though I preach the gospel, I have nothing to glory of: for necessity is laid upon me; yea, woe is unto me, if I preach not the gospel!"
Ephesians 6:18-20, please ;-)
http://tbc-pa.org

Tomas Brada
Send message
Joined: 3 Nov 15
Posts: 37
Credit: 1,934,925
RAC: 293
Level
Ala
Scientific publications
wat
Message 46036 - Posted: 2 Jan 2017 | 9:26:51 UTC - in response to Message 45925.

This has nothing to do with the users - this is purely a server or ISP configuration problem on GPUGRID's side.

Some things on the user end have helped. Like on the Intel cards, changing the Receive Buffers and Transmit Buffers to max helps get more before it does that timeout. (I cannot figure out how to do this to my Wireless Broadcom 802.11ac Network Adapter, so my main system is still having the issue harder than my laptop now.)

Caffeine, can you please explain how do you increase the buffer sizes? What buffers? Are they related to hardware accelerated TCP/IP? I read about TCP and learned about receive window size tunable that affects performance, so it may be it.
Note: I am just curious and know the issue was resolved server-size.

Profile caffeineyellow5
Avatar
Send message
Joined: 30 Jul 14
Posts: 225
Credit: 2,658,976,345
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwat
Message 46055 - Posted: 4 Jan 2017 | 2:05:27 UTC - in response to Message 46036.

Yes, it was discussed here and a link to the page that gives full instructions is given there.
http://www.gpugrid.net/forum_thread.php?id=4373&nowrap=true#45782

Profile cybersleauth
Send message
Joined: 30 Sep 11
Posts: 10
Credit: 119,766,724
RAC: 958
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwat
Message 46245 - Posted: 19 Jan 2017 | 21:49:18 UTC

I had very slow at end of year but now I had a screaming 350k download and no pausing. What ever they did it worked!
Hobby Website: http://www.viewcrafters.com

Post to thread

Message boards : Server and website : Why are Downloads So Slow