Advanced search

Message boards : Server and website : Problem with upload server?

Author Message
Erich56
Send message
Joined: 1 Jan 15
Posts: 371
Credit: 1,668,437,827
RAC: 2,978,537
Level
His
Scientific publications
watwatwat
Message 44323 - Posted: 29 Aug 2016 | 19:04:29 UTC

For a few hours, I've been experiencing a problem with uploading finished tasks: the upload speed which is normally between 500 and 600 KBps, now varies between 20 KBps and almost zero. The upload of about 50% of a Gianni WU (181MB size) has been running for almost 80 minutes now.

A test of my system has shown that the internet connection is okay and on full speed.

What's the problem?

Profile caffeineyellow5
Avatar
Send message
Joined: 30 Jul 14
Posts: 225
Credit: 2,658,976,345
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwat
Message 44340 - Posted: 30 Aug 2016 | 7:21:54 UTC

The uploads and downloads are probably being slowed by the bandwidth of the Adria OPEN and CLOSED tasks downloading, failing right away, then reporting failed. Bad task batches currently. Need to just wait this out until they are removed again.
____________
1 Corinthians 9:16 "For though I preach the gospel, I have nothing to glory of: for necessity is laid upon me; yea, woe is unto me, if I preach not the gospel!"
Ephesians 6:18-20, please ;-)
http://tbc-pa.org

Erich56
Send message
Joined: 1 Jan 15
Posts: 371
Credit: 1,668,437,827
RAC: 2,978,537
Level
His
Scientific publications
watwatwat
Message 44341 - Posted: 30 Aug 2016 | 9:08:40 UTC - in response to Message 44340.

The uploads and downloads are probably being slowed by the bandwidth of the Adria OPEN and CLOSED tasks downloading, failing right away, then reporting failed. Bad task batches currently. Need to just wait this out until they are removed again.

this might be the explanation. I, too, am receiving these Adria WUs on all of my hosts; no idea what they are not being removed from the server.

Erich56
Send message
Joined: 1 Jan 15
Posts: 371
Credit: 1,668,437,827
RAC: 2,978,537
Level
His
Scientific publications
watwatwat
Message 44347 - Posted: 30 Aug 2016 | 19:27:58 UTC

since this afternoon, upload speed is back to normal.

Liam
Send message
Joined: 27 Jul 14
Posts: 1
Credit: 1,457,040
RAC: 3
Level
Ala
Scientific publications
wat
Message 47851 - Posted: 6 Sep 2017 | 12:27:56 UTC
Last modified: 6 Sep 2017 | 12:31:58 UTC

Uploading a work unit, 145MiB, speed varies between 1mbit/s and 10 kilobit/sec.
In packet capture we see a lot of TCP re-transmission and duplicate ACKs (may get 90 or more in a row, one time 360?!). 450MiB of data was sent from our side, just to upload this 145MiB file.

I was thinking of writing to my ISP about their lousy connectivity to Europe, but when I looked at traceroute and ping for the server I see no evidence of loss or bandwidth saturation in the network path. e.g. while the upload was 'slow'...

$ ping -qc 50 84.89.134.145
--- 84.89.134.145 ping statistics ---
50 packets transmitted, 50 received, 0% packet loss, time 49056ms
rtt min/avg/max/mdev = 370.399/371.614/373.334/0.616 ms


Is there a problem currently at the server side, or could it be something else I have overlooked. Are others having troubles uploading WUs?

Erich56
Send message
Joined: 1 Jan 15
Posts: 371
Credit: 1,668,437,827
RAC: 2,978,537
Level
His
Scientific publications
watwatwat
Message 47883 - Posted: 16 Sep 2017 | 13:42:12 UTC

again, I see extremely slow uploads today; many times, they even pause for a while.

Is anyone else making the same experience?

Erich56
Send message
Joined: 1 Jan 15
Posts: 371
Credit: 1,668,437,827
RAC: 2,978,537
Level
His
Scientific publications
watwatwat
Message 48030 - Posted: 23 Oct 2017 | 12:39:50 UTC

I have given up my hope to ever get an answer from the GPUGRID people here :-(

But does anyone have any idea why the upload sever again does not work properly?
Today, uploads take forever :-( That's really annoying!

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 271
Credit: 1,299,282,831
RAC: 5,134,755
Level
Met
Scientific publications
watwat
Message 48033 - Posted: 23 Oct 2017 | 18:54:16 UTC - in response to Message 48030.

I have given up my hope to ever get an answer from the GPUGRID people here :-(

But does anyone have any idea why the upload sever again does not work properly?
Today, uploads take forever :-( That's really annoying!

I have not noticed slow uploads. But even if they are slow, as long as the upload doesn't take days, it doesn't really affect the flow. As long as your GPU is not idling, I don't see a problem.

Also, I don't have a problem with the GPUGrid Scientists not answering every single comment because I'd rather them concentrate on the entire reason they are doing this in the first place. To make groundbreaking scientific discoveries, and if they are answering questions on the forums every day they can't possibly be doing that.

They are low on people at the moment and don't even currently have an IT professional helping them so unfortunately we have to deal with this decrepit system at the moment.

Erich56
Send message
Joined: 1 Jan 15
Posts: 371
Credit: 1,668,437,827
RAC: 2,978,537
Level
His
Scientific publications
watwatwat
Message 48035 - Posted: 24 Oct 2017 | 6:05:32 UTC - in response to Message 48033.

Also, I don't have a problem with the GPUGrid Scientists not answering every single comment

Well, fact though is that not a single comment is answered. None at all :-(
And this can be quite frustrating for volunteers after a while.

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 271
Credit: 1,299,282,831
RAC: 5,134,755
Level
Met
Scientific publications
watwat
Message 48036 - Posted: 24 Oct 2017 | 10:42:36 UTC - in response to Message 48035.
Last modified: 24 Oct 2017 | 10:43:51 UTC

I work with scientists every day and I can tell you time is not something they have spare of. They are in meetings most of the day discussing the science at hand and when they're not in meetings they should be working. I think they should keep and eye on the server status and allow the work to always be flowing but for them to read every comment and respond is just not feasible.

Most of the questions presented by the forums are more tech related questions, suited for an IT professional. Most likely the scientists don't even know the answer to these questions.

Betting Slip
Send message
Joined: 5 Jan 09
Posts: 588
Credit: 2,036,066,275
RAC: 1,520,724
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48037 - Posted: 24 Oct 2017 | 12:05:05 UTC - in response to Message 48036.
Last modified: 24 Oct 2017 | 12:15:39 UTC

They could appoint other students as PR representatives and surely the university has access to IT students and staff.

There is no excuse really. If you take resources from contributors that amount to tens of thousands a month you owe them some communication otherwise it will be seen as complete disrespect and certainly ungrateful.

There can never be a case made for treating users that donate to your cause so badly.

Erich56
Send message
Joined: 1 Jan 15
Posts: 371
Credit: 1,668,437,827
RAC: 2,978,537
Level
His
Scientific publications
watwatwat
Message 48038 - Posted: 24 Oct 2017 | 14:24:07 UTC

As I had already written in another thread here in the forum some time ago (after having read this as a comment of one of the project administrators in the forum of another BOINC project):

Of course have happy volunteers is very important for the health of a project so this is something that should be addressed

Betting Slip
Send message
Joined: 5 Jan 09
Posts: 588
Credit: 2,036,066,275
RAC: 1,520,724
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48039 - Posted: 24 Oct 2017 | 15:49:04 UTC - in response to Message 48038.
Last modified: 24 Oct 2017 | 16:04:12 UTC

I remember that as well Erich and yet nothing happens. Only leaves me to think that those were empty words.

I'm sure there will be somebody along shortly that will have a whole list of reasons why things are like they are and promising things will change.

This project hasn't grown in active members for a long time and it's mostly 'hardcore' crunchers that have kept it viable. They must see this and yet silence which is tantamount to saying "speak to the hand"

But don't worry Admins, this thread will vanish into history as others have done and in about 6 months time another will appear and your loyal crunchers will still be here and at your disposal. Won't they?

kain
Send message
Joined: 3 Sep 14
Posts: 110
Credit: 132,491,966
RAC: 23,065
Level
Cys
Scientific publications
watwatwatwat
Message 48040 - Posted: 24 Oct 2017 | 19:37:45 UTC - in response to Message 48039.

Do we have WUs to crunch? We do. Are there new publications proving that our crunching is useful? There are.

Of course thats frustrating and to be honest - sad, that there is not even a single person to take care of PR and coding. But Spain has big problems right now, funding science is not a priority right now. We can donate five or ten k euros to the project, they should be able to hire some IT specialist for a few hours a week for let's say half of the year... Do you see where am I going?

Erich56
Send message
Joined: 1 Jan 15
Posts: 371
Credit: 1,668,437,827
RAC: 2,978,537
Level
His
Scientific publications
watwatwat
Message 48041 - Posted: 24 Oct 2017 | 19:40:26 UTC

Another uncertainty, I am afraid, now is what will happen to Universitat Pompeu Fabra in Barcelona in view of the forthcoming political developments/conflicts between Madrid and Catalonia.

Erich56
Send message
Joined: 1 Jan 15
Posts: 371
Credit: 1,668,437,827
RAC: 2,978,537
Level
His
Scientific publications
watwatwat
Message 48298 - Posted: 7 Dec 2017 | 21:24:08 UTC

Since last night, the upload server again is extremely slow. The upload speed of finished tasks is a fraction of what it normally is, sometimes it even comes to a halt. Uploads take forever.

Since this happens every once in a while, I wonder if no one at GPUGRID has ever looked into this problem.

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 1844
Credit: 10,620,014,794
RAC: 9,851,592
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48299 - Posted: 7 Dec 2017 | 21:38:18 UTC - in response to Message 48298.

Since last night, the upload server again is extremely slow. The upload speed of finished tasks is a fraction of what it normally is, sometimes it even comes to a halt. Uploads take forever.
I don't have any upload problems since last night. Usually it's only you reporting this slowness, so perhaps the error is on your ISP's side.
Try http://www.speedtest.net/; Open it with Microsoft Edge (or any flash enabled browser), and then you can select the location of the server you want to test your connection with. Practically you should select one in Barcelona. If the upload speed to those servers is slow too, then it's sure that GPUGrid has nothing to do about this.

WPrion
Send message
Joined: 30 Apr 13
Posts: 56
Credit: 593,384,169
RAC: 820,923
Level
Lys
Scientific publications
watwatwatwatwatwatwatwat
Message 48313 - Posted: 9 Dec 2017 | 4:09:13 UTC
Last modified: 9 Dec 2017 | 4:12:22 UTC

I know this thread is about uploads, but right now I have an ADRIA_FOLDCALP80 download that has periods of less than 1KBps download speed. Most files downloaded normally, but two took much longer. The last file (...pdb_file) is at 4.7% and 17 minutes....

Edited a couple of minutes later
I think a router somewhere just passed a stone. The last file download finished.

Erich56
Send message
Joined: 1 Jan 15
Posts: 371
Credit: 1,668,437,827
RAC: 2,978,537
Level
His
Scientific publications
watwatwat
Message 48334 - Posted: 11 Dec 2017 | 11:30:05 UTC - in response to Message 48299.

I don't have any upload problems since last night. Usually it's only you reporting this slowness, so perhaps the error is on your ISP's side.
Try http://www.speedtest.net/; Open it with Microsoft Edge (or any flash enabled browser), and then you can select the location of the server you want to test your connection with. Practically you should select one in Barcelona. If the upload speed to those servers is slow too, then it's sure that GPUGrid has nothing to do about this.

Thanks, Zoltan, for your hint regarding speedtest.net. So far, I've used this tool for testing my own internet connection when some problem came up once in a while.
Following your advice, from December 8th until today, I have tested the connection from here to servers in Barcelona and also the area around Barcelona numerous times.
EVERYTIME the results were between 125 and 145 Mbps for download, and between 13,5 and 15 Mbps for upload.

Which would, in theory, support my assumption that the problem of the sometimes very low upload speed has to do with the GPUGRID upload server.
Unless there are other possibilities, technical-wise, which I am not aware of (not being a network expert at all).

I think that the fact that I am the only one who reports these flaws here in the Forum does not neccessarily mean that I am the only one with this problem.
I guess many other crunchers simply may not notice it, or if they notice it, they do not care.
On the other hand, you, for example, did NOT have such problems.
No idea what's really behind this, and how it could be found out and solved.

To show the actual figures:
on my WinXP machines, the upload speed to GPUGRID normally is between 280 and 380 KBps.
On my Windows10 machines it normally is between 600 and 700 KBps.

Whenever the problem comes up, above cited speeds are reduced by 80-90%.

Post to thread

Message boards : Server and website : Problem with upload server?