Advanced search

Message boards : News : Outage resolved

Author Message
Toni
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 9 Dec 08
Posts: 913
Credit: 4,301,782
RAC: 0
Level
Ala
Scientific publications
watwatwatwat
Message 53899 - Posted: 13 Mar 2020 | 9:45:31 UTC

Before anybody wonders: yes there was an another outage last night. Thanks for the patience.

Zalster
Avatar
Send message
Joined: 26 Feb 14
Posts: 201
Credit: 4,343,484,601
RAC: 3,152,684
Level
Arg
Scientific publications
watwatwatwat
Message 53900 - Posted: 13 Mar 2020 | 11:12:15 UTC - in response to Message 53899.

NIce to have you back Toni...

Hopefully this isn't related to new volunteers was it??

Toni
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 9 Dec 08
Posts: 913
Credit: 4,301,782
RAC: 0
Level
Ala
Scientific publications
watwatwatwat
Message 53902 - Posted: 13 Mar 2020 | 11:57:48 UTC - in response to Message 53900.

It's not clear but I don't think so, because it happens suddenly. When it happens, the web server gets stuck without real load.

Pop Piasa
Avatar
Send message
Joined: 8 Aug 19
Posts: 31
Credit: 58,578,683
RAC: 819,441
Level
Thr
Scientific publications
wat
Message 53907 - Posted: 13 Mar 2020 | 14:36:40 UTC

Being a retired facilities manager, I was all ready to blame the custodial night crew for plugging in a floor buffer on the same circuit as Grosso and tripping the breaker and then forgetting to report it. Used to happen to our researchers now and then.
It's always a good excuse, anyway...😉

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 423
Credit: 379,278,158
RAC: 1,999,261
Level
Asp
Scientific publications
wat
Message 53908 - Posted: 13 Mar 2020 | 15:06:06 UTC

Wasn't just the web server. All my uploads and downloads were stalled out and backed off on all hosts. Finally cleared them this morning just now and getting new work finally.

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 423
Credit: 379,278,158
RAC: 1,999,261
Level
Asp
Scientific publications
wat
Message 53913 - Posted: 13 Mar 2020 | 20:59:04 UTC

Uploads not going through again.

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 423
Credit: 379,278,158
RAC: 1,999,261
Level
Asp
Scientific publications
wat
Message 53914 - Posted: 14 Mar 2020 | 1:41:32 UTC

GPUGRID 1u5tA02_413_1-TONI_MDADpr4su-2-10-RND2363_0_0 0.000 3.15 K 00:08:03 - 05:18:50 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1u5tA02_413_1-TONI_MDADpr4su-2-10-RND2363_0_1 0.000 276.03 K 00:08:03 - 05:13:23 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1u5tA02_413_1-TONI_MDADpr4su-2-10-RND2363_0_2 0.000 276.03 K 00:08:03 - 05:19:59 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1u5tA02_413_1-TONI_MDADpr4su-2-10-RND2363_0_8 0.000 1380.62 K 00:08:03 - 05:09:23 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1u5tA02_413_1-TONI_MDADpr4su-2-10-RND2363_0_9 0.000 472.81 K 00:08:03 - 05:21:32 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1u5tA02_413_1-TONI_MDADpr4su-2-10-RND2363_0_10 0.000 0.27 K 00:08:03 - 05:07:11 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1svmA02_413_4-TONI_MDADpr4ss-2-10-RND8253_0_0 0.000 3.18 K 00:04:00 - 03:37:11 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1svmA02_413_4-TONI_MDADpr4ss-2-10-RND8253_0_1 0.000 501.80 K 00:04:00 - 03:39:50 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1svmA02_413_4-TONI_MDADpr4ss-2-10-RND8253_0_2 0.000 501.80 K 00:04:00 - 03:37:32 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1svmA02_413_4-TONI_MDADpr4ss-2-10-RND8253_0_8 0.000 2509.49 K 00:04:00 - 03:40:32 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1svmA02_413_4-TONI_MDADpr4ss-2-10-RND8253_0_9 0.000 862.33 K 00:04:00 - 03:40:21 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1svmA02_413_4-TONI_MDADpr4ss-2-10-RND8253_0_10 0.000 0.27 K 00:04:00 - 03:39:54 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1vwxS01_450_0-TONI_MDADpr4sv-2-10-RND9020_0_0 0.000 3.18 K 00:04:01 - 02:42:02 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1vwxS01_450_0-TONI_MDADpr4sv-2-10-RND9020_0_1 0.000 411.36 K 00:04:01 - 02:39:25 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1vwxS01_450_0-TONI_MDADpr4sv-2-10-RND9020_0_2 0.000 411.36 K 00:04:01 - 02:41:56 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1vwxS01_450_0-TONI_MDADpr4sv-2-10-RND9020_0_8 0.000 2057.26 K 00:04:01 - 02:38:51 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1vwxS01_450_0-TONI_MDADpr4sv-2-10-RND9020_0_9 0.000 710.07 K 00:02:01 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1vwxS01_450_0-TONI_MDADpr4sv-2-10-RND9020_0_10 0.000 0.27 K 00:02:01 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1u2mB00_320_3-TONI_MDADpr4su-2-10-RND1264_0_0 0.000 3.14 K 00:02:00 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1u2mB00_320_3-TONI_MDADpr4su-2-10-RND1264_0_1 0.000 1590.96 K 00:02:00 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1u2mB00_320_3-TONI_MDADpr4su-2-10-RND1264_0_2 0.000 1590.96 K 00:02:00 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1u2mB00_320_3-TONI_MDADpr4su-2-10-RND1264_0_8 0.000 7955.31 K 00:02:00 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1u2mB00_320_3-TONI_MDADpr4su-2-10-RND1264_0_9 0.000 2711.64 K 00:02:00 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek
GPUGRID 1u2mB00_320_3-TONI_MDADpr4su-2-10-RND1264_0_10 0.000 0.27 K 00:02:00 0.00 Kbps Upload pending (Project backoff: 03:07:59) Pipsqueek

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 423
Credit: 379,278,158
RAC: 1,999,261
Level
Asp
Scientific publications
wat
Message 53915 - Posted: 14 Mar 2020 | 1:42:03 UTC

GPUGRID 1yg9A03_379_4-TONI_MDADpr4sy-2-pdb_file 0.000 1595.02 K 00:48:24 - 03:17:48 0.00 Kbps Download pending (Retry in: 00:02:24), retried: 24 Darksider
GPUGRID 1yg9A03_379_4-TONI_MDADpr4sy-2-par_file 0.000 178.34 K 00:44:22 - 03:17:16 0.00 Kbps Download pending (Retry in: 00:01:52), retried: 22 Darksider
GPUGRID 1ydhA00_379_3-TONI_MDADpr4sy-2-par_file 0.000 178.34 K 00:30:16 - 03:16:19 0.00 Kbps Download pending (Retry in: 00:00:55), retried: 15 Darksider

Pop Piasa
Avatar
Send message
Joined: 8 Aug 19
Posts: 31
Credit: 58,578,683
RAC: 819,441
Level
Thr
Scientific publications
wat
Message 53917 - Posted: 14 Mar 2020 | 6:05:18 UTC

@Toni ===>I seem to be having issues with more tasks showing up on the server as in progress than actually appear in my BOINC manager. I have 4 GPUs and 11 tasks in progress since the outage. I will list the unaccounted-for tasks if they persist tomorrow.

Bedrich Hajek
Send message
Joined: 28 Mar 09
Posts: 395
Credit: 5,032,906,897
RAC: 2,239,795
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 53918 - Posted: 14 Mar 2020 | 13:05:18 UTC - in response to Message 53917.

@Toni ===>I seem to be having issues with more tasks showing up on the server as in progress than actually appear in my BOINC manager. I have 4 GPUs and 11 tasks in progress since the outage. I will list the unaccounted-for tasks if they persist tomorrow.




I have a few "ghost" WUs myself right now, (3 actually), with only 4 units downloaded. See link:


http://www.gpugrid.net/results.php?hostid=263612&offset=0&show_names=0&state=1&appid=


And a grand total of 3 "ghost" computer accounts:


http://www.gpugrid.net/hosts_user.php?userid=19626





Bedrich Hajek
Send message
Joined: 28 Mar 09
Posts: 395
Credit: 5,032,906,897
RAC: 2,239,795
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 54128 - Posted: 28 Mar 2020 | 0:47:10 UTC - in response to Message 53918.
Last modified: 28 Mar 2020 | 0:48:20 UTC

@Toni ===>I seem to be having issues with more tasks showing up on the server as in progress than actually appear in my BOINC manager. I have 4 GPUs and 11 tasks in progress since the outage. I will list the unaccounted-for tasks if they persist tomorrow.




I have a few "ghost" WUs myself right now, (3 actually), with only 4 units downloaded. See link:


http://www.gpugrid.net/results.php?hostid=263612&offset=0&show_names=0&state=1&appid=


And a grand total of 3 "ghost" computer accounts:


http://www.gpugrid.net/hosts_user.php?userid=19626








As of a little more than hours, from the time I wrote this post, I had 2 active computers and 5 "ghost" computers. So, I used the merge computers by name to get the rid of the "ghosts" computers and my RAC and total credit doubled on the computer ID: 534811, see linked below. This happened by accident, not by intent.


https://www.gpugrid.net/show_host_detail.php?hostid=534811&ipprivate=1


Though it did not effect my user account RAC and total credit, which are correct.


http://www.gpugrid.net/show_user.php?userid=19626


Can this be corrected?

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 423
Credit: 379,278,158
RAC: 1,999,261
Level
Asp
Scientific publications
wat
Message 54142 - Posted: 28 Mar 2020 | 19:08:09 UTC - in response to Message 54128.

@Toni ===>I seem to be having issues with more tasks showing up on the server as in progress than actually appear in my BOINC manager. I have 4 GPUs and 11 tasks in progress since the outage. I will list the unaccounted-for tasks if they persist tomorrow.




I have a few "ghost" WUs myself right now, (3 actually), with only 4 units downloaded. See link:


http://www.gpugrid.net/results.php?hostid=263612&offset=0&show_names=0&state=1&appid=


And a grand total of 3 "ghost" computer accounts:


http://www.gpugrid.net/hosts_user.php?userid=19626








As of a little more than hours, from the time I wrote this post, I had 2 active computers and 5 "ghost" computers. So, I used the merge computers by name to get the rid of the "ghosts" computers and my RAC and total credit doubled on the computer ID: 534811, see linked below. This happened by accident, not by intent.


https://www.gpugrid.net/show_host_detail.php?hostid=534811&ipprivate=1


Though it did not effect my user account RAC and total credit, which are correct.


http://www.gpugrid.net/show_user.php?userid=19626


Can this be corrected?

No as far as I know, it can't. That number comes from the servers and you don't have the ability to modify. The server just glitched.

This same thing happened to one of my teammates (juan BFP) when he merged a host and he suddenly picked up almost a billion credits. Didn't affect the host RAC or any other adverse effect than instantly catapult him to the top of the total credits leaderboard. He just says the "the servers liked him"
https://stats.free-dc.org/stats.php?page=hosts&proj=sah&sort=today

admin
Send message
Joined: 9 Mar 12
Posts: 1
Credit: 2,393,032
RAC: 114,065
Level
Ala
Scientific publications
wat
Message 54165 - Posted: 31 Mar 2020 | 13:40:04 UTC

Can't upload for at least last 6hours.
Anyone else experiencing problems?

Thanks.

WR-HW95
Send message
Joined: 16 Dec 08
Posts: 1
Credit: 937,483,965
RAC: 1,397,529
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 54166 - Posted: 31 Mar 2020 | 13:51:30 UTC - in response to Message 54165.

Yes. My uploads are (project delayed).

snuffy
New member
Send message
Joined: 25 Mar 20
Posts: 1
Credit: 388,274
RAC: 27,440
Level

Scientific publications
wat
Message 54174 - Posted: 31 Mar 2020 | 15:59:19 UTC - in response to Message 54165.

Same. Rosetta is also stalled, but it look like they're out of tasks at the moment. Any other BOINC covid-19 projects suggested? Let's go smash through their jobs too!

Alessio Susi
Send message
Joined: 7 Mar 15
Posts: 5
Credit: 9,791,670
RAC: 127,617
Level
Ser
Scientific publications
wat
Message 54180 - Posted: 31 Mar 2020 | 18:39:43 UTC

Also TN-GRID is studying the relationship between some specific genes and COVID-19.
____________
ASUS X570 E-Gaming
AMD Ryzen 9 3950X, 16 core / 32 thread 4.4 GHz
AMD Radeon Sapphire RX 480 4GB Nitro+
Nvidia GTX 1080 Ti Gaming X Trio
4x16 GB Corsair Vengeance RGB 3466 MHz

mmonnin
Send message
Joined: 2 Jul 16
Posts: 276
Credit: 734,466,948
RAC: 1,654,405
Level
Lys
Scientific publications
wat
Message 54181 - Posted: 31 Mar 2020 | 23:47:10 UTC - in response to Message 54180.

Also TN-GRID is studying the relationship between some specific genes and COVID-19.


Thanks for sharing. Rosetta, TN-Grid and F@H.

https://gene.disi.unitn.it/test/forum_thread.php?id=265

Post to thread

Message boards : News : Outage resolved