Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Thread Type: Sticky Thread
Total posts in this thread: 427
Posts: 427   Pages: 43   [ Previous Page | 1 2 3 4 5 6 7 8 9 10 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 808020 times and has 426 replies Next Thread
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2170
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Comprehensive Issue List & Report Thread (Aug. 9, 2022)

Next potential issue:

Keep an eye on the OPNG credit. They seems to have dropped down to OPN1 levels. OPNG points were usually 5-600 (BOINC points), but the one I just crunched now only claimed 105.6 Boinc points. I'll wait and see what my wingman claims, and what the granted credit ends up being.

Example from my very slow GeForce GTX 660M GPU. The windows 8.1 computer:
https://www.worldcommunitygrid.org/contribution/workunit/152869783

Edit: Sure, that task only had 14 "jobs", but 105.6 is really low for an OPNG task.
----------------------------------------
[Edit 2 times, last edit by Grumpy Swede at Aug 18, 2022 9:41:17 PM]
[Aug 18, 2022 9:35:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 1951
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Comprehensive Issue List & Report Thread (Aug. 9, 2022)

The projects db_dump which is used by external stats sites, like BoincStats is exporting some very strange data.

Looking at the below link, WCG has gone millions of points backwards for a number of days now, it started first on July 27, and then it seems to work for a while. But now the last 5 days, WCG has lost millions of points (credits). Something is really broken with the db_dump
https://www.boincstats.com/stats/15/project/detail/lastDays

Thanks for letting us know, Grumpy Swede! We're looking into it right away.
Very good. The total points/credits WCG has accumulated, is now billions of points lower than the day the migration started. Not good at all.
I had only 2 OPN1 WUs in the last couple of days and yet, I gained 2 ranks in the BOINCstats page, so did a lot of folks "around" me. I think rather than the upload of the stats XML file, this is due to people dropping out and/or revoking the GDPR, so some folks high up in the ranks are dropping out which is causing those overall stats to drop that much...

Ralf
----------------------------------------

[Aug 18, 2022 10:53:58 PM]   Link   Report threatening or abusive post: please login first  Go to top 
RCC_Survivor
Veteran Cruncher
USA
Joined: Apr 28, 2007
Post Count: 1326
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Comprehensive Issue List & Report Thread (Aug. 9, 2022)

Explain this, on my download tab on BOINC Manager it shows Download pending for 20+ projects, however, on that tab the file progress is incrementing for all but one project. The Tasks tab shows no projects. The event log shows all projects failed to download due to transient HTTP error.
----------------------------------------
smile Be kinder than necessary, for everyone you meet is fighting some battle.

Please join the team The survivors hugs
[Aug 18, 2022 11:02:18 PM]   Link   Report threatening or abusive post: please login first  Go to top 
deltavee
Ace Cruncher
Texas Hill Country
Joined: Nov 17, 2004
Post Count: 4884
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Comprehensive Issue List & Report Thread (Aug. 15, 2022)

I have a few hundred WUs that won't download. Did no one over there tell the network guys what was going to happen here? After six months they have not yet addressed this? I know I need to have patience with them, but... . c'mon man!
----------------------------------------
4858
[Aug 18, 2022 11:13:05 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2170
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Comprehensive Issue List & Report Thread (Aug. 9, 2022)

The projects db_dump which is used by external stats sites, like BoincStats is exporting some very strange data.

Looking at the below link, WCG has gone millions of points backwards for a number of days now, it started first on July 27, and then it seems to work for a while. But now the last 5 days, WCG has lost millions of points (credits). Something is really broken with the db_dump
https://www.boincstats.com/stats/15/project/detail/lastDays

Thanks for letting us know, Grumpy Swede! We're looking into it right away.
Very good. The total points/credits WCG has accumulated, is now billions of points lower than the day the migration started. Not good at all.
I had only 2 OPN1 WUs in the last couple of days and yet, I gained 2 ranks in the BOINCstats page, so did a lot of folks "around" me. I think rather than the upload of the stats XML file, this is due to people dropping out and/or revoking the GDPR, so some folks high up in the ranks are dropping out which is causing those overall stats to drop that much...

Ralf
No, that's not possible. If that's they way WCG has its setup for their "Data sharing" settings, or if people leave the project, that would mean that if everyone left, or changed their "Data sharing" settings to "Hide my data", and/or change to "Do not link my devices", that all points that WCG has accumulated since its start, would drop to zero. Their settings can't be that stupid, that if people leave or change their "Data Sharing" settings, the point they have earned up to that point, gets subtracted from the previous WCG total, and the new lower WCG total is exported the next time to the db_dump.

WCG totals are "anonymous data", and can not be traced back to specific users, so the settings a user change in their "Data Sharing" settings, or leave the project, should of course not affect WCG total credits.

If that's really how things are setup here on WCG, then I'll just SMH in disbelief....
----------------------------------------
[Edit 3 times, last edit by Grumpy Swede at Aug 18, 2022 11:56:13 PM]
[Aug 18, 2022 11:42:42 PM]   Link   Report threatening or abusive post: please login first  Go to top 
rgarvey
Cruncher
Joined: Nov 22, 2004
Post Count: 23
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Comprehensive Issue List & Report Thread (Aug. 9, 2022)

Is it possible for Krembil to focus on these items:

1. Reliable WU download bandwidth the first time they try to download!
2. Reliable WU overview credit
3. Reliable WU external reporting

None of this has occurred since WUs were first released and we are now months into this with no visible progress
----------------------------------------

----------------------------------------
[Edit 1 times, last edit by rgarvey at Aug 19, 2022 1:04:39 AM]
[Aug 19, 2022 1:03:07 AM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 1951
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Comprehensive Issue List & Report Thread (Aug. 9, 2022)

WCG totals are "anonymous data", and can not be traced back to specific users, so the settings a user change in their "Data Sharing" settings, or leave the project, should of course not affect WCG total credits.

If that's really how things are setup here on WCG, then I'll just SMH in disbelief....
I have seen this happen before, not only with WCG, but with other projects as well in the past.
All the sudden, I move up a few ranks and when checking on the BOINCstats site on their rank list, I see that "someone" in front of me apparently dropped out, with everyone below that entry all the sudden move up. I had this even happening for projects that I at that time didn't even actively crunch.
I don't think that this is a WCG issue, but rather something at BOINCstats (and possibly other stats sites, but I don't really frequent those much)....

Here's an example of what I am seeing today, with me far away from overtaking anyone:
https://classic.boincstats.com/en/stats/15/user/list/0/200#240

If you follow the list further up, you will see that someone must have dropped out at position 150 and 71, respectively, in the last week (I thing it happened a couple of days ago).

Ralf
----------------------------------------

[Aug 19, 2022 1:10:13 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2170
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Comprehensive Issue List & Report Thread (Aug. 9, 2022)

yes, I have seen that too for me, I gained 22 places for no reason whatsover the last day. It's crazy if projects lose their total points over all their active time, just because users leave or change their Data protection settings. If that really is the case, the projects total points are totally meaningless.

Ah well, I give up on that issue for now. Let's see if the project admins comes up with an explanation from their perspective.

Good night, cruel world.

Edit, added, before it's time to sleep:

Looking at the WCG global statistics from here https://www.worldcommunitygrid.org/stat/viewGlobal.do
WCG has accumulated 3,785,537,868,002 WCG points since its start (values probably from before the migration). Divide that by 7 to get to the BOINC credits, and the result will be 540,791,124,000 BOINC credits. As of now, BoincStats only shows 435,613,465,908 BOINC credits in total for WCG.

So, if it's BoincStats that subtracts the users who leave or change their privacy settings, or WCG that subtracts the data from those users before they dump the daily data to db_dump, is the question. We'll see what they come up with. No matter what, it's the wrong values at BoincStats for WCG's total BOINC credit/points. I haven't checked any other external stat site, so I do not know it it's only a BoincStats problem, or if the other external stats sites shows the same discrepancy.

Now, Nighty night. smile
----------------------------------------
[Edit 5 times, last edit by Grumpy Swede at Aug 19, 2022 2:15:15 AM]
[Aug 19, 2022 1:19:59 AM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 1951
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Comprehensive Issue List & Report Thread (Aug. 9, 2022)

Is it possible for Krembil to focus on these items:

1. Reliable WU download bandwidth the first time they try to download!
2. Reliable WU overview credit
3. Reliable WU external reporting

None of this has occurred since WUs were first released and we are now months into this with no visible progress
I don't think that 3. is an issue, it seems to work for all I can see. But all the internal stats are not properly "visualized", which to some degree makes it hard to judge the accuracy of the external stats.
And I am not sure if "bandwidth" is the issue with the download problems.For example when downloading MCM1 WUs, there are a bunch of small files, between 296 and 1021 bytes in size. That is certainly smaller than the maximum payload of an Ethernet packet of 1500 bytes. Yet, all of those files get always stuck at exactly 107 bytes. And one large .txt file for the project, with a whooping 121MBytes gets downloaded on the same host with a speed of 800KB/sec to 1MB/sec.

Ralf
----------------------------------------

[Aug 19, 2022 4:16:52 AM]   Link   Report threatening or abusive post: please login first  Go to top 
bfmorse
Senior Cruncher
US
Joined: Jul 26, 2009
Post Count: 298
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Comprehensive Issue List & Report Thread (Aug. 9, 2022)

Seems we still have issues with file transfers. Some of the WU’s that were reported as sent to my systems still have not completed.

Since I was at work at the times they were originally transmitted, I did not see the issue until I returned home from work about 04:00 UTC. I had also forced the retry’s - most have finally succeeded but, even now, there are still some that have not.

I need sleep at this point so I will not be more specific with the error messages other than: http errors.
[Aug 19, 2022 6:28:28 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 427   Pages: 43   [ Previous Page | 1 2 3 4 5 6 7 8 9 10 | Next Page ]
[ Jump to Last Post ]
Post new Thread