Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 38
Posts: 38   Pages: 4   [ Previous Page | 1 2 3 4 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2524 times and has 37 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: What happened to validation?

There's room for improvement, certainly. But right now, I suspect the WCG team are just pleased with their significant improvement over the standard BOINC method.

Post-game analysis and the sort of in-depth research needed to cover all the variables will take some time. It's likely that the WCG will just hand over their improvements to the BOINC developers, and let the community play with it for a while.
[May 29, 2006 12:42:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: What happened to validation?

Didactylos,

You've missed the point entirely. What are you going to tell people 20 weeks from now when they show up in the forums and ask why they aren't getting points? Or maybe they will have figured out that the deadline changed without warning. Either way, when they tell you they would have continued crunching for nothing had they not noticed they weren't getting points... well... what are you going to say? When volunteers discover their efforts were all for naught they feel like they got dumped on and they will tell other people about it. Changing the game rules without telling all the players is really bad for PR. I'm still shaking my head in disbelief. See... if WCG will dump on them, then WCG will dump on me too. I don't like getting dumped on.
[May 29, 2006 7:35:54 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: What happened to validation?

They are getting points!

Where did you get this idea? All valid, returned results get points. And nobody's changing the deadline.

So, relax.... pour a tall cold one and kick back.... :-D
[May 29, 2006 7:54:33 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: What happened to validation?

Where did I get that idea? Well, mmm, errr.....aliens abducted me and planted the thought in my brain???

Pop, fizz, glug, glug. Ok. I'm better now.
[May 29, 2006 8:56:17 PM]   Link   Report threatening or abusive post: please login first  Go to top 
David Autumns
Ace Cruncher
UK
Joined: Nov 16, 2004
Post Count: 11062
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: What happened to validation?

Hi Dagorath

I think the majority of newbies cut their crunching teeth with UD on Window Boxes. All Ud'ers are unaffected by this change and they get their points immediately, well a maximum of 6 hours late anyway.

BOINC crunchers have usually moved on a bit and appreciate the crunching for what it is scientific research which takes a bit of patience.

Everyone get's their points eventually by only sending out 3 WU's initially and if those 3 results come back then no further processing power is squandered sending out a forth for that WU. Science wins and if everyone converted to BOINC our ~30TFlops Supercomputer turns into a 50TFlops overnight without any additional hardware.

This has got to be an improvement thinking

Once we get through this initial pain of migrating from one method to the new one the points will come through at exactly the same rate as before you will just have more work units in your pending validation buffer who knows every now and again you might get a surprise bumper crop of points

Dave
----------------------------------------

[May 29, 2006 11:02:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: What happened to validation?

Certainly people will still continue to get all their points. I hope I didn't somehow imply anything different.

My point was simply that any result turned in after 4 days (or whatever the final reissue time is) won't really do much actual good, and will be pretty much a waste of time as far as actually helping the project goes.

People deserve to know that, and the deadline is the fundamental mechanism for telling them so. The very act of having to warn people not to cache 4 days worth of work is a major clue that the stated deadline no longer reflects reality. Out of band warnings shouldn't be needed. And most people don't read these forums anyway, so most of those who need the warning won't even get it.

Personally, I'd be much more upset if I had a slow machine and found out 20 weeks from now that my last few months of crunching had done nothing but get me points, contributing little real value to the project. But I guess most people in that situation never would find out; they'll just keep on turning in worthless week-old results and collecting points. Another case of ignorance is bliss, I guess. But it bugs me.

If all someone cares about is the points, there are other projects that "pay" a lot better than WCG, especially with the right optimized software.
[May 29, 2006 11:07:17 PM]   Link   Report threatening or abusive post: please login first  Go to top 
David Autumns
Ace Cruncher
UK
Joined: Nov 16, 2004
Post Count: 11062
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: What happened to validation?

p.s. The slow PC issue

The slow PC taking up to 3 weeks to return a WU has always been there except with the old way of working you might post back your 4th when a quorum of 3 has already been established and you would get your points

now...

you might be a slow PC working with 2 other PC's on a group of 3 WU's and because your PC is taking it's time the 4 day timer expires and a 4th WU is sent out to another PC. You might report back on day 5 or the other PC might burn through the WU and report back before your PC gets time to complete it's work unit, eventually you return the Work Unit

How is the first different to the last?

In both cases everyone gets their points and 4 WU have been crunched and science is happy.

knreed and the crew at IBM are just trying to make the process more effective it won't work all of the time as described above but some of the time the new process will deliver the same with less. Which has got to be good for Science and the Environment

Dave (again)
----------------------------------------

[May 29, 2006 11:17:34 PM]   Link   Report threatening or abusive post: please login first  Go to top 
David Autumns
Ace Cruncher
UK
Joined: Nov 16, 2004
Post Count: 11062
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: What happened to validation?

Before there was never any concept of being late apart from the 3 week time out. But the quorum of 3 has been there since the beginning of the project so the slow PC effect has always been there only now that there is a realisation of a possibility of the process being more effective has this inherent effect of grid computing been presented to us. The validity of a slow PC's contribution hasn't changed by the new rules just before there wasn't a choice. Now you might get a short WU and produce a useful result within the 4 days without that Work Unit also being sent out to another quicker machine


btw the average WCG PC is just over a 2700+ Athlon churning out 3GFlops of raw number crunching power

Dave (I'll shut up now)
----------------------------------------

[May 29, 2006 11:37:49 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: What happened to validation?

Ok, I buy the argument that the situation now is no worse than before. Still, I think the way to maintain good public relations in a community as diverse as WCG is to take the extra effort to inform everybody of major changes in policy. That way nobody has a reason to feel they've been cut out of the loop or slighted in any way. Putting the info about the 4 day "undeadline" thing in the RSS feed or doing a mass email or maybe in a box called "Breaking News" on the WCG homepage .... stuff like that tells volunteers they have not been forgotten.

Furthermore, advising those with slow computers on BOINC that they will likely be missing the 4 day "undeadline" and that they ought to consider switching to UD would eliminate a bit of waste and boost efficiency a wee bit more.

And even farther more, letting ALL your average 2700+ Athalon BOINCers know about the 4 day "undeadline" and advising ALL of them of the effect of caching more than 4 days work would give yet another wee tweak in the right direction and our ~30TFlop Supercomputer becomes a lean, mean 51TFlop Sooper Dooper Cruncherator which beats 50TFlops by 1TFlop.
[May 30, 2006 12:29:53 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: What happened to validation?

True, the slow PC effect has always been there, with most of the work of a slow PC being "wasted" turning in 4th results that turned out not to be needed. But at least before, a significant portion of the slow results weren't wasted; they were needed to make up for failures among the other 3 copies. So on average, 2-week old results were still fairly useful and worth turning in, in spite of the overall wastage.

But now, 2 week old results are almost totally worthless; there's practically no chance that the WU won't have been long since finished by that time. Which is great; all I'm saying is the project shouldn't still be telling people that 2 and 3 week old results are still worth crunching when they're not. It's not that there's any more wastage than before; far from it. But now we know pretty accurately which units are still being wasted, so it seems strange to let this remaining, identified loss continue needlessly when it's so easily fixed.

Before, there was a kind of decreasing percent chance that your result would turn out to be needed, the longer you took to turn it in, so the grid techs made a reasonable judgement call as to how far to let things go. But now there's a nice clean sharp line where your result changes instantly from very important to very likely useless, and I'm confused that the project hasn't recognized it. The deadlines could now be highly objective and accurate, precisely informing people where their efforts really stand, and dovetailing efficiently with the scheduling algorithms in the manager, but instead they've become misleading and counter-productive.

I'm glad the average WCG node is so powerful; that's a lot better than I expected. But there're still those who cache a lot of WUs (either always to insure against downtime, or when they go on vacation etc.), as well as those who work a lot of projects and don't give that much to WCG. I'd be really curious to see what the curve of total WU turnaround time looks like.

I'm also not so sure that none of this applies to the UD side. The only real difference there is that the points are awarded up front, and the validation happens later behind the scenes without all of us leaning over the server's shoulder and nitpicking on the method. The server still has to collect a quorum, and still has to reissue failed units, and so there's still this same kind of efficiency and wastage issue going on; we just aren't in a position watch it and whine about it. Which I'm sure is a great relief to those involved.

And so I'll shut up now too.
----------------------------------------
[Edit 1 times, last edit by Former Member at May 30, 2006 7:54:45 AM]
[May 30, 2006 12:53:40 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 38   Pages: 4   [ Previous Page | 1 2 3 4 | Next Page ]
[ Jump to Last Post ]
Post new Thread