| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Community
Forum: Chat Room
Thread: Hunting Tool 2.0 |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 116
|
|
| Author |
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Am afraid this turns out to be another Sagrada Famiglia... you can help by donating some time in user-testing builds and giving feedback, particular when something hangs.
Today added a "calculations rebuild" button to the ribbon (in effect Ctrl+Shft+Alt+F9 for which you need two hands), as sometimes the non-volatile functions forget/miss that the data they're looking at has changed, but somehow did not get word passed by the Excel internal auditor. BTW, did you know that if you hit F9, Excel only re-computes the active sheet, the one on your display, and not the underlying sheets it's feeding from? The center piece pulls information from some 25, hence, but I've got 3 isolated instances running concurrently, small, medium and large... they all resolve, still, even the one that has now almost 300,000 archived results on one tab, 28 thousand entries from the current result status pages, and most anything executing in a few minutes, pivot analyses even in seconds and then one does not need watching it while processing... the workbook gives different pings, urgent, benign, admonishing, still working, and async since a few days, so the audio functions of Windows don't slow down the tool... yes when the speakers are off, Windows will get 'smart' and will cause one or the other ping instruction to go in wait-state, endlessly.  |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Oops, what planet are those Microsoft boys living on? When computing in the spreadsheet you get double precision by default, but be aware certain cell formatting were/are appended to numbers at the far end... somewhere over the 14th decimal. When computing in Visual Basic you get either Single or Double precision, as you specify, but by rule single is 7-8 decimal exact. That's the case when computing inside VB, but the moment you write a result from single precision back to the spreadsheet, suddenly it's only 3 decimal exact. Not a big problem for what is done with the result data EXCEPT, when computing and converting the resultant in the spreadsheet back to e.g. date/time representation, suddenly what you have is
ModTime(sec) NowDateTimeSingle NowDateTimeDouble 1481462155 11-12-16 13:13:07 11-12-16 13:15:55 1481462150 11-12-16 13:13:07 11-12-16 13:15:50 1481462150 11-12-16 13:13:07 11-12-16 13:15:50 1481462150 11-12-16 13:13:07 11-12-16 13:15:50 1481462150 11-12-16 13:13:07 11-12-16 13:15:50 1481462149 11-12-16 13:13:07 11-12-16 13:15:49 1481462143 11-12-16 13:13:07 11-12-16 13:15:43 1481462138 11-12-16 13:13:07 11-12-16 13:15:38 1481462138 11-12-16 13:13:07 11-12-16 13:15:38 1481462132 11-12-16 13:13:07 11-12-16 13:15:32 1481462126 11-12-16 13:13:07 11-12-16 13:15:26 1481462126 11-12-16 13:13:07 11-12-16 13:15:26 1481462121 11-12-16 13:13:07 11-12-16 13:15:21 1481462120 11-12-16 13:13:07 11-12-16 13:15:20 1481462103 11-12-16 13:13:07 11-12-16 13:15:03 1481462028 11-12-16 13:13:07 11-12-16 13:13:48 So unless, even with any modicum of accuracy, you need Double in your procedures and custom functions. (And there I was thinking the validation frequency had changed  ) |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Available for small, medium and 'how big do you wanna crunch' large activity accounts. Added were an archive export [file labelled with start-end dates of results included and a live db archive shrink function... you enter an 'oldest to retain' date and anything older gets ejected, to return the tool to top speed (The small I run on my account has 55K results on it, and does the period stats cycle, fetching last 12 hour results, update the MyCon front page, archive valids, extend project level histories, in under 15 seconds... so the focus can return to 'hunting' for whatever one wishes to hunt for.
The 'how big do you wanna crunch' version in a 2 pass strategy can now handle 116000 valid results per day, size up to 120,000 in the works, [for when MCM and OZ are ported to GPGPU, since otherwise they wont finish before 2030 ;o] TTYL |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Just quickly inserted the newly concocted signin url in the hunting tool script
.navigate WCGPath & "j_security_check?j_username=" & [MemName] & "&j_password=" & [MemPw] and awesomeness struck, grabbed the book I started reading during the 3 days of no power "Unwillingly" in free translation (courtesy of a few meters snow where snow should not be other than a veil... [visit the snow-tsunami video how the apocalyptic storm rolled in from the much too warm Adriatic, hitting the cold mountain air recorded with a smartphone], and all I needed to do was hitting the mouse 3 times every few minutes, 2 drag/drops and an OK, for something no VBA code exists for, and up we are at 50,000 live results on the RS pages that can be handled per 12 hour period... in 2 pass, that is 200,000 valid results per day, lossless. Ready for the GPUfication of MCM and few others, else they wont finish before end of next decade  |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Think I have a General Availability release on my hands, BUT, still need testers to put the 3.0i version through it's paces. Plz don't hesitate to PM me if you want to try the latest greatest, and plz do give feedback on what breaks [if any]... without, progress is slow finding the flaws. \0^o/
(The new .navigate line works on any IE version, registry hacks allow choosing which IE code to use and test against] and FireFox and Chrome, so removed several ribbon tool buttons from the distribution release.) |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
La pièce de résistance, been shoving this forward for a year, but had to be done, or else... adding a project with the push of a ribbon menu button and entering the acronym is enough, even creating the sheet's code module with vba code is inserted [under the hood], in order to hit the ground running when the first valids kick in :D)
----------------------------------------If 1), the project is not found it will tell you and you may back off (all those results stuck in PV jail ;P), see the fine red underscored line..., or 2), the feedback finds the project acronym and tells you what it stands for...  Excuse the spelling/grammar/punctuation on the image... English proper was not switched on... no proofreaders have been on offer ;))) [Edit 1 times, last edit by Former Member at Jan 30, 2017 10:02:39 PM] |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
yippee ki yay, My Friends, one years late, it's done, feature complete, stable, but for WCG website itself, the menu of rare actions now carrying the Add Project option as well.
----------------------------------------See ya layta meaningless is proofs... http links fail to load at WCG, just insert an s and nothing stops ya.  [Edit 1 times, last edit by Former Member at Jan 31, 2017 2:17:48 PM] |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
''Loose ends'' day... just, but only just in case a user has windows installed in a non-standard location not
PlaySound "C:\Windows\..." but PlaySound Environ("WINDIR") & "...", else you would not hear the bell, notify, exclamation, done, dusted, alarm sounds which are programmed to occur at times [if speakers are on]. E.g. if the message was printed to go fetch a coffee as the procedure could take longer, no need to hang around... Pavlov will tole the bell  ) |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
The last of the last loose ends, for those that succeed
 ... |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Maybe the very last, certainly one of the best when working with large data sets, manual calculation and scripting: Range().Dirty
----------------------------------------Confounding how at times the source page with formula was not being properly tallied into the project and global summary tabs... knew about Ctrl+Shft+Alt+F9 to do a full rebuild [taking very long if there are 400K records, 31 fields each], even a button was set up on the ribbon to emulate the contortionist key combination, but investigating the ever returning issue [widely discussed on the expert forums], it appeared you can tell Excel what ranges to set set for recomputing at a later date by declaring a range as dirty, as of office 2013 supposedly, but .Dirty references are found back to 2004. So now when result pages and In Progress are fetched, the near end concluding lines are 352 Range("IPXml").Dirty & 485 Range("ResXml").Dirty Now F9 or running MyCon Update is enough to get the right numbers, first time, every time. ttyl Reference discussions: https://msdn.microsoft.com/en-us/library/office/bb687891.aspx https://msdn.microsoft.com/en-us/library/office/ff838797.aspx https://fastexcel.wordpress.com/2013/11/03/ex...irky-formula-calculation/ [Edit 1 times, last edit by Former Member at Feb 3, 2017 1:28:49 PM] |
||
|
|
|