| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Community
Forum: Chat Room
Thread: Team Data: Scraping? |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 2
|
|
| Author |
|
|
OldChap
Veteran Cruncher UK Joined: Jun 5, 2009 Post Count: 978 Status: Offline Project Badges: 
|
I believe I read here that you call collecting data from WCG, scraping.
----------------------------------------It is a subject about which I know nothing at all. Does anyone here have a moment to point me at some links that will allow me to learn how to get team data such as runtime and points in order to build charts? Ultimately I want to be able to support a team challenge with this.  [Edit 1 times, last edit by OldChap at Oct 13, 2015 5:31:18 PM] |
||
|
|
SekeRob
Master Cruncher Joined: Jan 7, 2013 Post Count: 2741 Status: Offline |
'Scraping' is copy/pasting html pages as-is. Some pages/addresses have xml/json export extensions, so you can query those easily for import into a spreadsheet. For the results status pages there was even an API written, so you can real-time filter what data you want to extract.
----------------------------------------The key words to search for in Help were emphasized to get you along. What you though would want to do is use the 6 hourly BOINC exports of most all statistics data including those for teams **. Those are already in xml, for easy import into for instance Excel. Those are found at http://www.worldcommunitygrid.org/boinc/stats/ ** Could be these only update 1x per 24 hours. [Edit 1 times, last edit by SekeRob* at Oct 13, 2015 5:53:01 PM] |
||
|
|
|