Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 
World Community Grid Forums
  Category: Official Messages
  Forum: We're Moving to Krembil Research Institute!
  Thread: Data for external stats

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 20
Posts: 20   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 4898 times and has 19 replies
Stony666
Cruncher
Joined: Nov 13, 2020
Post Count: 3
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Data for external stats
Hi,

after moving to the new site our external stats page is no longer able to get data from WCG.
Is there a help page or direkt link for me to get/pull that data?

Thanks in advance Jörg
[Aug 29, 2022 9:17:18 AM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2172
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Data for external stats
Let me guess, you get a "503 Service Unavailable". Just try at non-busy hours, like all of us do.

EDIT: Else. please be more specific.
----------------------------------------
[Edit 1 times, last edit by adriverhoef at Aug 29, 2022 11:14:56 AM]
[Aug 29, 2022 11:13:26 AM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 1957
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Data for external stats
Hi,

after moving to the new site our external stats page is no longer able to get data from WCG.
Is there a help page or direkt link for me to get/pull that data?

Thanks in advance Jörg
Mysteriously, external stats is one of the few things that are so far actually working, at least BOINCstats and Free-DC seem to download that XML file just fine.So it doesn't really seem that anything in that regards has changed. So as someone else mentioned, you need at the very least provide some more info ...

Ralf
----------------------------------------
[Aug 29, 2022 4:52:21 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Stony666
Cruncher
Joined: Nov 13, 2020
Post Count: 3
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Data for external stats
There is no error message, the data is just not up to date.
See u.t.g, which makes points every day in any case.
<LastResult>2022-02-25T06:17:54</LastResult>
<Points>7609154894</Points>
Divided by 7 = 1,087,022,127 Boincpoints, as per my stats.
But according to Boincstats it is 1,090,589,137 points which will be true of course.
The other statistic sites must have a different access to the data. As "TPCBF" suggests, it must be a file that can be downloaded.

Translated with www.DeepL.com/Translator (free version)
[Aug 30, 2022 8:31:55 AM]   Link   Report threatening or abusive post: please login first  Go to top 
TPCBF
Master Cruncher
USA
Joined: Jan 2, 2011
Post Count: 1957
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Data for external stats
There is no error message, the data is just not up to date.
See u.t.g, which makes points every day in any case.
<LastResult>2022-02-25T06:17:54</LastResult>
<Points>7609154894</Points>
Divided by 7 = 1,087,022,127 Boincpoints, as per my stats.
But according to Boincstats it is 1,090,589,137 points which will be true of course.
The other statistic sites must have a different access to the data. As "TPCBF" suggests, it must be a file that can be downloaded.
Yes, there is an XML file that is created 2x times a day AFAIK, that can be downloaded with a known filename and URL. Producing that file used to be an issue once in a while and one of the techs back then (knreed/uplinger) needed to manually give it a "kick in the pants" and restart a certain cron'd process.
And it seems you are NOT downloading that particular file, as without intervention, external stats sites like BOINCstats and Free-DC (that are the only ones I am looking at, primarily the former) started to show up per user/project stats when the first test WUs started to be send out in June.

It seems like you are downloading some file directly off the web site, and on that, beside the actual "Results" page, which DOES show the user related send and received WUs, nothing hasn't been updating since WCG shut down on February 2022 for the physical move from IBM (in Texas?) to Krembil in Toronto.
Translated with www.DeepL.com/Translator (free version)
Wenn es hier Verständigungsschwierigkeiten giebt, kannst Du das auch in Deutsch posten... wink

Ralf
----------------------------------------
[Aug 30, 2022 2:48:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Stony666
Cruncher
Joined: Nov 13, 2020
Post Count: 3
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Data for external stats
Hallo Ralf, danke!

Ich schreibe hier für einen Kollegen, der bei uns (Planet3Dnow) die internen Stats macht. Kennst du du die Location, wo man das File abholen kann und den Filenamen? Oder hast du einen Kontakt, der den benennen kann?

Auf jeden Fall... Vielen Dank für deine Hilfe!

Gruß Jörg
[Aug 30, 2022 7:41:01 PM]   Link   Report threatening or abusive post: please login first  Go to top 
ydeeps
Cruncher
Joined: May 10, 2012
Post Count: 3
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Data for external stats
Hallo Ralf, ich habe für unser Team eine eigene Statistikseite programmiert (https://p3d-stats.dd-dns.de).
Bisher hatte ich über "https://www.worldcommunitygrid.org/team/viewT...ge=250&xml=true" die aktuellen Daten der User bekommen. Das fragt wohl eine Datenbank ab, die nicht mehr aktualisiert wird. Ich hätte da zwei Fragen.
Mit welcher Abfrage könnte ich an die aktuelle XML rankommen und wie könnte ich an stündliche Daten kommen. Beim Pentathlon hat Seti-Germany ja auch Stundenoutputs.

Danke an Stony für das anstoßen hier :-)
[Aug 30, 2022 7:49:52 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2217
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Data for external stats
The following seems to be the working URL to the external statistics files on WCG:
https://download.worldcommunitygrid.org/boinc/stats/

I believe it's from that URL, external sites like BoincStats, is importing the WCG stats to their system.
----------------------------------------
[Edit 2 times, last edit by Grumpy Swede at Aug 30, 2022 8:09:45 PM]
[Aug 30, 2022 8:08:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
ydeeps
Cruncher
Joined: May 10, 2012
Post Count: 3
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Data for external stats
@Grumpy Swede,
When I call up the page, I get 503 Service unavailable, which doesn't seem to be working
[Aug 30, 2022 8:23:18 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Grumpy Swede
Master Cruncher
Svíþjóð
Joined: Apr 10, 2020
Post Count: 2217
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Data for external stats
@Grumpy Swede,
When I call up the page, I get 503 Service unavailable, which doesn't seem to be working

Hmm, works for me almost every time, but from time to time I'm also getting a 503 response. I think the server is very busy with other requests.

Edit: It seems to be the right URL though, since the files in question is up to date

Index of /boinc/stats

	    Name	                 Last modified	        Size	
------------------------------------------------------------
[PARENTDIR]	Parent Directory	 	-	 
[TXT]	db_dump.xml	                2022-08-30 19:16	1.1K	 
[   ]	host.gz	                        2022-08-30 19:13	753M	 
[   ]	host.xml.gz	                2022-08-30 19:13	753M	 
[   ]	host_deleted.gz	                2022-08-30 19:16	1.8M	 
[   ]	host_deleted.xml.gz	        2022-08-30 19:16	1.8M	 
[DIR]	stats/	                        2022-08-30 19:16	-	 
[DIR]	stats_2022_8_29_13_3..>	        2022-08-29 01:07	-	 
[DIR]	stats_2022_8_29_19_3..>	        2022-08-29 13:11	-	 
[DIR]	stats_2022_8_30_1_44_2/	        2022-08-29 19:19	-	 
[DIR]	stats_2022_8_30_13_4..>	        2022-08-30 01:25	-	 
[DIR]	stats_2022_8_30_19_3..>	        2022-08-30 13:22	-	 
[TXT]	tables.xml	                2022-08-30 19:16	6.4K	 
[   ]	team.gz	                        2022-08-30 17:58	2.6M	 
[   ]	team.xml.gz	                2022-08-30 17:58	2.6M	 
[   ]	user.gz	                        2022-08-30 17:58	5.7M	 
[   ]	user.xml.gz	                2022-08-30 17:58	5.7M	 
[   ]	user_deleted.gz	                2022-08-30 19:16	425K	 
[   ]	user_deleted.xml.gz	        2022-08-30 19:16	425K

----------------------------------------
[Edit 2 times, last edit by Grumpy Swede at Aug 30, 2022 8:38:07 PM]
[Aug 30, 2022 8:31:59 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 20   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread