| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Support
Forum: Website Support
Thread: Problem with XML versions of stats page [RESOLVED] |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 8
|
|
| Author |
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
A while back I made an application that reads the xml versions of some of statistics pages and then processes the extracted information further.
----------------------------------------This worked fine until today. Today when I run my application I get a html page saying Error: The application is unavailable at this time, please try again later instead of xml. This would be ok if there was a real problem at WCG (although it is not very nice to return a html error message to an xml request), but if I paste the url requested by my application in my browser it works just fine. It seems something was changed with the upgrade of today that prevents my application from working, but I can't figure out what. Why would the website nicely return xml when my browser requests a page, but return a html error message if another application on the same computer requests exactly the same page? Has some logic to prevent programmatic page requesting been implemented? If so why, cause I can't see much other use for xml versions of the statistics pages. The url I requested: http://www.worldcommunitygrid.org/team/viewTe...PerPage=5000&xml=true I tried it with various teamId's. They all work fine in my browser, but return the html error message if my own app requests the same url. [Edit 2 times, last edit by Former Member at Jul 17, 2009 7:25:53 AM] |
|||
|
||||
|
Sekerob
Ace Cruncher Joined: Jul 24, 2005 Post Count: 20043 Status: Offline |
Confirmed. My own scraper is broken too and gives "Unable to open url ..." Cannot download the information you requested".
----------------------------------------Edit: But, after opening the query in the editor and re-saving it runs again. Transient?
WCG
----------------------------------------Please help to make the Forums an enjoyable experience for All! [Edit 1 times, last edit by Sekerob at Jul 14, 2009 8:45:18 PM] |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
I tried rerunning my app again to verify if it was transient and gone. I still get the same error message though.
----------------------------------------From your post I suspect you scrape using Excel? In my case it is a self build application. No query builder to open and save the query again for me... [Edit 1 times, last edit by Former Member at Jul 14, 2009 9:19:21 PM] |
||
|
|
uplinger
Former World Community Grid Tech Joined: May 23, 2005 Post Count: 3952 Status: Offline Project Badges: 
|
What tool are you using to pull in the xml data? Wget?
-Uplinger |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
The app is in php. Originally I used simplexml_load_file. When I ran into this issue I rewrote it to use curl though with the same result.
----------------------------------------[Edit 1 times, last edit by Former Member at Jul 14, 2009 9:36:48 PM] |
||
|
|
uplinger
Former World Community Grid Tech Joined: May 23, 2005 Post Count: 3952 Status: Offline Project Badges:
|
Have you tried enabling cookies when pulling the information in?
Something along these lines $s = curl_init(); curl_setopt($s,CURLOPT_COOKIEJAR,"cookiefile.txt"); curl_setopt($s,CURLOPT_COOKIEFILE,"cookiefile.txt"); -Uplinger |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
I don't have cookie support enabled in my app at the moment. I can try this evening when I'm home.
Strange if this is the cause of the problem though, because my app worked fine without cookie support until the 14th. Still no harm in trying so I'll give it a go. |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
I just ran my app again (without any change to what failed) and behold, I got no error message but proper xml instead. My guess is that whatever was changed on the WCG side has been resolved, as my app is basically the same as the one that worked before the 14th. I never got to adding the cookie parameters to CURL, so it works without.
In any case my problem has been resolved, so I'll add the text to the subject |
||
|
|
|