XtremLab HELP!

This forum provides an FAQ for users as well as allowing you to ask questions about MundayWeb's very popular BOINC stats services.
Neil
Site Admin
Posts: 1349
Joined: Mon Apr 18, 2005 8:35 pm
Location: UK
Contact:

XtremLab HELP!

Post by Neil » Fri Apr 14, 2006 12:34 am

Hi all,

I need to ask the BOINC community a favour... I have done a few tests on my webhost's server to work out what is going on as I have not been able to update the XtremLab stats since 20/03/06. (I have cheated tonight by doing a hand scripted update using a copy of the XML files off my local PC).

Anyways, here's the results:

Code: Select all

-jailshell-2.05b$ ping  xw01.lri.fr
PING xw01.lri.fr (129.175.7.127) 56(84) bytes of data.
64 bytes from xw01.lri.fr (129.175.7.127): icmp_seq=0 ttl=50 time=121 ms
64 bytes from xw01.lri.fr (129.175.7.127): icmp_seq=1 ttl=50 time=121 ms

--- xw01.lri.fr ping statistics ---
3 packets transmitted, 2 received, 33% packet loss, time 2015ms
rtt min/avg/max/mdev = 121.143/121.170/121.197/0.027 ms, pipe 2
-jailshell-2.05b$
-jailshell-2.05b$ telnet xw01.lri.fr 4320
Trying 129.175.7.127...
telnet:  Unable to connect to remote host: Connection timed out
Any ideas?

Thanks for any help/advice,

Neil.

User avatar
carlos
Member
Posts: 17
Joined: Tue Mar 07, 2006 2:46 am
Location: Rio de Janeiro, Brazil
Contact:

Post by carlos » Fri Apr 14, 2006 1:49 am

Yes

1) They run on a non-standard port 4320

2) The directory listing is not enabled ... see:

http://xw01.lri.fr:4320/stats/

Code: Select all

You are not authorized to view this page 
You might not have permission to view this directory or page using the credentials you supplied. 

--------------------------------------------------------------------------------

If you believe you should be able to view this directory or page, please try to contact the Web site by using any e-mail address or phone number that may be listed on the xw01.lri.fr:4320 home page.

You can click  Search to look for information on the Internet.




HTTP Error 403 - Forbidden 
Internet Explorer  
3) Their e-mail server is *not* working

However u should be able to post on their forums
http://xw01.lri.fr:4320/forum_index.php
(once u have created an account)
http://xw01.lri.fr:4320/create_account_ ... ?teamid=75

And even witout creating an account u sould be able to get
the comressed stats ... the names are the same as of other projects see
http://xw01.lri.fr:4320/stats/team.gz

Code: Select all

 <?xml version="1.0" encoding="iso-8859-1" ?> 
- <teams>
- <team>
  <id>1</id> 
  <type>1</type> 
  <name>USA</name> 
  <userid>6</userid> 
  <total_credit>4888.501344</total_credit> 
  <expavg_credit>331.362058</expavg_credit> 
  <expavg_time>1144970743.258210</expavg_time> 
  <nusers>9</nusers> 
  <founder_name>David M</founder_name> 
  <create_time>1141667200</create_time> 
  <country>United States</country> 
  </team>
- <team>
  <id>2</id> 
  <type>1</type> 
  <name>ESEA (Earth Space Exploration Agency)</name> 
  <userid>7</userid> 
  <total_credit>81.627224</total_credit> 
  <expavg_credit>9.241906</expavg_credit> 
  <expavg_time>1144938123.285000</expavg_time> 
  <nusers>2</nusers> 
  <founder_name>Bruno G. Olsen & ESEA @ greenholt</founder_name> 
  <create_time>1141669914</create_time> 
  <url>www.esea.dk/esea/boinc.asp</url> 
  <name_html><b>ESEA</b> <i>(Earth Space Exploration Agency)</i></name_html> 
  <description><img src='http://www.esea.dk/images/esealogo.png'><br>What is important to us, humans? To explore the unknown. ESEA is all about exploring and sharing knowledge about the unknown. To explore space is to explore the earth. To explore the earth is to explore space. To explore science is to explore both. This team can be found in other projects as well.</description> 
  <country>International</country> 
  </team>
- <team>
-----  I had cut here ----
For what u use ping and telnet :?:

ps: These commands works to me :wink:
wget http://xw01.lri.fr:4320/stats/team.gz
gunzip team

User avatar
Lee Carre
Member
Posts: 17
Joined: Tue Jan 31, 2006 1:34 am
Location: Jersey, Channel Islands, Great Britain (UK)

Post by Lee Carre » Fri Apr 14, 2006 3:40 am

could you schedule a download manager (like GetRight) to download (and resume if a timeout occours) the files daily (or however often you need, getright can be initiated via a script that checks if the stats have been updated and told to download a list of URLs via command line input based on the results of the "checking" script) and then unzip and import the files from the downloaded copies
Last edited by Lee Carre on Fri Apr 14, 2006 3:53 am, edited 1 time in total.
Want to search the BOINC Wiki, BOINCstats, or various BOINC forums from within firefox? Try the BOINC related Firefox Search Plugins

User avatar
Lee Carre
Member
Posts: 17
Joined: Tue Jan 31, 2006 1:34 am
Location: Jersey, Channel Islands, Great Britain (UK)

Post by Lee Carre » Fri Apr 14, 2006 3:48 am

carlos wrote:1) They run on a non-standard port 4320
makes no difference as long as the routing and connection are both reliable, and the server is configured correctly (no reason it shouldn't be, it's just a different port) and is able to sustain long connections (again, it should be able to, a download isn't exactly a stressful task)

maybe they can't, or aren't allowed to, use port 80 (the default)
some ISPs block it (so you can't host a site easilly) and if they're on a university campus then it's up to the uni IT staff to decide what they can and can't do, prehaps that IP address is used for other things
there's a long list of reasons, lets just work with what we've got first before demanding major changes
2) The directory listing is not enabled ... see:

http://xw01.lri.fr:4320/stats/

Code: Select all

HTTP Error 403 - Forbidden
also makes no difference, as long as neil can download the files it doesn't matter if he can get a directory listing
3) Their e-mail server is *not* working
um, sorry? why would he need email?
However u should be able to post on their forums
http://xw01.lri.fr:4320/forum_index.php
(once u have created an account)
http://xw01.lri.fr:4320/create_account_form.php
i think notifying them of the problem would be a good start, at least they can investigate and see if it's a problem their end, i have to say i've had no trouble connecting to them when their server has been stable, but then a page is rather small and time from request initiation to response completion is quite short, no where near as long as a download

you could use Ethereal to see exactly what's going on and find out why connections are being dropped (capture filter of "port 80" without the quotes)
And even witout creating an account u sould be able to get
the comressed stats ... the names are the same as of other projects see
http://xw01.lri.fr:4320/stats/team.gz
so how is directory browsing relavent?
For what u use ping and telnet :?:
to test basic connectivity to the server lol, if basic connectivity doesn't work (or isn't reliable) then HTTP sure isn't going to be

(performed on a windows system)
C:\>ping xw01.lri.fr

Pinging xw01.lri.fr [129.175.7.127] with 32 bytes of data:

Reply from 129.175.7.127: bytes=32 time=47ms TTL=53
Reply from 129.175.7.127: bytes=32 time=24ms TTL=53
Reply from 129.175.7.127: bytes=32 time=31ms TTL=53
Reply from 129.175.7.127: bytes=32 time=34ms TTL=53

Ping statistics for 129.175.7.127:
Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 24ms, Maximum = 47ms, Average = 34ms
Want to search the BOINC Wiki, BOINCstats, or various BOINC forums from within firefox? Try the BOINC related Firefox Search Plugins

Neil
Site Admin
Posts: 1349
Joined: Mon Apr 18, 2005 8:35 pm
Location: UK
Contact:

Post by Neil » Fri Apr 14, 2006 11:52 am

Hi,

Thanks for the suggestions. My web host has increased the timeout value for connections, but this doesn't seem to have helped.

I tried a wget as well (the app has been renamed to mywget for security reasons).

Code: Select all

-jailshell-2.05b$ /usr/bin/mywget http://xw01.lri.fr:4320/stats/team.gz
--11:44:50--  http://xw01.lri.fr:4320/stats/team.gz
           => `team.gz'
Resolving xw01.lri.fr... 129.175.7.127
Connecting to xw01.lri.fr|129.175.7.127|:4320... failed: Connection timed out.
Retrying.

--11:45:35--  http://xw01.lri.fr:4320/stats/team.gz
  (try: 2) => `team.gz'
Connecting to xw01.lri.fr|129.175.7.127|:4320... failed: Connection timed out.
Retrying.

--11:46:20--  http://xw01.lri.fr:4320/stats/team.gz
  (try: 3) => `team.gz'
Connecting to xw01.lri.fr|129.175.7.127|:4320... failed: Connection timed out.
Retrying.

--11:47:05--  http://xw01.lri.fr:4320/stats/team.gz
  (try: 4) => `team.gz'
Connecting to xw01.lri.fr|129.175.7.127|:4320... failed: Connection timed out.
Retrying.

--11:47:50--  http://xw01.lri.fr:4320/stats/team.gz
  (try: 5) => `team.gz'
Connecting to xw01.lri.fr|129.175.7.127|:4320... failed: Connection timed out.
Retrying.

--11:48:35--  http://xw01.lri.fr:4320/stats/team.gz
  (try: 6) => `team.gz'
Connecting to xw01.lri.fr|129.175.7.127|:4320... failed: Connection timed out.
Next step is to contact XtremLab.

Here goes...

Neil.

Neil
Site Admin
Posts: 1349
Joined: Mon Apr 18, 2005 8:35 pm
Location: UK
Contact:

Post by Neil » Fri Apr 14, 2006 12:11 pm

Hi,

For those interested, a thread has already been created at the XtremLab forums about the problems...

http://xw01.lri.fr:4320/forum_thread.php?id=53

Neil.

User avatar
carlos
Member
Posts: 17
Joined: Tue Mar 07, 2006 2:46 am
Location: Rio de Janeiro, Brazil
Contact:

Post by carlos » Fri Apr 14, 2006 8:56 pm

I am believing that this problem is not a problem of xlab nor of mundayweb , really is a problem of the path (way /street)

What hapens is that the connection betwen mubdaywb and xlab
is not a single hop coonection ... there are intermediates hops
that may be not working well
See a trace from my Linux, 2gbit Link

Code: Select all

[[email protected] root]# wget http://xw01.lri.fr:4320/stats/team.gz
--16:18:06--  http://xw01.lri.fr:4320/stats/team.gz
           => `team.gz'
Resolving xw01.lri.fr... done.
Connecting to xw01.lri.fr[129.175.7.127]:4320... connected.
HTTP request sent, awaiting response... 200 OK
Length: 15,381 [text/plain]

100%[=================================================================================>] 15,381        30.65K/s    ETA 00:00

16:18:08 (30.65 KB/s) - `team.gz' saved [15381/15381]

[[email protected] root]# traceroute -I xw01.lri.fr
traceroute to xw01.lri.fr (129.175.7.127), 30 hops max, 38 byte packets
 1  2121.rjo.virtua.com.br (200.179.212.1)  125.205 ms  12.387 ms  33.894 ms
 2  RJOBRRTD01.rjo.virtua.com.br (200.179.192.1)  13.872 ms  17.615 ms  11.999 ms
 3  embratel-G4-2-gacc02.rjo.embratel.net.br (200.244.153.5)  12.734 ms  9.347 ms  10.472 ms
 4  ebt-G5-0-intl01.rjo.embratel.net.br (200.244.162.25)  9.495 ms  12.072 ms  11.615 ms
 5  ebt-SO-2-0-2-intl01.mianap.embratel.net.br (200.244.111.158)  142.327 ms  133.471 ms  135.211 ms
 6  so-1-0-0.ar2.MIA1.gblx.net (67.17.212.185)  159.312 ms  175.134 ms 64.210.31.57 (64.210.31.57)  166.659 ms
 7  * * *
 8  * * *
 9  * * *
10  * * *
11  * * *

[[email protected] root]# traceroute  xw01.lri.fr
traceroute to xw01.lri.fr (129.175.7.127), 30 hops max, 38 byte packets
 1  2121.rjo.virtua.com.br (200.179.212.1)  51.126 ms  28.125 ms  19.014 ms
 2  RJOBRRTD01.rjo.virtua.com.br (200.179.192.1)  37.576 ms  28.583 ms  17.568 ms
 3  embratel-G4-2-gacc02.rjo.embratel.net.br (200.244.153.5)  18.617 ms  24.101 ms  23.818 ms
 4  ebt-G5-0-intl01.rjo.embratel.net.br (200.244.162.25)  24.586 ms  23.110 ms  24.214 ms
 5  ebt-SO-2-0-2-intl01.mianap.embratel.net.br (200.244.111.158)  136.658 ms  144.596 ms  137.846 ms
 6  so-1-0-0.ar2.MIA1.gblx.net (67.17.212.185)  167.608 ms 64.210.31.57 (64.210.31.57)  167.158 ms  161.838 ms
 7  * * *
 8  * * *
 9  * * *
10  * *
as is clearly above, gblx.net is blocking icmp, and udp too.

Now see a trace from another ip, 45kbit link

Code: Select all

Tracing route to xw01.lri.fr [129.175.7.127]
over a maximum of 30 hops:

  1  1836 ms     *        *     200.216.95.116
  2  1662 ms   259 ms   519 ms  200.141.239.1
  3     *        *        *     Request timed out.
  4     *        *        *     Request timed out.
  5     *     2467 ms   619 ms  PO0-5.BDEA-BA-ROTN-01.telemar.net.br [200.223.131.69]
  6  1037 ms   458 ms   399 ms  So1-0-2-0-grtnycpt2.red.telefonica-wholesale.net [213.140.51.149]
  7  2596 ms     *        *     So7-2-0-0-grtnycpt3.red.telefonica-wholesale.net [213.140.37.230]
  8   378 ms  1819 ms  2938 ms  P13-0-0-grtwaseq1.red.telefonica-wholesale.net [213.140.37.54]
  9     *        *        *     Request timed out.
 10  1303 ms  1158 ms  1699 ms  Renater.sfinx.tm.fr [194.68.129.102]
 11   476 ms   479 ms   459 ms  nri-d-g2-0-0-101.cssi.renater.fr [193.51.187.22]
 12   656 ms   779 ms   798 ms  orsay-pos1-0.cssi.renater.fr [193.51.179.42]
 13   475 ms   458 ms   460 ms  ups-orsay.cssi.renater.fr [193.51.183.29]
 14   437 ms   439 ms   439 ms  129.175.127.130
 15   444 ms   438 ms   432 ms  xw01.lri.fr [129.175.7.127]

Trace complete.
Do a trace from the ip u download the stats file,
and u will find another path ...

The simplest way to solve this, is downloading the stats files
that came from xw01.lri.fr [129.175.7.127]

from another ip, (other than the mundayweb ip), that has a better path to xlab :D

Perhaps download xlab stats to one of the mundayweb shadows
and then, from that shadow send that files to mundayweb master
-or- the mundayweb master get that files from that mundayweb shadow

ps: I guess that this problem started when mundayweb master
left UK, (that is near france) to US, that is somewhat more distant ...
and may be, has a not a optimal Internet Link to France.

Cheers
Last edited by carlos on Fri Apr 14, 2006 9:31 pm, edited 1 time in total.
ImageImage

User avatar
clarkf1
Established Member
Posts: 175
Joined: Sun Jun 05, 2005 11:36 am

Post by clarkf1 » Fri Apr 14, 2006 9:15 pm

Code: Select all

C:\Documents and Settings\Chris>tracert xw01.lri.fr

Tracing route to xw01.lri.fr [129.175.7.127]
over a maximum of 30 hops:

  1     1 ms     1 ms     1 ms  voyager.home [192.168.1.1]
  2    17 ms    11 ms    12 ms  217.47.88.58
  3    11 ms    11 ms    12 ms  217.47.89.161
  4    11 ms    13 ms    12 ms  217.41.171.21
  5    23 ms    14 ms    12 ms  217.41.171.65
  6    12 ms    10 ms    11 ms  217.41.171.130
  7    13 ms    14 ms    12 ms  217.41.171.50
  8    12 ms    10 ms    10 ms  217.47.88.242
  9    12 ms    11 ms    11 ms  core2-pos6-1.kingston.ukcore.bt.net [62.6.40.78]

 10    12 ms    12 ms    11 ms  core2-pos13-1.ilford.ukcore.bt.net [195.99.120.1
94]
 11    16 ms    12 ms    11 ms  transit2-pos4-0.ilford.ukcore.bt.net [194.72.20.
254]
 12    12 ms    11 ms    12 ms  t2c2-p8-0.uk-ilf.eu.bt.net [166.49.168.97]
 13    12 ms    12 ms    12 ms  t2c1-p8-0.uk-lon1.eu.bt.net [166.49.208.2]
 14    12 ms    12 ms    12 ms  t2a4-ge0-0.uk-lon1.eu.bt.net [166.49.135.20]
 15    12 ms    14 ms    11 ms  166-49-211-130.eu.bt.net [166.49.211.130]
 16     *        *        *     Request timed out.
 17    23 ms    22 ms    21 ms  nri-c-pos0-0.cssi.renater.fr [193.51.185.2]
 18    22 ms    22 ms    22 ms  nri-d-g2-0-0-101.cssi.renater.fr [193.51.187.22]

 19    24 ms    22 ms    23 ms  orsay-pos1-0.cssi.renater.fr [193.51.179.42]
 20    22 ms    23 ms    23 ms  ups-orsay.cssi.renater.fr [193.51.183.29]
 21    24 ms    24 ms    24 ms  129.175.127.130
 22    24 ms    24 ms    23 ms  xw01.lri.fr [129.175.7.127]

Trace complete.
Perhaps the time out along the route could be a problem......it obviously found a different route to take even though it's an EU based IP address it stumbles at
Image
Cruncher: i7-8700K (6 cores, 12 threads), 16GB DDR4-3000Mhz, 8GB NVIDIA 1080

Neil
Site Admin
Posts: 1349
Joined: Mon Apr 18, 2005 8:35 pm
Location: UK
Contact:

Post by Neil » Fri Apr 14, 2006 11:15 pm

I agree it could be a routing issue somewhere. As I said before, it all started since the 20th March.

My website has been hosted in the US for about 2 years. Before then it was on a UK based server.

Ideally I would like this to get sorted as I don't want to have to rely on another site to pull the stats files. It wouldn't be hard at all to get one of the mirror sites to run a cron job to pull the files, but again, I'd like to understand the problem and get it sorted.

Thanks for the comments ;-)

The saga continues....

User avatar
carlos
Member
Posts: 17
Joined: Tue Mar 07, 2006 2:46 am
Location: Rio de Janeiro, Brazil
Contact:

Post by carlos » Sat Apr 15, 2006 7:01 am

one of the mirror sites to run a cron job to pull the files
not necessarily a cron on a mirror

the cron job can be in the master ... the shadows has only a special .php
script to do the job of getting files someplace else and fulfilling
the request from the master

may be a generic script ...

Now, is xlab ... tomorrow may be other project
*may be some natural accident , block comunications from a <----> b

Code: Select all

however a can see b trougth c                          a    |||    b
                                                       \         /
                                                         \      /
                                                           \  /
                                                             c
Of course this is simple matter of routing
but if that routing via c uses too many hops,
may be ttl does not suffice
so using a intermediate site to take the file, ttl does not matter
and u can use any of the shadows ...

Cheers
ImageImage

Neil
Site Admin
Posts: 1349
Joined: Mon Apr 18, 2005 8:35 pm
Location: UK
Contact:

Post by Neil » Thu Apr 20, 2006 6:02 pm

Hi all,

I have come-up with a workaround for now. It isn't in place yet, as I've only just asked one my mirror providers if I can put my new script on their server.

For those who are interested, it basically (on request) downloads the XtremLab stats and via a PHP header command, echos the contents of each gzip file back to the requesting source (e.g. web browser, Perl script etc.).

I hope that this will do the trick!

Watch this space...

Neil.

User avatar
Halifax--lad
Established Member
Posts: 228
Joined: Sat Sep 10, 2005 11:27 pm

Post by Halifax--lad » Thu Apr 20, 2006 6:48 pm

Good luck hope if works.

Fingers crossed :lol:
Join us in Chat (see the forum) Click the Sig
Image

Neil
Site Admin
Posts: 1349
Joined: Mon Apr 18, 2005 8:35 pm
Location: UK
Contact:

Post by Neil » Fri Apr 21, 2006 12:32 pm

James, the man behind mirror no. 10 has kindly offered to trial my workaround for XtremLab and I'm happy to report that it's working a treat and that the stats are now updating automatically.

:-)

Neil.

User avatar
Halifax--lad
Established Member
Posts: 228
Joined: Sat Sep 10, 2005 11:27 pm

Post by Halifax--lad » Fri Apr 21, 2006 10:10 pm

Very good, problem solved for now then :lol: hope nothing goes wrong with it
Join us in Chat (see the forum) Click the Sig
Image

kiribati
New Member
Posts: 2
Joined: Thu May 11, 2006 4:28 pm

Post by kiribati » Thu May 11, 2006 4:36 pm

Neil wrote:... and I'm happy to report that it's working a treat and that the stats are now updating automatically...
how to add XtremLab to the All-In-One counter?¿?
I try it since 2 days but all I see is:
Could not connect to XtremLab server, please try again. (Hit refresh)

thx

Post Reply