multiple rps [Archive]

elvis1

11-09-2009, 07:06

how about of making use of em using a CP like webmin and using each rps as a slave?

Neil

08-09-2009, 17:48

Hi

No problem, will propose it though. I do not think NFS can do it, but maybe GFS.

elvis1

08-09-2009, 17:16

thanks neil! your help is appreciated

Neil

08-09-2009, 16:51

I am afraid you cannot join RPS's together even with NFS, but it is an interesting suggestion so I will put it forward.

elvis1

08-09-2009, 15:02

thanks neil! is there any way to join various rps in one? something like proxmox would do the job?

Neil

08-09-2009, 10:03

Hi

Sorry I am not sure what you need to know? I have been reading and see some interesting things going with S3, the only thing I can confirm right now is that we do not offer NFS on new RPS's.

elvis1

08-09-2009, 02:11

can someone from the staff clear out the nfs type and access please?

elvis1

03-09-2009, 01:16

Originally Posted by unclebob

If you just mount the s3 as storage on your RPS (I use s3fs from http://code.google.com/p/s3fs/wiki/FuseOverAmazon), you would be using OVH's network and Amazon solely for storage (not their EC2 VPS service). There would be no torrent traffic through Amazon's network at all

I also would prefer unlimited usage for a monthly charge but S3 is only slightly more expensive than additional iSCSI space, so paying for what you use isn't that bad. And its faster than the ~1MB/s on the standard plans

very f.. clever

Thanks

unclebob

02-09-2009, 21:59

Originally Posted by elvis1

very good option.. the fact is that I can t use amazon s3 24/7 worry free and I doubt they allow torrent traffic in their net at all.. I also dont like the idea of paying for what I use ( I do like it for testing of apps and related stuff) in this case..

If you just mount the s3 as storage on your RPS (I use s3fs from http://code.google.com/p/s3fs/wiki/FuseOverAmazon), you would be using OVH's network and Amazon solely for storage (not their EC2 VPS service). There would be no torrent traffic through Amazon's network at all

I also would prefer unlimited usage for a monthly charge but S3 is only slightly more expensive than additional iSCSI space, so paying for what you use isn't that bad. And its faster than the ~1MB/s on the standard plans

elvis1

02-09-2009, 21:27

Originally Posted by unclebob

I get better throughput to an Amazon S3 bucket than the OVH iSCSI arrays. If it's just files storage then that could be an option...?

very good option.. the fact is that I can t use amazon s3 24/7 worry free and I doubt they allow torrent traffic in their net at all.. I also dont like the idea of paying for what I use ( I do like it for testing of apps and related stuff) in this case..

unclebob

02-09-2009, 20:08

I get better throughput to an Amazon S3 bucket than the OVH iSCSI arrays. If it's just files storage then that could be an option...?

Myatu

02-09-2009, 16:49

Hmmf. So I guess you could setup an NFS server on one of the RPSes, but whether that's a good idea is debatable.

unclebob

02-09-2009, 16:17

Originally Posted by derchris

iSCSI authenticates by a CHAP password.
So it is possible to add it to more then 1 system.
But if i remember someone here already asked for the user/pass details, and was denied by OVH.

Yeah, that person was me

Although iSCSI can be authenticated via CHAP, OVH's implementation doesn't. You can see this when you extract the iSCSI config files from the initial RAM disk. So unfortunately you can't access the same iSCSI target directly from more than one RPS

derchris

02-09-2009, 11:34

iSCSI authenticates by a CHAP password.
So it is possible to add it to more then 1 system.
But if i remember someone here already asked for the user/pass details, and was denied by OVH.

unclebob

02-09-2009, 10:21

Correct me if I'm wrong, but I don't think it is possible any more... Multiple RPS can mount the same NFS drive, but iirc NFS is not available any more. iSCSI authenticates by MAC or IP address (I forget which) and does not allow multiple iSCSI 'clients' to mount the same iSCSI disk simultaneously.

elvis1

02-09-2009, 05:30

Originally Posted by Myatu

I'm digging into this, as it's interesting Do you have a "/etc/iscsi/nodes/" directory?

I dont currently own an rps.. I share a kimmy with a friend of mine and I would like to have some independence and have the peace of mind of not being able to mess with his stuff in wost case scenario

Many thanks Myatu! Your knowledge is extremely helpful ! I would love any of the reps (Neil, Marks, Sophie) to be in the forums in a more proactive way

NickW

02-09-2009, 00:53

I made the assumption that because people were wget testing it, it was from OVH.

Myatu

01-09-2009, 20:24

Originally Posted by elvis1

how about the original topic?

I'm digging into this, as it's interesting Do you have a "/etc/iscsi/nodes/" directory?

elvis1

01-09-2009, 19:53

how about the original topic?

elvis1

01-09-2009, 19:52

Originally Posted by NickW

Woah, I just got this:

VPS in Dallas, US:

VPS in Chicago, US:

Epic speeds from OVH to America?

dude, cachefly has servers all over the globe ( specially in the US)...I cant figure where OVH would be involved as you say to be using US VPS s

EDIT: just saw this has already been stated

NickW

01-09-2009, 14:34

Originally Posted by Myatu

So Dallas just got about 2.8 Mb/s faster... Weeeh!

Yeah, and then we realise the file is not OVH hosted, it's in America.

Myatu

01-09-2009, 14:32

So Dallas just got about 2.8 Mb/s faster... Weeeh!

NickW

01-09-2009, 14:13

Originally Posted by Myatu

Use "-O /dev/null". If your VPS/RPS has only one NIC and it uses a SAN storage (iSCSI, NFS, GFS, etc., etc.), then you're sharing bandwidth on the NIC for both the download and to save the file on the SAN storage. If you /dev/null it, it simply disappears in a big black hole... Even in Full Duplex, you'll notice the difference

Got 10.8MB/s average in Chicago and 10.0MB/s average in Dallas with that .

Edit: Just did it again and got 11.0 and 10.2

Myatu

01-09-2009, 14:08

Originally Posted by NickW

Epic speeds from OVH to America?

Use "-O /dev/null". If your VPS/RPS has only one NIC and it uses a SAN storage (iSCSI, NFS, GFS, etc., etc.), then you're sharing bandwidth on the NIC for both the download and to save the file on the SAN storage. If you /dev/null it, it simply disappears in a big black hole... Even in Full Duplex, you'll notice the difference

NickW

01-09-2009, 13:50

Woah, I just got this:

VPS in Dallas, US:

wget http://cachefly.cachefly.net/100mb.test
--05:49:46-- http://cachefly.cachefly.net/100mb.test
Resolving cachefly.cachefly.net... 205.234.175.175
Connecting to cachefly.cachefly.net|205.234.175.175|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 104857600 (100M) [application/octet-stream]
Saving to: `100mb.test'

100%[=======================================>] 104,857,600 7.05M/s in 14s

05:49:59 (7.40 MB/s) - `100mb.test' saved [104857600/104857600]

VPS in Chicago, US:

wget http://cachefly.cachefly.net/100mb.test
--16:49:51-- http://cachefly.cachefly.net/100mb.test
Resolving cachefly.cachefly.net... 205.234.175.175
Connecting to cachefly.cachefly.net|205.234.175.175|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 104857600 (100M) [application/octet-stream]
Saving to: `100mb.test'

100%[=======================================>] 104,857,600 10.6M/s in 9.6s

16:50:01 (10.4 MB/s) - `100mb.test' saved [104857600/104857600]

Epic speeds from OVH to America?

RikT

01-09-2009, 13:49

Originally Posted by derchris

Maybe.
Can someone who owns a RPS run a 'ethtool eth0' and post the output.
Then we know how they are connected.

There you go

Code:

r26631:~# ethtool eth0
Settings for eth0:
        Supported ports: [ TP ]
        Supported link modes:   10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Full
        Supports auto-negotiation: Yes
        Advertised link modes:  10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Full
        Advertised auto-negotiation: Yes
        Speed: 100Mb/s
        Duplex: Full
        Port: Twisted Pair
        PHYAD: 0
        Transceiver: internal
        Auto-negotiation: on
        Supports Wake-on: pumbg
        Wake-on: g
        Current message level: 0x00000033 (51)
        Link detected: yes

gigabit

01-09-2009, 13:48

Nothing special there...

Code:

Settings for eth0:
        Supported ports: [ TP MII ]
        Supported link modes:   10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
        Supports auto-negotiation: Yes
        Advertised link modes:  10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
        Advertised auto-negotiation: Yes
        Speed: 100Mb/s
        Duplex: Full
        Port: MII
        PHYAD: 0
        Transceiver: internal
        Auto-negotiation: on
        Supports Wake-on: pumbg
        Wake-on: g
        Current message level: 0x00000033 (51)
        Link detected: yes

derchris

01-09-2009, 13:39

Maybe.
Can someone who owns a RPS run a 'ethtool eth0' and post the output.
Then we know how they are connected.

DedicatedPros

01-09-2009, 12:57

Originally Posted by derchris

Yes, I'm on Gbit.
But if the machine we tested from is a RPS, and it doesn't fit with your answer about RPS only have 100mbit port.
Because I was able to get about 420mbit looking at my wget stats.

Maybe the RPS servers share an internal 1Gbit connection, so at times they will burst above their allotted 100Mbit limit (which OVH does not block as its free bandwith, and it works out better for the client)

derchris

01-09-2009, 12:50

Yes, I'm on Gbit.
But if the machine we tested from is a RPS, and it doesn't fit with your answer about RPS only have 100mbit port.
Because I was able to get about 420mbit looking at my wget stats.

unclebob

01-09-2009, 10:55

RPSs only have a 100mbit port, so the maximum you'll be able to get is ~11.2MB/s. Derchris must have a dedicated server with a gigabit port

Also, remember that write speeds to the iSCSI hard drive are only guaranteed at 1MB/s, unless you get the "Premium" or "Business" plans. So although data can be stored in RAM at 11MB/s, it can't be transferred to the hard drive at this speed.

elvis1

01-09-2009, 06:27

are those speeds an internal joke (using high end hardware) and pulling my leg or can a rps do 42MB/s????

11 is :O and 42 is please dont sh.. me :P

Myatu

30-08-2009, 07:16

No fair! :P

derchris

30-08-2009, 07:02

Mine is faster

Code:

# wget http://cachefly.cachefly.net/100mb.test -O /dev/null
--2009-08-30 07:00:03--  http://cachefly.cachefly.net/100mb.test
Resolving cachefly.cachefly.net... 205.234.175.175
Connecting to cachefly.cachefly.net|205.234.175.175|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 104857600 (100M) [application/octet-stream]
Saving to: `/dev/null'

100%[===================================================================================>] 104,857,600 42.7M/s   in 2.3s

2009-08-30 07:00:05 (42.7 MB/s) - `/dev/null' saved [104857600/104857600]

Myatu

30-08-2009, 06:58

Originally Posted by elvis1

Waiting for ovh to confim

Can someone please post results of this:

http://cachefly.cachefly.net/100mb.test

Code:

# wget http://cachefly.cachefly.net/100mb.test -O /dev/null
--2009-08-30 06:59:39--  http://cachefly.cachefly.net/100mb.test
Resolving cachefly.cachefly.net... 205.234.175.175
Connecting to cachefly.cachefly.net|205.234.175.175|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 104857600 (100M) [application/octet-stream]
Saving to: `/dev/null'

100%[===============================================>] 104,857,600 11.2M/s   in 9.0s

2009-08-30 06:59:53 (11.1 MB/s) - `/dev/null' saved [104857600/104857600]

elvis1

30-08-2009, 04:28

Originally Posted by gigabit

What are you on about? The RPSes all have 100Mbit unlimited... Nothing has changed for them.

mj12 node, vpn, image galleries, file hosting, torrent ( only legal stuff), web hosting and some others

gigabit

30-08-2009, 02:25

Originally Posted by elvis1

off topic: is there any monthly cap ( does the new bandwidth caps affect rps at all?) besides the 8Mbps/2.5 tb ?

What are you on about? The RPSes all have 100Mbit unlimited... Nothing has changed for them.

derchris

29-08-2009, 23:58

Originally Posted by gigabit

It probably wont be the root system mounted, just another partition/drive shared like /home

That makes more sense, and what NFS is good for.
To have a FS available over the network.

Though I don't like the approach of OVH and how they are realising it (ZFS), but that is a totaly different story

elvis1

29-08-2009, 23:20

off topic: is there any monthly cap ( does the new bandwidth caps affect rps at all?) besides the 8Mbps/2.5 tb ?

elvis1

29-08-2009, 23:15

Originally Posted by gigabit

If it was a bad idea or impossible Oles wouldn't have said they were going to do it. I just don't think they've done it yet.

Waiting for ovh to confim

Can someone please post results of this:

http://cachefly.cachefly.net/100mb.test

gigabit

29-08-2009, 23:09

It probably wont be the root system mounted, just another partition/drive shared like /home

derchris

29-08-2009, 22:47

Just because he posted it doesn't mean it is a good idea.
NFS is not known for its security precautions.
And mounting the Root partition on another system is, and always will be, a bad idea.

gigabit

29-08-2009, 22:17

If it was a bad idea or impossible Oles wouldn't have said they were going to do it. I just don't think they've done it yet.

derchris

29-08-2009, 22:08

I would say impossible.
Don't know how RPS are working, but it sounds like that the root partition is Mounted via NFS?
If this is the case, then hopefully OVH has setup access restrictions on the NFS shares. Otherwise you would be able to mount any share you want.
The other problem I see is, as you quoted, that it should be possible to mount the SAEM NFS on more then one box.
In general I don't see a problem with that, as thats what NFS is for.
But if my first statement is try about the root partition, then this is a very bad idea.
All node would be writing to the same root partition.

elvis1

29-08-2009, 21:11

Hi I would like to know how to set up multiple RPS acting as one.

I recall

unclebob
11-04-2008, 04:27 PM
Another advantage of NFS is that we can use it with 2 or 3 RPS. That means that the same NFS partition is mountable on as many RPS in parallel as you want and they are automatically identical! It is therefore possible to make RPS clusters very easily and almost automatically in 1 click. With the loadbalancing IP, you can create a cluster in a few minutes with 10 RPS.

Now *that* is cool. Can this be achieved without re-installing the RPS?

But I cant figure out how I can do it.

Thanks in advance