Sharing my growth in the datacenter

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

Yarik Dot

Active Member
Apr 13, 2015
220
110
43
47
We are about to put another customer to our platform:

cdn.jpg

Configuration (top down):
  • 4x 1U E3-1230v5, 1x 120GB SSD, 16GB RAM - video processing servers
  • 1x 1U E3-1230v5, 4x 480GB SSD, 64GB RAM - management server
  • 1x 2U 2x E5-2620v4, 24x240GB SSD + 2x120GB SSD system, 256GB RAM - proxy cache server with 4x10Gbps uplink
  • 1x 4U E3-1230v5, 36x 6TB + 2x120GB SSD system, 64GB RAM - storage
Unfortunately, there are no drives yet - the systems has been just prepared to get them to DC, which means we just noted their mac addresses and checked if they worked. All other instalation will be done remotely when they are racked. Just waiting for drives to arrive.
 
Last edited:

maze

Active Member
Apr 27, 2013
576
100
43
What does a "proxy cache server" do exactly in this case? - seems like a serious amount of juice and 4x10gig uplink capacity is quite hefty aswell :)
 

cheezehead

Active Member
Sep 23, 2012
723
175
43
Midwest, US
What does a "proxy cache server" do exactly in this case? - seems like a serious amount of juice and 4x10gig uplink capacity is quite hefty aswell :)
From similar setups I've seen it basically front-ends the storage server taking the bulk of hits from clients.
 

Yarik Dot

Active Member
Apr 13, 2015
220
110
43
47
Just a small update. We have finaly started our 3rd rack housing (5th location - 2 locations are only with several servers in shared racks).

Sorry for the picture quality, there is poor light and I didn't have my camera with me.

WP_20170413_23_58_07_Pro.jpg WP_20170413_23_58_23_Pro.jpg

So current situation is:

First datacenter - whole rack (we are going to migrate to 1/4 as we are not able to put anything there due high traffic costs). Long term goal is to terminate contract there and move it to new location.

Second datacenter - currently 1/2 rack, which is completely full.

Third datacenter - still some space to spare. However I hope I will fill it with some stuff soon.
 

Jerry Renwick

Active Member
Aug 7, 2014
200
36
28
43
It is so nice of you to record what you have done in the past few years. will share it with others
 

Yarik Dot

Active Member
Apr 13, 2015
220
110
43
47
Our new location (where we are probably going to migrate everything except backup) is getting ready. We became LIR within RIPE NCC, so we have our own IP addresses. And work on testing our 10G core switches.

Goal is simple: Have up to 80G redundant uplink (160G non redundant), every storage server connected with redundant 10G, every normal server with single or dual 1G uplink to Nexus 3000 switches (we will test them later, but we already have them ready for testing).

More pictures are about to be posted as soon as everything is racked, labeled and running. I will consider posting some migration photos.

Ouh by the way, Arista switches are something I have been very surprised of. Very well written documentation and everything works on first attempt.

DSC_0847.JPG
 
Last edited:

ELit3

Banned
Aug 10, 2017
309
24
18
40
Texas
Our new location (where we are probably going to migrate everything except backup) is getting ready. We have become LIR within RIPE NCC, so we have our own IP addresses. And we are currently working on testing our 10G core switches.

Goal is simple: Have up to 80G redundant uplink (160G non redundant), every storage server connected with redundant 10G, every normal server with single or dual 1G uplink to Nexus 3000 switches (we will test them later, but we already have them ready for testing).

More pictures are about to be posted as soon as everything is racked, labeled a running. I will consider posting some migration photos.

Ouh by the way, Arista switches are something I have been very surprised of. Very well written documentation and everything works on first attempt.

View attachment 6392
What aristas are you using do they require licenses?
 

Yarik Dot

Active Member
Apr 13, 2015
220
110
43
47
Another location and another rack. This time with aristas we mentioned before.

Total cabeling time: 7 hours. Power cables are unfortunately ****ed, becase we did not plan it properly. :(

Nevertheless, rack is redundant 10G ready. :)

DSC_0993.JPG DSC_1001.JPG DSC_1004.JPG DSC_1007.JPG DSC_1008.JPG