It's All About The Hardware

Posted in

#1 by yorhel
2012-07-14 at 06:51
Hello my dear friends (Yes, you. You're my friend, right?),

VNDB has been getting a bit sluggish lately, in terms of response times that is. Now there are several ways I can optimize the database backend and code, but those take effort. Instead, I've decided to dump our old server and host VNDB on something more shiny.

I've ordered a new dedicated server with the following specs:
CPU: I5-2300 CPU @ 2.80GHz
RAM: 16GB
HDD: 2TB
BW: 10TB/month
I was initially planning to order this box, but then found out that Hetzner.de doesn't want its clients to host erotic content. (WHY!?) So instead I decided to go with OVH this time.

For comparison, the server that has hosted VNDB for all these years and is now going to be replaced has the following specs:
CPU: Intel(R) Pentium(R) D CPU 2.80GHz
RAM: 1.5GB
HDD: 80GB
BW: 500GB/month*
It's been almost 6 years now since I bought that box, it's been holding out surprisingly long.
*) The static files of VNDB are currently proxied and cached through another server, because 500GB/month wasn't enough. This won't be necessary with the new server.


I've currently installed the OS and will transfer everything sometime this week. There may be some minor downtime, but I'll keep you updated on the progress.

-- UPDATE --
I'll put VNDB into read-only mode in a bit, meaning that you will appear to be logged out, and you won't be able to register a new account or login for short period. I'll then migrate the database to the new server, update the DNS, and put the VNDB on the new server out of read-only mode.

tl;dr: I'm moving the site, so don't be surprised when you can't login for a while.

-- UPDATE #2 --
Transfer done. If you can read this it means you're already connected to the new server. If you notice any issues (e.g. image uploading not working, that kind of stuff), please notify me!Last modified on 2012-07-15 at 08:38
#2 by pendelhaven
2012-07-14 at 07:50
CPU: Intel(R) Pentium(R) D CPU 2.80GHz

Oh god. This processor has a TDP of 95watts for a very poor performance. At least most, if not all processors that are dual core and higher are at 65W and, yeah, overall performance is better. Good decision.Last modified on 2012-07-14 at 07:51
#3 by justinizhere
2012-07-14 at 08:39
There may be some minor downtime

end of the world!
#4 by assassinator
2012-07-14 at 08:45
Oh god. This processor has a TDP of 95watts for a very poor performance. At least most, if not all processors that are dual core and higher are at 65W and, yeah, overall performance is better. Good decision.

I don't know what you're getting at here.

1. Power consumption is definitely not at the top of the priority list when choosing servers. In fact, you aren't paying the power bills, the hosting company is.
2. One of the earliest dual core CPUs has worse performance/power ratio than more modern dual core CPUs.... I'm sure this is a giant surprise to everyone.Last modified on 2012-07-14 at 08:54
#5 by pendelhaven
2012-07-14 at 09:07
1. Power consumption is definitely not at the top of the priority list when choosing servers. In fact, you aren't paying the power bills, the hosting company is.

If Yorhel is renting a server, true. I assumed that Yorhel is running on his own server.

2. One of the earliest dual core CPUs has worse performance/power ratio than more modern dual core CPUs.... I'm sure this is a giant surprise to everyone.

This can be also said in other processors. Like the first batch of Sandy Bridge processors had. But yeah. Point taken.Last modified on 2012-07-14 at 09:09
#6 by battlesheep
2012-07-14 at 13:21
Hmm, upgrades! :)
#7 by harrstein
2012-07-14 at 17:45
[qoute]1. Power consumption is definitely not at the top of the priority list when choosing servers. In fact, you aren't paying the power bills, the hosting company is.

If Yorhel is renting a server, true. I assumed that Yorhel is running on his own server.
[/quote]

seeing he has to buy bandwidth i assume he is on a co-location. so his own server. but located at a hoster.

most of the time the hoster only bills you in bandwidth and you get a 10 amp connection for your power
#8 by overmage
2012-07-14 at 18:11
Wow, I'm more surprised that we're holding out so well on something so old.
#9 by klutch
2012-07-15 at 00:40
You should have reached out to the community before purchasing. If we heard of this a few weeks earlier, I could have offered to partition my cluster and host for you!

I recommended against the i5 in favor of a xeon/opteron instead. Economy class logical processors are not designed with server hosting in mind.

The last cluster I owned back in 2007 (DL140) ran L5320s. Nowadays, that would run you at maximum $300 and has a far more efficient power consumption as a 2x quad than compared to a dual core.Last modified on 2012-07-15 at 00:54
#10 by tokizo
2012-07-15 at 04:57
Good to know, thank you my comrade.
#11 by yorhel
2012-07-15 at 06:37
@kluch: Find me an offer with real server hardware with resources comparable to the dedicated server I just got, and for max. 50 €/month. I realize that customer-grade hardware isn't the best for server-usage, but my experiences with those have so far been quite positive nonetheless, and considering the price I'm more than willing to take the risk. Price is more important than reliability and uptime for a poor student like me. :-)

To clear up some other confusion: My old server is a colocated one, so I own that box and pay for power usage, bandwidth and server room stuff. The new box is dedicated, so I rent the box itself and the hosting. Since the overall price includes power usage, I don't really care about how power-efficient the CPU is.Last modified on 2012-07-15 at 07:03
#12 by klutch
2012-07-15 at 07:42
@kluch: Find me an offer with real server hardware with resources comparable to the dedicated server I just got, and for max. 50 €/month. I realize that customer-grade hardware isn't the best for server-usage, but my experiences with those have so far been quite positive nonetheless, and considering the price I'm more than willing to take the risk. Price is more important than reliability and uptime for a poor student like me. :-)

To clear up some other confusion: My old server is a colocated one, so I own that box and pay for power usage, bandwidth and server room stuff. The new box is dedicated, so I rent the box itself and the hosting. Since the overall price includes power usage, I don't really care about how power-efficient the CPU is.

I hadn't realized you were on a budget. $60/month (that's like 50€, right?) for an inclusive contract, that's not bad at all. Additionally, if you negotiated a managed contract (I hope you did) hardware failure and maintenance would be the liability of your provider.

But in the broad-view of things, I doubt hosting vndb is extremely taxing so it should be fine.
#13 by yorhel
2012-07-15 at 08:49
Okay, VNDB transfer complete. Everything is running as usual again, hopefully.

Additionally, if you negotiated a managed contract (I hope you did) hardware failure and maintenance would be the liability of your provider.
Of course, hardware issues are their responsibility. :-)
(Software issues aren't, and I'm damn happy with that because I *want* to do software myself :D)
#14 by arkady18
2012-07-15 at 10:59
Okay, VNDB transfer complete. Everything is running as usual again, hopefully.
Actually, VNDB has started running as usual for me only since a few minutes ago. Two or three minutes ago I couldn't login and the last post in this discussion was #12 (and this discussion wasn't updated).

Anyways, it seems that the specs of the new hardware are way better than the old one's.^^
#15 by gabezhul
2012-07-15 at 11:44
Hm... Say what you want, I expected that new server would at least give us free ice-cream on the first login or something. I am disappoint. :P
#16 by pendelhaven
2012-07-15 at 17:16
It's All About The Hardware
It had always been about the hardware.

I *want* to do software myself
What software? It's as fine as it gets. If I would have a single complaint, it would be that it's not troll-friendly and n00b-friendly.
#17 by horseband
2012-07-15 at 23:23
@pendel..

Software can always be improved. Likewise VNDB can be improved both frontend and backend. Neither are perfect.

I can program and it's a never ending cycle of optimization, fixing things, and adding new features.Last modified on 2012-07-15 at 23:24
#18 by yorhel
2012-07-16 at 08:17
Okay, some migration stats.

2-day CPU graph of the old server versus the new server. DNS took longer to update than I had expected. On the old server I had VNDB running behind a proxy that caches several pages, which decreased CPU usage by around 40% back when I configured that. On the new server I haven't configured that yet, so all pages are generated on the fly and CPU usage is a bit higher than necessary. But still significantly lower than with the old server. :-)

Oh, and other than the login being disabled for a while, there has been no downtime.Last modified on 2012-07-16 at 08:31
#19 by pendelhaven
2012-07-16 at 14:52
On the new server I haven't configured that yet, so all pages are generated on the fly and CPU usage is a bit higher than necessary. But still significantly lower than with the old server. :-)

Nice improvement even though you haven't proxy'd yet. I'd imagine another less 40% on CPU usage when you proxy with the new server. Or wait, you're renting the server, right?

there has been no downtime.

Brofist.
#20 by adhinferno
2012-07-19 at 10:07
Mayan Apocalypse is faster than predicted....
2012 = New VNDB Server = New Era
Yeah~ (^0^)/"
#21 by usagi
2012-07-19 at 19:27
It's strange but now, just after transfering to new hardware when I go to vndb - it's something like this:
[IMG]http://i41.fastpic.ru/thumb/2012/0719/c9/0333a301c09e7bb0b69abd6bcb3ee4c9.jpeg[/IMG]
Refresh does not help. And couple of days already passed..
#22 by yorhel
2012-07-19 at 19:35
@usagi: t635 -> Remove that line from your hosts file again, if you still have it.
#23 by horseband
2012-07-19 at 19:36
what browser is that? What os do you have? Are you using any browser addons?

Edit: Damn yorhel has a good memory.Last modified on 2012-07-19 at 19:36
#24 by usagi
2012-07-19 at 19:44
Remove that line from your hosts file again, if you still have it.
I never added any lines to my hosts file.
what browser is that? What os do you have? Are you using any browser addons?
Google Chrome. WinXP SP3. Without addons.

EDIT: never mind. Sorry, I just checked hosts file and it seems that I forgot that somehow sometime I added one line there 0_0 Now I removed it and all works like it should ^_^
P.S.: I've just read that link (it was hard to notice with screwed html code).. oops )) How could I forget it? 0_0 )))Last modified on 2012-07-19 at 20:03
#25 by kelpie
2012-07-19 at 21:06
Quite a big upgrade! I've been looking at the state of hardware lately, and really things have changed. It's like living in the future.

P.S.: I've just read that link (it was hard to notice with screwed html code).. oops )) How could I forget it? 0_0 )))
usagi, we did warn you, after all.

Reply

You must be logged in to reply to this thread.