Official eMule-Board: How Much Sever Bandwith Is Needed? - Official eMule-Board

Jump to content


  • (2 Pages)
  • +
  • 1
  • 2

How Much Sever Bandwith Is Needed? Razorback 2

#21 User is offline   lugdunummaster 

  • Golden eMule
  • PipPipPipPipPipPipPip
  • Group: Member_D
  • Posts: 1040
  • Joined: 19-September 02

Posted 30 December 2004 - 05:19 PM

Quote

13 kb per each connected client?


:) You tell us...

Ever heared about TCP stack memory usage ? Operating System internals ?

On razorback eserver itself uses 7 GB, linux uses 5 GB
0

#22 User is offline   asturcon3 

  • Miembro con bola
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 7487
  • Joined: 26-July 04

Posted 30 December 2004 - 05:42 PM

I do. Thanks :+1:
Posted Image Posted Image Posted Image
0

#23 User is offline   Devil Doll 

  • feature request writer
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 2570
  • Joined: 19-February 04

Posted 30 December 2004 - 06:27 PM

asturcon3, on Dec 30 2004, 05:04 PM, said:

13 kb per each connected client? :shock:  Sure you store the IP, the share list and some stats of each client, but 13kb still seems too much to me...  :confused:
Let's see... 7 GB RAM for 115 millions of file descriptions (they appear to be the dynamic part of the equation, let's just ignore the users) would mean 65 bytes per file description. 16 bytes is the file hash alone, and somewhere the complete file name (in multiple instances! Everyone may rename a file and share it with their own name - I'm doing this for all my shares as to provide more search-friendly names) has to be stored as well (probably in some hash tree?). Amazing - I would have expected an even worse scenario.

And Razorback has a softlimit of 5000 shares per client, although the average client only shares 125 files. I wonder whether lowering the softlimit would allow more users with reasonable shares to connect to this machine... I'd be fine with 500, for example. (EDIT: slugfiller, please forgive me for possibly stepping on your toes - I just read that complete wonderful thread that gcostanza linked below.)

This post has been edited by Devil Doll: 30 December 2004 - 09:45 PM

0

#24 User is offline   gcostanza 

  • Philosopher
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 805
  • Joined: 10-October 04

Posted 30 December 2004 - 06:43 PM

My calculations just got confused. Something has surely changed :confused:
In this thread which I think definitely belongs to the All Time Hall Of Fame of the forum lugdunummaster says the memory cost for a published file is 168 bytes (skip to page 5 but definitely worth reading all). If it were true that now it takes only 65 bytes that's a huge improvement. :xmas:
"Computer Science is no more about computers than astronomy is about telescopes."
-- E. W. Dijkstra
"Computers are useless. They can only give you answers."
-- Pablo Picasso
0

#25 User is offline   GreatInca 

  • Jesus Freak
  • PipPipPipPip
  • Group: Members
  • Posts: 189
  • Joined: 20-September 04

Posted 31 December 2004 - 12:19 AM

How does Eserver get to be able to address more than 4GB anyway? 64bit processor/OS? I know 32bit SQLServer PCs can be decked out to 64GB if microsoft is paid really well.

What creates the 12GB limitation anyway? Money? Slots on the MoBo vs. econonomicly prices StickSizes? OS Limit?

A GigStick of El Cheepo RAM can be had for around $100. Gaming grade RAM is still over $200 for a GiGStick.

This post has been edited by GreatInca: 31 December 2004 - 12:21 AM

0

#26 User is offline   Andu 

  • Morph Team
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 13015
  • Joined: 04-December 02

Posted 31 December 2004 - 08:29 AM

Razorback2 is a dual Opteron as far as I know on a 64Bit Linux distribution. And since it was upgraded from 8GB in the beginning I guess it's a matter of cash rather than anything else that prevents the RAM from being upgraded. Remember this is not your average low cost RAM it's specially designed for server use.
Three Rings for the Elven-kings under the sky,
Seven for the Dwarf-lords in their halls of stone,
Nine for Mortal Men doomed to die,
One for the Dark Lord on his dark throne
In the Land of Mordor where the Shadows lie.
One Ring to rule them all, One Ring to find them,
One Ring to bring them all and in the darkness bind them
In the Land of Mordor where the Shadows lie.


Dark Lord of the Forum


Morph your Mule

Need a little help with your MorphXT? Click here

0

#27 User is offline   lugdunummaster 

  • Golden eMule
  • PipPipPipPipPipPipPip
  • Group: Member_D
  • Posts: 1040
  • Joined: 19-September 02

Posted 31 December 2004 - 09:56 AM

Currently, razorback has 2 Opterons 248 CPUS.

The motherboard has 4 ECC ram slots for each cpu.

On the first cpu, 4 2GB ram modules (PC3200)
On the 2nd cpu, 4 1GB ram modules (PC2100 , coming from old razorback1 server)

At the very begining, razorback ram was 8 x 1GB modules

Yesterday, bile666 decided to replace the old 4x1GB modules by new ones (4x2GB), so razorback2 ram is going from 12GB to 16GB soon.

One 2GB ECC ram module cost about 900 $

About number of bytes per file, dont forget that one unique file may be shared by many clients.

So, for 107845615 'files' means 38013696 'unique hashes'

The server has various objects in memory :

- One for the 'unique file" (containing the hash, and various attributes, including filename)
- One for each share of a client
- One for each client
- Various ones for the indexes (to be able to perform fast searches)


On razorback, the program is a native 64bits program (x86_64), so it can address a *lot* of ram.
0

#28 User is offline   cyhyryiys 

  • Eselhirte seit 2001
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 640
  • Joined: 26-December 02

Posted 31 December 2004 - 10:17 AM

Is this server only financed by donations and advertisement or do the owners of this ed2k-server put in their own money? I think a server with such big and expensive hardware must have an economical reason for its operators.
0

#29 User is offline   Devil Doll 

  • feature request writer
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 2570
  • Joined: 19-February 04

Posted 01 January 2005 - 02:14 AM

lugdunummaster, on Dec 31 2004, 09:56 AM, said:

About number of bytes per file, dont forget that one unique file may be shared by many clients. So, for 107845615 'files' means 38013696 'unique hashes'
But shouldn't eserver then report the "unique hashes" to the client (eMule: Server / column "files"), not the "files"? (Or perhaps both?)

For the purpose of searching I'd be much more interested in the unique hashes (that's what I'd probably make manual connecting depend on); a server with more "files" would perhaps give me more sources when I ask for these but I'd find enough sources via client source exchange already.

lugdunummaster, on Dec 31 2004, 09:56 AM, said:

The server has various objects in memory :
- One for the 'unique file" (containing the hash, and various attributes, including filename)
What about different file names for the same file? When I search on an eserver with my eMule the results can contain more than one file name for a file hash; is this "group by" mechanism done on eserver already or does my client handle this when receiving the same file hash multiple times?
0

#30 User is offline   LuBaihu 

  • Member
  • PipPip
  • Group: Members
  • Posts: 25
  • Joined: 05-November 04

Posted 12 January 2005 - 12:29 PM

Quote

1/12/2005 7:33:37 AM: Connecting to Razorback 2 (195.245.244.243:4661)...
1/12/2005 7:33:58 AM: Razorback 2 (195.245.244.243:4661) appears to be dead.
WHAT THE ...
0

#31 User is offline   asturcon3 

  • Miembro con bola
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 7487
  • Joined: 26-July 04

Posted 12 January 2005 - 01:13 PM

LuBaihu, on Jan 12 2005, 01:29 PM, said:

Quote

1/12/2005 7:33:37 AM: Connecting to Razorback 2 (195.245.244.243:4661)...
1/12/2005 7:33:58 AM: Razorback 2 (195.245.244.243:4661) appears to be dead.
WHAT THE ...
View Post

One post is enought http://forum.emule-p...showtopic=68931 <_<
Posted Image Posted Image Posted Image
0

#32 User is offline   buzz 

  • Golden eMule
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 860
  • Joined: 25-December 02

Posted 12 January 2005 - 04:19 PM

Devil Doll, on Jan 1 2005, 02:14 AM, said:

What about different file names for the same file? When I search on an eserver with my eMule the results can contain more than one file name for a file hash; is this "group by" mechanism done on eserver already or does my client handle this when receiving the same file hash multiple times?
View Post


AFAIR eServer stores only the first filename for a published file hash. Additional sources are only added to "sources".

The group by is done by on the client side. eMule groups files that have the same hash but different filenames. This happens only on GLOBAL search, if some servers have indexed another filename first....
0

#33 User is offline   dudeman456 

  • Advanced Member
  • PipPipPip
  • Group: Members
  • Posts: 91
  • Joined: 19-January 03

Posted 12 January 2005 - 04:56 PM

Its fine from my side, it has been displaying some strange behavior lately, but everytime I've tried its been active.

LuBaihu, on Jan 12 2005, 12:29 PM, said:

Quote

1/12/2005 7:33:37 AM: Connecting to Razorback 2 (195.245.244.243:4661)...
1/12/2005 7:33:58 AM: Razorback 2 (195.245.244.243:4661) appears to be dead.
WHAT THE ...
View Post

0

  • Member Options

  • (2 Pages)
  • +
  • 1
  • 2

1 User(s) are reading this topic
0 members, 1 guests, 0 anonymous users