Official eMule-Board: Kad Explained In Detail - Official eMule-Board

Jump to content


  • (2 Pages)
  • +
  • 1
  • 2

Kad Explained In Detail How does it work?

#1 User is offline   V9RT5 

  • Newbie
  • Pip
  • Group: Members
  • Posts: 3
  • Joined: 31-March 06

Posted 31 March 2006 - 11:47 AM

I have e-mule working fine and read all I could about KAD but still don't understand the advantage of it.
KAD is open and Buddy: connected but I don't seem to be getting more uploads because of it.
Occasionally a name appears under "current searches". Is it a user uploading or downloading like in the "transfers" window? If so, what is he uploading or downloading?
Is there a detailed guide that explains all this? I can't find one, only general stuff telling you how to connect to KAD.
Thanks
Pedro
0

#2 User is offline   jestheonlyone 

  • Golden eMule
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 4346
  • Joined: 18-July 04

Posted 31 March 2006 - 12:11 PM

hi

kad is an alternative to ed2k servers. (have you ever heard about fake servers? or razorback being closed?)
kad is a serverless network; this means that each connected client acts a bit like a small server.
while there are good ed2k servers, the main advantage of using kad is that the whole network remains much more stable whenever a large server is down or closed.
if all good servers were to being closed, and only fake servers were remaining, we could still go on with kad only :)

what you see in the kad window is not related to your current downloads or uploads. It's the files or keywords being indexed or searched.
my latest favorite jamendo album (Creative Commons license): CraZyH et Djézinho - Prémis N'1
Could be considered as the male counterpart to zap mama. It's really worth a try, even if you hate hip-hop...
Jamendo tags = beatbox electro ethnique experimental hiphop lounge percussions ragga rap reggae scat soft triphop world


--------------------------------------------------------

Pris pour des vaches à lait par les industries du disque... Maintenant boycottons-les!!!
0

#3 User is offline   V9RT5 

  • Newbie
  • Pip
  • Group: Members
  • Posts: 3
  • Joined: 31-March 06

Posted 31 March 2006 - 12:19 PM

I've read all that in several places, but what does it mean? In my Transfers window some of the people are downloading / uploading through the eD2K network and some throught the KAD network? If I disconnect KAD I will loose a certain number of people in my Transfers window?

Or do the KAD transfers happen in another window that I'm not aware of?

When I do a search am I searching both networks simultaneously or do I have to make a search specifically for KAD?

Thanks
Pedro
0

#4 User is offline   leuk_he 

  • MorphXT team.
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 5975
  • Joined: 11-August 04

Posted 31 March 2006 - 12:19 PM

Every client that has kad enabled is a mini server. It stores filenames, hashes & ip that have those hashes. THe kad traffic is relative low.

You cannot tune much about kad: just make sure your udp port is open and kad is fully functional. You find sources for your files with it and publishes the filesnames/hashes of your files. Don't expect miracles because of kad.
Download the MorphXT emule mod here: eMule Morph mod

Trouble connecting to a server? Use kad and /or refresh your server list
Strange search results? Check for fake servers! Or download morph, enable obfuscated server required, and far less fake server seen.

Looking for morphXT translators. If you want to translate the morph strings please come here (you only need to be able to write, no coding required. ) Covered now: cn,pt(br),it,es_t,fr.,pl Update needed:de,nl
-Morph FAQ [English wiki]--Het grote emule topic deel 13 [Nederlands]
if you want to send a message i will tell you to open op a topic in the forum. Other forum lurkers might be helped as well.
0

#5 User is offline   xscarab 

  • Mrs Chief Mumpopo 'Monkeyballs' Umboga III
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 4334
  • Joined: 22-February 04

Posted 31 March 2006 - 12:37 PM

V9RT5, on Mar 31 2006, 01:19 PM, said:

In my Transfers window some of the people are downloading / uploading through the eD2K network and some throught the KAD network? If I disconnect KAD I will loose a certain number of people in my Transfers window?
View Post

Where you see KAD or ED2K in the transfer window, it means that source was found via KAD or the server. Once you have a source, it is aware of you, so you will not lose a KAD source if you disconnect KAD. If you didn't connect to KAD at all it is still possible to acquire sources who are connected to KAD but not the ed2k servers via source exchange. (although this wouldn't happen if they were the only source for a file you wanted from them and they hadn't been asked for it by any of your known clients)
Are we nearly there yet?
0

#6 User is offline   V9RT5 

  • Newbie
  • Pip
  • Group: Members
  • Posts: 3
  • Joined: 31-March 06

Posted 31 March 2006 - 12:48 PM

Thanks to everyone.

Now I understood it.
0

#7 User is offline   himmelroman 

  • Newbie
  • Pip
  • Group: Members
  • Posts: 1
  • Joined: 28-April 06

Post icon  Posted 28 April 2006 - 11:40 AM

hi,

this is is only thread I could find that's trying to explain what goes on in KAD.
though I wouldn't call it "Explained in Detail"... yet.

Is there a place where the parameters we see in the KAD window are explained ?
What is the Contact Type? what does the binary in "Distance" mean?

come on guys... let's get to the bottom of it!
10x in advance.
0

#8 User is offline   ElChele 

  • Miembro con emule 0.50a
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 7295
  • Joined: 02-September 04

Posted 29 April 2006 - 04:48 AM

Hi everyone

In short:
The objective of Kad, is to arrive at this network architecture, of direct connection, in which, each PC is simultaneously "client" and "server".
For this, each PC is transformed into a "node" of the network, and communicates with its "neighbours" to have access to, all the information of the network.
For its operation, Kad needs: To learn the topology of the network on which the client connects itself (who uses Kad already). To look for the information on all the nodes, (who has the file that I want). To receive an answer of a node that responds to the criteria (I found a source). The reality is a few more complex, obviously.

Kad files.
The contact established with their Kad node, it's saved in the file nodes.dat.
This file evolve regularly when Kad carries out new searches, the new nodes it incorporates, and eliminate all the inactive nodes (PC disconnected of the network, IP changed etc.).
Taken care of... In the present versions, while Kad works, this file is updated in the memory of the PC. Single it is updated in the disc, when Kad is closed.
Is very important then to close Kad correctly; the file is not updated if Windows it's blocked.

The file nodes.dat has therefore the identifications of active nodes. If it lets Kad update it (long disconnections etc.), the kept nodes are deactivated little by little, and the file becomes useless.
Kad also uses two tables of index for the identifications of the contacted nodes, and the archives available in these nodes.
These tables are managed in the memory and single they correctly keep in disc, when stopping itself the mule, in two archives: s_index.dat and, k_index.dat.

The ports used by Kad to.
For her transactions, the mule uses a port TCP and a port UDP.
Port TCP is used for the connections as other clients and to the interchange of sources between clients. It is the test on this port that allows the attribution of ID.
By port UDP, they pass other transactions, as the management of the waiting queues, the controls of "ping" and the searches of sources.

The present versions of Kad voluntarily are limited in their searches of nodes, not to saturate the network.
The users who have connections to Internet of low speed (modem 56k, ISDN 64/64 etc.) they must use a single network and in this case, ed2k is preferable.

Connecting kad.
First, it is necessary to start emule in the network ed2k , using the classic way, selecting a server.
It's enough then to click in the Kad option Boot strap "from known clients".
Emule can then initiate with the contacts of the file nodes.dat, if it contains active nodes, or use one of the Kad clients with highID, found in the network ed2k, to enter the network Kad. This last solution can be slower.

Posted Image


The other solutions.

In order to be safe to have a file nodes.dat, for beginning with active nodes.
A recent file nodes.dat can be unloaded, from http://www.emule-inside.net/nodes.datEmule-Inside, http://download.over...00.de/nodes.dat Or from here.
The downloaded file must be saved in the folder... \emule\config.
can be then started using the function, Boot strap>from known clients.

System used in the principles of the Kad mule - To enter "Traffic tab", to make a double "click" on one of the files in unloading, to look for a client who has a version of later Kad 0.41xxx or, to click a right click on this client, and click again over Boot strap.
Another system - Also it can be to try with function "IP or address" - "Boot strap" - using the standard 195.236.75.57 IP , and indicating port UDP 5674.

Contacts(nodes)

Posted Image

nodes with which we have established a relationship, (number of contacts).
ID = Kad ID of the contact, (node) .
Type & Contacts: Amount on failed attempts of contact.

Green colour (0), not contact tried with this node has failed, the relation stays.
the possibility that this node, knows sources that his client looks for, still exists. (or vice versa).

Yellow colour (0) will be an attempt of connection to know, if this contact is still present or no, to update the indexed data (identification, name of the archives etc.) .

Yellow colour (1) Yes. The connection was tried successfully (the update can be done).

Yellow colour (1) not. control tried and was a failure in the attempt of connection.

Red colour (2) was a second attempt of connection to this node and also node failed... after awhile, this node will be delete of your list of contacts.

Distance: Approximated distance, expressed in bits, between kad and contact (node).

current searches (of nodes, archives, sources...)

Posted Image

Number = number assigned to the search (Internal use of the program).
Key = Kad ID of contact (node)
Type = type search.

Looking for new contacts (number of clients that give back a list of contacts)

store keyword = indexing a shared file so that it can be found by the others, with the option search (key of the file that is being stored: clients who have located that file).

• To keep file, indexing shared file so that his node, can be located like source of the same one, (clients that has located that file),
• Looking for keyword for download. (results of the search),
• Looking for sources for archives that it has in unloading (results of the search).
Name = The name from the file to which the search talks about.
• Number of clients who give back a list of contacts

In its present versions, Kad limits its searches of nodes. Otherwise, therefore the searches of new nodes, would be permanent, and occupy all the resources of the mule. When the source number found, by both networks ed2k and Kad is sufficient, the search of new sources in the network Kad, will be suspended so that the excessive traffic does not saturate the network. Continuous after of awhile.
At the moment, 700 nodes are due to find approximately about.

To the launching, Kad controls the file ipfilter.dat to eliminate the redundancies, the superposition’s of IP ranks, and adjacent ranks. The table in memory is thus less voluminous, and ipfilter is more effective.
The management of the table index, and the file nodes.dat, becomes in the memory of the PC.
With Windows, if the PC has few memory available, it can be that the mule starts.
But if the emule requires too much memory in any moment, and as Windows does not manage it correctly, the mule crash. And sometimes, Windows crash too.
Windows XP SP2 requires more resources of CPU, and more memory than SP1. Taken care of.

PTH. :)

Edit1: + Info.

bye

This post has been edited by ElChele: 29 April 2006 - 04:53 AM

Posted Image Make your own ipfilter file, and manage fake files. Take in count, You are the best filter for emule.
0

#9 User is offline   torpon 

  • I'm so tired
  • PipPipPipPipPipPipPip
  • Group: Moderator
  • Posts: 21272
  • Joined: 20-January 05

Posted 29 April 2006 - 09:53 AM

¡¡¡Ole mi niño!!! :thumbup:
Sorry but y can't tranlste the above expression.

Cheers :D

#10 User is offline   Esel4711 

  • Platinum eMule
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 3694
  • Joined: 22-March 04

Posted 30 April 2006 - 06:40 AM

ElChele :respect:
Just signed you in for the "supporter-of-the-month" contest :P
If justice rules the universe we are all in trouble...
0

#11 User is offline   ElChele 

  • Miembro con emule 0.50a
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 7295
  • Joined: 02-September 04

Posted 30 April 2006 - 02:13 PM

Single I limit myself to repeat, everything what I have learned here, in the forums of emule.
in anyway, thanks to both. :+1: And thanks to all those that teach to me, with their topics/posting/tutorials. (like the master Tchon, in this case). :+1: :flowers:
bye
Posted Image Make your own ipfilter file, and manage fake files. Take in count, You are the best filter for emule.
0

#12 User is offline   jestheonlyone 

  • Golden eMule
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 4346
  • Joined: 18-July 04

Posted 30 April 2006 - 05:10 PM

hi

new in v0.47a (probably the new kad2.0 mentioned in the changelog :) )

"Normal" (highID) kad connection process:

step 0. Red contacts
-> not connected

step 1. Orange contacts
-> connection attempts
-> kad status = firewalled

step 2. Yellow contacts
-> successful connections
-> kad status = open

up to this point, the whole process should take only a few seconds, and you can start using kad :)
(but on the first kad connection, or if your nodes.dat, key_index.dat etc. are too old, you may not get many results yet, I think)

now, there are two extra steps, which can be take more time (up to a few hours), and I don't know really what they mean; just some guesses:

step 3. Blue contacts
On my PC, this happens after ~1 hour, and I have noticed that this coincides approximately with the time needed to publish my whole shared files list on kad (-> "shared ed2k|kad" column in the shared files tab)
Maybe there's a relationship?

step4. Green contacts
1 or 2 extra hours here
I have no clue about this one, but I believe it shows the time needed for a new kad node to be fully integrated in the network :)
my latest favorite jamendo album (Creative Commons license): CraZyH et Djézinho - Prémis N'1
Could be considered as the male counterpart to zap mama. It's really worth a try, even if you hate hip-hop...
Jamendo tags = beatbox electro ethnique experimental hiphop lounge percussions ragga rap reggae scat soft triphop world


--------------------------------------------------------

Pris pour des vaches à lait par les industries du disque... Maintenant boycottons-les!!!
0

#13 User is offline   ElChele 

  • Miembro con emule 0.50a
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 7295
  • Joined: 02-September 04

Posted 01 May 2006 - 02:01 PM

I'm using 0.47a client.
Process

1- Kad connect from known clients, contacts (230 approximately) ==> nodes included into nodes.dat file.
2- Node lookup process, start. (Type tab).
3- A node be found ===> Store Keyword (Type tab). A number search, is assigned to him, in the Number tab.
4- A new node it's added to the Contacts tab. The attempt for connect to, start. There are 4 attempt for get it.
The Node colours, depend of the connection attemps, as follow:

Green Colour = Connected node, (explained above)

Posted Image

Blue colour = 1º attempt. (failed)

Posted Image

Yellow colour = 2º attempt. (failed)

Posted Image

Orange colour = 3º attempt . (failed)

Posted Image

Red colour = 4º and last attempt, for a few time. (the reazon for this behaviour, explained above)

Posted Image

be continue.....
Posted Image Make your own ipfilter file, and manage fake files. Take in count, You are the best filter for emule.
0

#14 User is offline   ElChele 

  • Miembro con emule 0.50a
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 7295
  • Joined: 02-September 04

Posted 01 May 2006 - 02:15 PM

the node changes of colour, based on the number of times, that a conección tries.

Green colour node.
Here begin the realationship between your client and the source, and the interchange process start.

Posted Image

The packets are sent, and responses received, or not.

bye
Posted Image Make your own ipfilter file, and manage fake files. Take in count, You are the best filter for emule.
0

#15 User is offline   leuk_he 

  • MorphXT team.
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 5975
  • Joined: 11-August 04

Posted 01 May 2006 - 03:35 PM

I think you start at yellow colour and go to b;ue/green after a hour and several succesful connections or to orange/red after failures.

But like said before: after succesful connection and not firewalled state you do not have much influence on it.
Download the MorphXT emule mod here: eMule Morph mod

Trouble connecting to a server? Use kad and /or refresh your server list
Strange search results? Check for fake servers! Or download morph, enable obfuscated server required, and far less fake server seen.

Looking for morphXT translators. If you want to translate the morph strings please come here (you only need to be able to write, no coding required. ) Covered now: cn,pt(br),it,es_t,fr.,pl Update needed:de,nl
-Morph FAQ [English wiki]--Het grote emule topic deel 13 [Nederlands]
if you want to send a message i will tell you to open op a topic in the forum. Other forum lurkers might be helped as well.
0

#16 User is offline   ElChele 

  • Miembro con emule 0.50a
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 7295
  • Joined: 02-September 04

Posted 01 May 2006 - 09:15 PM

leuk_he said:

I think you start at yellow colour

In my case, they are orange colour.
bye
Posted Image Make your own ipfilter file, and manage fake files. Take in count, You are the best filter for emule.
0

#17 User is offline   cplif 

  • Premium Member
  • PipPipPipPipPip
  • Group: Members
  • Posts: 318
  • Joined: 16-November 04

Posted 04 May 2006 - 04:59 PM

Great post, all of you! another great kernel of knowledge added to our too small intellects
0

#18 User is offline   moloko+ 

  • ...
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 1209
  • Joined: 18-August 05

Posted 07 May 2006 - 02:29 AM

himmelroman, on Apr 28 2006, 09:40 PM, said:

hi,

this is is only thread I could find that's trying to explain what goes on in KAD.
though I wouldn't call it "Explained in Detail"... yet.

Is there a place where the parameters we see in the KAD window are explained ?
What is the Contact Type? what does the binary in "Distance" mean?

come on guys... let's get to the bottom of it!
10x in advance.
View Post
okay, you asked for it... try reading this:
ed2k://|file|Kademlia.pdf|81047|B96817E90CDD4CCC4CD56E5FDC3899E7|/


hi, thanks for this human readable thread people!

:cry2: ... i have no buddies - they're always firewalled!
0

#19 User is offline   Esel4711 

  • Platinum eMule
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 3694
  • Joined: 22-March 04

Posted 07 May 2006 - 07:45 AM

A buddy uses YOU as a gateway to Kad...
If justice rules the universe we are all in trouble...
0

#20 User is offline   moloko+ 

  • ...
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 1209
  • Joined: 18-August 05

Posted 07 May 2006 - 11:10 AM

Esel4711, on May 7 2006, 05:45 PM, said:

A buddy uses YOU as a gateway to Kad...
View Post

hmm... well in that case that's a good thing... cheers Esel4711
0

  • Member Options

  • (2 Pages)
  • +
  • 1
  • 2

Fast Reply

  

1 User(s) are reading this topic
0 members, 1 guests, 0 anonymous users