Official eMule-Board: Slow Download Ending Solution - Official eMule-Board

Jump to content


  • (2 Pages)
  • +
  • 1
  • 2

Slow Download Ending Solution Rate Topic: -----

#1 User is offline   Kutfiusz 

  • Newbie
  • Pip
  • Group: Members
  • Posts: 3
  • Joined: 20-October 05

Posted 20 October 2005 - 12:29 PM

Hi
everybody must have noticed that emule can be very slow at the end of each download, especially at 99%.
Having experience only as a regular user, not seeing the code, I think that's only when I'm downloading a particular file from multiple clients. I guess emule assigns every client a frame (part of a file) and every client sends his part of file to me. Problem appears when there is no frames left to assign to client. Client is disconected. Because fastest clients ask for new frames more often then slow ones there is very high probability that the fastest clients are the first disconected ones and the last frame is downloaded from the slowest client. For example (very common situation) I dowload file archive.zip from 3 clients. One uploads to me with 80Kb/s, another 5Kb/s and the last 100B/s. The file dowloads fast, but the last frame is downloaded with 100B/s (from slowest client) and sometimes it takes 50% of total file download time.
I see 2 solutions. One is smaller frame size, but this will lead to more control data needed and lower transfers.
Another solution is more subtle. When emule cannot assign a frame to client (there are no free frames) it checks which client is the slowest one, "kicks" kim, and gives the last frame (part) to the actually fastest free client. In other words, Emule kicks the slowest client and lets the faster one to finish frame download.
Tell me what do you think?
greetings
0

#2 User is offline   PluG 

  • Golden eMule
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 1585
  • Joined: 27-November 02

Posted 20 October 2005 - 12:43 PM

Take a look at dazzle's -> Faster 'endgame'

Also netfinity's 'dynamic block requests' aims to resolve this senario too. But so far the devs haven't been inclined to implement such a thing in official.
0

#3 User is offline   Kutfiusz 

  • Newbie
  • Pip
  • Group: Members
  • Posts: 3
  • Joined: 20-October 05

Posted 20 October 2005 - 12:55 PM

thanks for replying, sorry but we didn't find this info.
But the question remains, why do devs won't implement it if it is such an easy problem to solve and gives a boost to the software.
0

#4 User is offline   PluG 

  • Golden eMule
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 1585
  • Joined: 27-November 02

Posted 20 October 2005 - 01:09 PM

Kutfiusz, on Oct 20 2005, 12:55 PM, said:

thanks for replying, sorry but we didn't find this info.

You didn't need to find it, the underlined^ Faster 'endgame' above is a link, just click it.

Quote

But the question remains, why do devs won't implement it if it is such an easy problem to solve and gives a boost to the software.
It's an old problem which is frequently mentioned, I think zz has responed to it a couple of times, but I guess the official devs don't see it as a big issue. You get your file eventually, whether it's in 10 minutes or 10 hours.
0

#5 User is offline   Kutfiusz 

  • Newbie
  • Pip
  • Group: Members
  • Posts: 3
  • Joined: 20-October 05

Posted 20 October 2005 - 01:47 PM

PluG, on Oct 20 2005, 02:09 PM, said:

Kutfiusz, on Oct 20 2005, 12:55 PM, said:

thanks for replying, sorry but we didn't find this info.

You didn't need to find it, the underlined^ Faster 'endgame' above is a link, just click it.


well, I meant i haven't found it before I asked my question.. :)
thx to you too ;)
0

#6 User is offline   Andu 

  • Morph Team
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 13009
  • Joined: 04-December 02

Posted 20 October 2005 - 05:28 PM

PluG, on Oct 20 2005, 03:09 PM, said:

Kutfiusz, on Oct 20 2005, 12:55 PM, said:

thanks for replying, sorry but we didn't find this info.

You didn't need to find it, the underlined^ Faster 'endgame' above is a link, just click it.

Quote

But the question remains, why do devs won't implement it if it is such an easy problem to solve and gives a boost to the software.
It's an old problem which is frequently mentioned, I think zz has responed to it a couple of times, but I guess the official devs don't see it as a big issue. You get your file eventually, whether it's in 10 minutes or 10 hours.
View Post


Erm zz has already implemented his own version of the faster endgame in vanilla eMule iirc. Should have happened in 0.46c I think. I'm certain it was in one of the 0.46x clients.
Three Rings for the Elven-kings under the sky,
Seven for the Dwarf-lords in their halls of stone,
Nine for Mortal Men doomed to die,
One for the Dark Lord on his dark throne
In the Land of Mordor where the Shadows lie.
One Ring to rule them all, One Ring to find them,
One Ring to bring them all and in the darkness bind them
In the Land of Mordor where the Shadows lie.


Dark Lord of the Forum


Morph your Mule

Need a little help with your MorphXT? Click here

0

#7 User is offline   PluG 

  • Golden eMule
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 1585
  • Joined: 27-November 02

Posted 20 October 2005 - 05:39 PM

Andu, on Oct 20 2005, 05:28 PM, said:

Erm zz has already implemented his own version of the faster endgame in vanilla eMule iirc. Should have happened in 0.46c I think. I'm certain it was in one of the 0.46x clients.
View Post

My mistake, your right, just checked the changelog for 46c.

Quote

----------------------
- June, 28. 2005    -
----------------------
zz: When downloading from a really slow source, request less of the file at a time. This locks less of the file, so if there's a faster source available we have a better chance of downloading from it even when the file is almost completely downloaded.

0

#8 User is offline   zz 

  • -
  • PipPipPipPipPipPipPip
  • Group: Debugger
  • Posts: 2014
  • Joined: 30-November 02

Posted 20 October 2005 - 08:42 PM

I have further improvements to it in my local build, but I doubt we'll insert it in the next standard eMule. I don't want to do risky stuff just to get the few last Kbytes faster.

It will be part of the next ZZUL release though.

/zz B)

This post has been edited by zz: 20 October 2005 - 08:43 PM

ZZUL - get control of your uploads: ZZUL Forum
0

#9 User is offline   MasterJunior 

  • no more then I have to, if that. EndGame
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 1313
  • Joined: 01-April 04

Posted 20 October 2005 - 09:05 PM

isnt that dazzel mod a bad 1 though? it has some features that arnt good for the network.
I'm wasted away, i make a million mistakes, theres a storm in my head, it rains on my bed, when your not here, im not afraid of dyin, but i am afraid of loosing you, maybe im addicted, im outta control, but your the drug that keeps me from dyin, maybe im a liar, but all i really kno, is your the only reason im tryin, when your lying next to me, your love is flowing through to me oh its beautiful, everythings clear to me, untill i hit reality and then i loose it all...... I love you eMule!!!

Bored??? Release your inner mule and get involved with your favorite file sharing program, EMULE!!!!!! Check out my feature request.
Modifications!!!....................Speed Up eMule!!! Partly Done
On Queue 2........................Individual Max Sources/File Partly Done
Advanced Sorting.................Slot for Small Files
Easy Switching.Partly Done....Advanced Priority System
To accomplish great things, we must not only act, but also dream; not only plan, but also believe
0

#10 User is offline   Andu 

  • Morph Team
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 13009
  • Joined: 04-December 02

Posted 20 October 2005 - 09:11 PM

zz, on Oct 20 2005, 10:42 PM, said:

I have further improvements to it in my local build, but I doubt we'll insert it in the next standard eMule. I don't want to do risky stuff just to get the few last Kbytes faster.

It will be part of the next ZZUL release though.

/zz B)
View Post


Are you implying that the next release of the official client isn't too far off or is it just my wild imagination? :angelnot:
Three Rings for the Elven-kings under the sky,
Seven for the Dwarf-lords in their halls of stone,
Nine for Mortal Men doomed to die,
One for the Dark Lord on his dark throne
In the Land of Mordor where the Shadows lie.
One Ring to rule them all, One Ring to find them,
One Ring to bring them all and in the darkness bind them
In the Land of Mordor where the Shadows lie.


Dark Lord of the Forum


Morph your Mule

Need a little help with your MorphXT? Click here

0

#11 User is offline   PluG 

  • Golden eMule
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 1585
  • Joined: 27-November 02

Posted 20 October 2005 - 09:40 PM

MasterJunior, on Oct 20 2005, 09:05 PM, said:

isnt that dazzel mod a bad 1 though? it has some features that arnt good for the network.
View Post

The mod is, as far as the reports around here go, tho' I never looked at it myself. But the Faster 'endgame' code is in the snippets section as I linked too....

Tho' all that's probably obsolette anyway, with zz's version implemented and under further developement, guess we just have to wait and see what nice surprises the future brings :D
0

#12 User is offline   MasterJunior 

  • no more then I have to, if that. EndGame
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 1313
  • Joined: 01-April 04

Posted 21 October 2005 - 12:02 AM

idk, i tried it out and its baaaaaaaaad, if i were a admin around here id remove its name from every post
I'm wasted away, i make a million mistakes, theres a storm in my head, it rains on my bed, when your not here, im not afraid of dyin, but i am afraid of loosing you, maybe im addicted, im outta control, but your the drug that keeps me from dyin, maybe im a liar, but all i really kno, is your the only reason im tryin, when your lying next to me, your love is flowing through to me oh its beautiful, everythings clear to me, untill i hit reality and then i loose it all...... I love you eMule!!!

Bored??? Release your inner mule and get involved with your favorite file sharing program, EMULE!!!!!! Check out my feature request.
Modifications!!!....................Speed Up eMule!!! Partly Done
On Queue 2........................Individual Max Sources/File Partly Done
Advanced Sorting.................Slot for Small Files
Easy Switching.Partly Done....Advanced Priority System
To accomplish great things, we must not only act, but also dream; not only plan, but also believe
0

#13 User is offline   leuk_he 

  • MorphXT team.
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 5975
  • Joined: 11-August 04

Posted 21 October 2005 - 07:50 PM

MasterJunior, on Oct 20 2005, 11:05 PM, said:

isnt that dazzel mod a bad 1 though? it has some features that arnt good for the network.
View Post


dassel :lol: is indeed a very bad mod(0-uploading possiblity) , but nothing illegal.

All the dazzle end-game does is dropping slow sources, That is not the most efficient way since you still ahve to wait if a faster source is availble.

046c did an more generic improvement to the download code. that not only improves the laast chunk, but also might be an impreovement for all chunks.
Download the MorphXT emule mod here: eMule Morph mod

Trouble connecting to a server? Use kad and /or refresh your server list
Strange search results? Check for fake servers! Or download morph, enable obfuscated server required, and far less fake server seen.

Looking for morphXT translators. If you want to translate the morph strings please come here (you only need to be able to write, no coding required. ) Covered now: cn,pt(br),it,es_t,fr.,pl Update needed:de,nl
-Morph FAQ [English wiki]--Het grote emule topic deel 13 [Nederlands]
if you want to send a message i will tell you to open op a topic in the forum. Other forum lurkers might be helped as well.
0

#14 User is offline   zz 

  • -
  • PipPipPipPipPipPipPip
  • Group: Debugger
  • Posts: 2014
  • Joined: 30-November 02

Posted 21 October 2005 - 11:26 PM

Andu, on Oct 20 2005, 11:11 PM, said:

Are you implying that the next release of the official client isn't too far off or is it just my wild imagination? :angelnot:
View Post


No, I'm not implying anything. Just that I won't put that code in the standard source, so it won't be part of a release whenever it may happen.

If it works out ok in a few ZZUL releases, I might feel safe enough to advocate for it in the standard eMule release, but we'll have to see.

/zz B)
ZZUL - get control of your uploads: ZZUL Forum
0

#15 User is offline   SlugFiller 

  • The one and only master slug
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 6988
  • Joined: 15-September 02

Posted 21 October 2005 - 11:47 PM

When I saw that in the changelog, I though they adapted netfinity's patch(hence saving me the trouble). But from the posts I'm reading, it seems to be inferior.
If a superior patch is, indeed, available, why not use it?
(Hey, first time I get to ask that about somebody else's patch)
Why haven't you clicked yet?

SlugFiller rule #1: Unsolicited PMs is the second most efficient method to piss me off.
SlugFiller rule #2: The first most efficient method is unsolicited eMails.
SlugFiller rule #3: If it started in a thread, it should end in the same thread.
SlugFiller rule #4: There is absolutely no reason to perform the same discussion twice in parallel, especially if one side is done via PM.
SlugFiller rule #5: Does it say "Group: Moderators" under my name? No? Then stop telling me about who you want to ban! I really don't care! Go bother a moderator.
SlugFiller rule #6: I can understand English, Hebrew, and a bit of Japanese(standard) and Chinese(mandarin), but if you speak to me in anything but English, do expect to be utterly ignored, at best.
0

#16 User is offline   zz 

  • -
  • PipPipPipPipPipPipPip
  • Group: Debugger
  • Posts: 2014
  • Joined: 30-November 02

Posted 22 October 2005 - 03:03 PM

I don't remember the particulars about Netfinity's patch; but we didn't want to kick out connections, and didn't want request blocks smaller than the standard 180KBytes. Maybe that patch used one of those methods? It's too long ago to remember. :)

The small change I did simply decides if 1, 2 or 3 blocks will be requested.

/zz B)
ZZUL - get control of your uploads: ZZUL Forum
0

#17 User is offline   Andu 

  • Morph Team
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 13009
  • Joined: 04-December 02

Posted 22 October 2005 - 03:42 PM

Well it surely requested blocks smaller than 180 kB if necessary. Not sure about the first thing.

So I guess netfinity's patch still is a bit more advanced than that in the official client.
Three Rings for the Elven-kings under the sky,
Seven for the Dwarf-lords in their halls of stone,
Nine for Mortal Men doomed to die,
One for the Dark Lord on his dark throne
In the Land of Mordor where the Shadows lie.
One Ring to rule them all, One Ring to find them,
One Ring to bring them all and in the darkness bind them
In the Land of Mordor where the Shadows lie.


Dark Lord of the Forum


Morph your Mule

Need a little help with your MorphXT? Click here

0

#18 User is offline   SlugFiller 

  • The one and only master slug
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 6988
  • Joined: 15-September 02

Posted 22 October 2005 - 04:10 PM

There were two patchs to solve this.
First, Dazzle created a patch that kicks sources.
Then, NetFinity created one that asks for smaller blocks.

To me, NetFinity's solution is better, but either works as a solution to the problem at hand.

I don't see how there can be a solution without one of the two. Even before the appearance of these two patchs, I already knew those were the only two thinkable possible solutions, and I did discuss them in theory a bit.
It was actually somewhat funny when both variations appeared shortly after one another.

Well, actually, a third solution I thought of was requesting overlapping blocks when no free ones are left, and "may the faster uploader win", though that's somewhat wasteful with bandwidth.
Why haven't you clicked yet?

SlugFiller rule #1: Unsolicited PMs is the second most efficient method to piss me off.
SlugFiller rule #2: The first most efficient method is unsolicited eMails.
SlugFiller rule #3: If it started in a thread, it should end in the same thread.
SlugFiller rule #4: There is absolutely no reason to perform the same discussion twice in parallel, especially if one side is done via PM.
SlugFiller rule #5: Does it say "Group: Moderators" under my name? No? Then stop telling me about who you want to ban! I really don't care! Go bother a moderator.
SlugFiller rule #6: I can understand English, Hebrew, and a bit of Japanese(standard) and Chinese(mandarin), but if you speak to me in anything but English, do expect to be utterly ignored, at best.
0

#19 User is offline   Andu 

  • Morph Team
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 13009
  • Joined: 04-December 02

Posted 22 October 2005 - 04:16 PM

Hm netfinity's patch was implemented into his mod significantly earlier than dazzle's patch iirc.
Three Rings for the Elven-kings under the sky,
Seven for the Dwarf-lords in their halls of stone,
Nine for Mortal Men doomed to die,
One for the Dark Lord on his dark throne
In the Land of Mordor where the Shadows lie.
One Ring to rule them all, One Ring to find them,
One Ring to bring them all and in the darkness bind them
In the Land of Mordor where the Shadows lie.


Dark Lord of the Forum


Morph your Mule

Need a little help with your MorphXT? Click here

0

#20 User is offline   SlugFiller 

  • The one and only master slug
  • PipPipPipPipPipPipPip
  • Group: Members
  • Posts: 6988
  • Joined: 15-September 02

Posted 22 October 2005 - 04:45 PM

Hmm... Yes.
I'm going over the threads and indeed NetFinity's snippet is dated Nov 11 2004, while Dazzle's is Apr 29 2005. I just didn't spot NetFinity's patch until tHeWiZaRdOfDoS brought the thread back from the dead in May 31 2005, a month after Dazzle's patch was posted.

Here's a twist, though, NetFinity's patch has already been around for over a year, and with all the eMule versions that's come and gone, it still isn't in the official.
And there I thought Check Diskspace and SafeHash took their sweet time.
Why haven't you clicked yet?

SlugFiller rule #1: Unsolicited PMs is the second most efficient method to piss me off.
SlugFiller rule #2: The first most efficient method is unsolicited eMails.
SlugFiller rule #3: If it started in a thread, it should end in the same thread.
SlugFiller rule #4: There is absolutely no reason to perform the same discussion twice in parallel, especially if one side is done via PM.
SlugFiller rule #5: Does it say "Group: Moderators" under my name? No? Then stop telling me about who you want to ban! I really don't care! Go bother a moderator.
SlugFiller rule #6: I can understand English, Hebrew, and a bit of Japanese(standard) and Chinese(mandarin), but if you speak to me in anything but English, do expect to be utterly ignored, at best.
0

  • Member Options

  • (2 Pages)
  • +
  • 1
  • 2

1 User(s) are reading this topic
0 members, 1 guests, 0 anonymous users