[emugle]

Hi, I am the webmaster at www.emugle.com website. Emugle is a search engine for the edonkey network. Emugle aims to be a good replacement for the disappeared jigle.com. It is clean, google style, no file renaming, and it tries to load the servers as few as possible to keep the emugle database fresh, in fact its objective is to provide as good results as a global search but without asking any edonkey server

It would be nice if you want to add emugle as a new search method in emule All you have to do is to add it to the search methods dropdown list, and, when start search is clicked and emugle method is selected, build the url with the proper search querystring and launch the browser pointing to that url. These are the specs for the querystring:

Search url: http://www.emugle.com/search.php?
Search fields:
q          ->words to be searched for, default operator is AND, but you can use and, or, not operators between words.

t           ->search types, it can be Video, Archive, Image, Audio, CD Image, (void=any type)

or         ->if or=1 default operator for field q is “or”

ex        ->words to be excluded in the search

mins     ->minimum size specified in MB

maxs    ->maximum size specified in MB

avai      ->minimum file availability

sourceid           ->you can specify in this filed any string like “emule” or “emuleModName” it will be used to build search statistics for you about the number of searches if you wish.

f           -> if f=1 emugle will try to perform a live search from the servers instead of the local emugle database, it is not recommended since it will load the servers as much as a common emule search, also it will be slower.

The only one required field is q

Examples:
http://www.emugle.com/search.php?q=emule&t=&f=&or=&ex=&mins=&maxs=&avai=&sourceid=emule
http://www.emugle.com/search.php?q=emule&t=Archive&f=0&or=0&ex=installer&mins=0&maxs=2&avai=20&sourceid=emule
http://www.emugle.com/search.php?q=emule&t=&sourceid=emule

Any suggestions are welcome

[PacoBell]

I've seen your service and it is indeed the spirit of Jigle.com come back to us. Major props for your hard work! How does it achieve its results without relying on the servers? Is it a pure Kademlia interface to the network?

Regarding adding eMugle as a dropdown search option in eMule, I don't think that's the best way to go. There's already a webservices.dat that interfaces quite effectively with most PHP/CGI-bin webservices out there. In fact, I'll be adding yours as such:

eMugle info,http://www.emugle.com/details.php?f=#hashid

Thanks again for creating such a wonderful resource!

[EDIT]
Hrm...I just tested that out and it doesn't seem to work properly. Guess it's back to the drawing board.

File size search doesn't seem to be functional, either. p00p.
[/EDIT]

This post has been edited by PacoBell: 08 February 2005 - 06:55 AM

[emugle]

Quote

I've seen your service and it is indeed the spirit of Jigle.com come back to us. Major props for your hard work!

Thanks !! It is a funny project, I hope it will get better day by day.

Quote

Major props for your hard work! How does it achieve its results without relying on the servers? Is it a pure Kademlia interface to the network?

No, it uses the servers, but mainly a local enormous database that acts as a cache for servers, so the searches doesn’t arrive to edonkey servers. Currently it does not use Kademlia.

Quote

There's already a webservices.dat that interfaces quite effectively with most PHP/CGI-bin webservices out there

As far as I know with this service you can view more info regarding a file, but you can not define search methods.

Quote

File size search doesn't seem to be functional, either.

Be sure you are specifying the size in MB and be sure you specify some words to search (you can not search only by size). Anyway if you find some search url that you think that it is not working you can send it to me and I will take a look.

[PacoBell]

emugle, on Feb 7 2005, 11:52 PM, said:

Be sure you are specifying the size in MB and be sure you specify some words to search (you can not search only by size).

Aww...I can't? Well, I did try to search for a file name within a very specific size range and eMugle didn't find any hits. Is there a method to force a server search in the off chance that it might not be in the database yet? That was one of the things I liked about the Jigle interface. Jugle.net has something similar, btw.

[MoNKi]

First of all, thanks for offering us this service, is awesome.

Quote

Any suggestions are welcome

How about a new param:
output -> output=rss outputs the emugle page as a rss page (xml format) that can be used to parse the results by emule and show it in the search window. (void = normal output). Other posible values can be "rss2_0" (rss 2.0), "atom" or other sindication formats.

EDITED: Or a SOAP interface.

This post has been edited by MoNKi: 08 February 2005 - 11:25 AM

[PacoBell]

All of the above is, of course, good and welcome. If, however, you don't feel like going that route, we could always do it purely as a web thing like eMule currently does with the FileDonkey service (eww, tags):

SearchResultsWnd.cpp, Line 380

CString	CSearchResultsWnd::CreateWebQuery(SSearchParams* pParams)
{
	CString query;
	switch (pParams->eType)
	{
	case SearchTypeFileDonkey:
		query = _T("http://www.filedonkey.com/search.html?");
		query += _T("pattern=") + ToQueryString(pParams->strExpression);
		if (pParams->strFileType == ED2KFTSTR_AUDIO)
			query += _T("&media=Audio");
		else if (pParams->strFileType == ED2KFTSTR_VIDEO)
			query += _T("&media=Video");
		else if (pParams->strFileType == ED2KFTSTR_PROGRAM)
			query += _T("&media=Pro");
		query += _T("&requestby=emule");

		if (pParams->ulMinSize > 0)
			query.AppendFormat(_T("&min_size=%u"),pParams->ulMinSize);
		
		if (pParams->ulMaxSize > 0)
			query.AppendFormat(_T("&max_size=%u"),pParams->ulMaxSize);

		break;
	default:
		return _T("");
	}
	return query;
}

[emugle]

Quote

Is there a method to force a server search in the off chance that it might not be in the database yet?

In emugle homepage click “Show/Hide advanced options ” and select “Search Servers”, also, for an automated search as I said in my first post adding the parameter f=1 forces fresh search from servers. if f=1, emugle will try to perform a live search from the servers instead of the local emugle database, it is not recommended since it will load the servers as much as a common emule search, also it will be slower

MoNKi, thanks for your suggestion. I like it If emugle.com is supported as PacoBell said in his last post that would be the next step

[PacoBell]

Is there a way to search by hashid? So far, entering a hashid manually into details.php doesn't work as I'd expected, at least not for hashid's that aren't already indexed in the database.

[emugle]

Quote

Is there a way to search by hashid? So far, entering a hashid manually into details.php doesn't work as I'd expected, at least not for hashid's that aren't already indexed in the database.

If you paste the file elink in the search box the file will be checked and refreshed from servers as soon as possible. Anyway you won’t have to do it manually, I changed the details view code, so if you try to view the details of a file not already in the database, the hash entered will be checked and refreshed from servers as soon as possible. So your web service now should work much better Thanks for your suggestion.

This post has been edited by emugle: 10 February 2005 - 07:49 AM

[PacoBell]

Ooh! sw00by! Thanks a bunch for that

[Sir_Boagalott]

@emugle, who are you?

Are you affiliated with the wonderfull "All your base belong to us" Servers?

Am I the only 1 who finds it kinda odd that this "great" web service just shows up out of the blue after most have been shut down.

No offense emugle, but a person with only 4 posts who joined here 7-February 05 IMHO would have no clue how to set up a service like this unless your a Professional coder being paid by a large corporation. This service wasnt coded overnight for sure!!

Q: What corporation would possibly want such a IP loggable free service?

This service just seems to good to be true!!

[Some Support]

Quote

It would be nice if you want to add emugle as a new search method in emule

Well we are very careful if not to say reserved when adding anything to eMule which cannot control.
For example if it gets added and one week later the service is changed to a porn site (this is just an example, im not implying that this would happen with your service) this would cause major trouble of all kind to us and also decrease eMule's reputation.
Therefore it is unfortunatly at the moment rather unlikely that we will add another webbased search engine.

[PacoBell]

Well, by that logic, why do we even have the FileDonkey search in eMule? Do the devs own that site? I personally have never liked that service due to the annoying spam they glom to the end of every search. That's just MHO, tho.

[emugle]

Quote

No offense emugle, but a person with only 4 posts who joined here 7-February 05 IMHO would have no clue how to set up a service like this unless your a Professional coder being paid by a large corporation. This service wasnt coded overnight for sure!!

No corporation pay me for developing emugle I was developing this service during several months on my free time. Before this I followed the edonkey development since the beginning of emule. (emugle user is new here, but I am not new in ed2k)

Quote

Q: What corporation would possibly want such a IP loggable free service?

I don’t know, but if I wanted to log IPs I just install an ed2k server or run a modified emule it would be ridiculous to invert a lot of effort in a project like emugle

Quote

This service just seems to good to be true!!

Thanks !!!

Quote

Well we are very careful if not to say reserved when adding anything to eMule which cannot control.
For example if it gets added and one week later the service is changed to a porn site (this is just an example, im not implying that this would happen with your service) this would cause major trouble of all kind to us and also decrease eMule's reputation.

I understand your point of view so I sent you a PM with the details about me and the emugle service, so I hope you can reconsider it and trust on this service now.

[SlugFiller]

Looks like another filedonkey, only with more options, and without all the added junk, like name padding and file filtering. I'm also hoping the database updates more often(though not too often, don't want to kill the servers or anything).

Any chance for an XML interface or some other types of result markers so eMule could get the results in the search tab, rather than open an explorer window?

Also, any chance for Kad support? Sure, Kad search is pretty good, but substring beats keyword by far.

Wait, I didn't even ask, do you have substring search? If not, you should.

[emugle]

Quote

Looks like another filedonkey, only with more options, and without all the added junk, like name padding and file filtering. I'm also hoping the database updates more often(though not too often, don't want to kill the servers or anything).

You are right, it is another filedonkey, but cleaner, with more options and, probably, you will get better results for your searches. You can compare it with filedonkey and use the best for you, or both

Quote

Any chance for an XML interface or some other types of result markers so eMule could get the results in the search tab, rather than open an explorer window?

Yes, that is a good idea and I like it (XML results), this will be the next step once emugle is supported by emule or its mods.

Quote

Also, any chance for Kad support? Sure, Kad search is pretty good, but substring beats keyword by far.

Emugle does not use Kad for build the database and I don’t know if it should… if ed2k servers are enough I think it is better not to load Kad with some additional searches…

Quote

Wait, I didn't even ask, do you have substring search? If not, you should.

You can search for substrings using *
For example if you search emule* it will match all files having a word that begins with emule.

Thanks for your suggestions.

[MoNKi]

emugle, can the "sourceid" param have unicode chars (%xx)? I suppose you use it for statistics, and don't know If you will parse it if the sourceid contains unicode chars.

EDITED: There is a problem when searching unicode strings. For example, if you search "España" (spain ) on the web page, it searchs "espa%C3%B1a" (and works), instead of "espa%F1a" which is the correct URL-Encoded string (and don't works), therefore searching "españa" fails on an modified emule (or lphant).

EDITED2: Sorry, is a bug in emule, not in your page, sorry (the fix here: http://forum.emule-p...showtopic=73713).
lphant also has this bug.

This post has been edited by MoNKi: 07 March 2005 - 01:49 PM

[emugle]

Quote

can the "sourceid" param have unicode chars (%xx)? I suppose you use it for statistics, and don't know If you will parse it if the sourceid contains unicode chars

Yes, there is no problem with it. If in the future you want to see your sourceid stats ask me for it.

Quote

There is a problem when searching unicode strings. For example, if you search "España" (spain tongue.gif) on the web page, it searchs "espa%C3%B1a" (and works), instead of "espa%F1a" which is the correct URL-Encoded string (and don't works), therefore searching "españa" fails on an modified emule (or lphant).

EDITED2: Sorry, is a bug in emule, not in your page, sorry (the fix here: http://forum.emule-p...howtopic=73713).
lphant also has this bug.

You are right emugle did not handle well non UTF8 query strings. Although your patch is enough for emule, I modified emugle, and now it detects if the query string is not an UTF8 valid string and it does the conversion for you, so now it should work in any way.

Thank you very much for your report , I noticed now that it was giving some problems, not only for lphant clients, also for some other webs that added a search box for emugle and they don't send UTF8 query strings

[James R. Bath]

emugle, on Mar 2 2005, 08:39 AM, said:

Quote

Also, any chance for Kad support? Sure, Kad search is pretty good, but substring beats keyword by far.

Emugle does not use Kad for build the database and I don’t know if it should… if ed2k servers are enough I think it is better not to load Kad with some additional searches…

Actually, I like the idea of indexing it to help lessen the search load. As long as the index searches were spaced out (like every 30 seconds) and you didn't try to have real-time concurrency, the result might be less client-to-client search overhead.

Edit: Provided there is no "force" option to do a real-time search of Kad. That would defeat any point of having an index for Kad.

Might because, like Sir_Boagalott, a lot of people that prefer Kad prefer it because there is no centralization. They would never use your index.

It's smart to get feedback. If a lot (A LOT) of people like it and would use it, then go for it. You could do a partial test too. Maybe only index a certain type of files (such as video and images) and check out how that affects Kad before including audio and archives.

It is cleaner than FileDonkey, which I never use (not because it's not real-time but because it completely misses files and is way behind). I prefer jugle.net (I don't think it's actually real-time either, but it is both clean and provides all the fake/comments). My current preference is bitzi.com. They have an open source multi-hash rating/comment submitter/retriever (Bitcollider) that could be integrated into eMule.

As for eMugle, I think it would be best left as a Web service addition.

This post has been edited by James R. Bath: 08 March 2005 - 12:36 PM

[SlugFiller]

Quote

Yes, that is a good idea and I like it (XML results), this will be the next step once emugle is supported by emule or its mods.

Shouldn't it be the step before? It would make integration into a client alot simpler, I think.

Quote

Emugle does not use Kad for build the database and I don’t know if it should… if ed2k servers are enough I think it is better not to load Kad with some additional searches…

Some people use Kad only, and they may have unique files that won't be indexed. Sure, Kad search works almost as well as a web site search on it's own, but:
1. Having one place to make both types of searchs is neat.
2. It may, in the end of things, save bandwidth.
3. Substring searchs or searchs for short strings is a real up, so it would be nice to have a search engine that supports it, unlike Kad.
So I think you should have Kad indexing, even though I'm not 100% sure whether that's even possible. It really depends on how open the Kad search is for full-indexing exploits(seeing as how brute-forcing through keywords rather than clients would definately not work well).

In any way, cool site thus far.