Link Grabber?
Posted by: forever
Date: June 28, 2010 12:55AM

Hi

sometimes i need to grab a lot of links from sites like

ftp://ftp.avm.de/programs/fritz/deutsch/ (just an example)

but i can only copy one link after another.

Is there any chance for an extention that grabs all the links?

would be very helpful for me and perhaps for other users ;)


or is there already one and i just didn't find it?



Edited 1 time(s). Last edit at 06/28/2010 12:56AM by forever.

Re: Link Grabber?
Posted by: panzer
Date: June 28, 2010 02:38AM

there's a built-in option in Kmeleon to display all links in a page view>links or page context>page properties>links.

Re: Link Grabber?
Posted by: forever
Date: June 28, 2010 03:37AM

ok just tested it with some websites
it works, but unfortunately i doesn't work with the example page



Edited 1 time(s). Last edit at 06/28/2010 03:38AM by forever.

Re: Link Grabber?
Posted by: JamesD
Date: June 28, 2010 03:43AM

I got it to work on the example site and I have popup blocker enabled. It does require Javascript.

Re: Link Grabber?
Posted by: forever
Date: June 28, 2010 04:14AM

but not as i need it

it just displays:


but i need it that way:
f*tp://ftp.avm.de/programs/fritz/deutsch/FRITZ!_UP_030704.exe

minus the * of course ;)

for 1 links its ok to rightclick--> copy link URL
but if there are about 100 Links it is a lot of work ;)



Edited 2 time(s). Last edit at 06/28/2010 04:15AM by forever.

Re: Link Grabber?
Posted by: disrupted
Date: June 28, 2010 07:34AM

http://kmext.sourceforge.net/macros/exposelinks.7z

tools>development>expose links
shortcut key: ALT L

Re: Link Grabber?
Posted by: forever
Date: June 28, 2010 01:16PM

once again you made my life a little bit more comfortable ;)

Thank you so much


just the Shortcut doesn't work because ALT+L opens my bookmarks.
Thats perhaps because of the german version, but no problem

Re: Link Grabber?
Posted by: disrupted
Date: June 28, 2010 01:48PM

you welcome forever, you can easily change the shortcut by editing the macro and changing the accelerator.

i think you will like this better:

links extractor (extracts all links and saves to plain text file)
tools>development>links extractor

NT: http://kmext.sourceforge.net/files/linksextractorNT.7z
9x: http://kmext.sourceforge.net/files/linksextractor9x.7z

Re: Link Grabber?
Posted by: forever
Date: June 28, 2010 01:54PM

can you read my mind?
i just wanted to ask if this would be possible *lol*

i get this
file:///C:/Programme/K-Meleon/tools/linksextractor/extractions/ftp.avm.de.txt

but unfortunately it's empty

Re: Link Grabber?
Posted by: disrupted
Date: June 28, 2010 02:05PM

no, unfortunatley it won't work with ftp indexes and only works with regular websites because there is no actual file to parse and only see them in the browser..it's like a file manager but online. in some cases you can find sites that have files for their ftp servers, then it will work.. but mainly it's for regular websites.. probably panzer will benefit from this

http://download.uni-hd.de/ftp/mirrors/debian/project/experimental/Contents-kfreebsd-amd64.diff/

Re: Link Grabber?
Posted by: forever
Date: June 28, 2010 02:15PM

hmm.... that's bad but ok.
i think i will use both extensions ;)

it would have been great if there weren't the details like size and date so they could be copied



Edited 1 time(s). Last edit at 06/28/2010 02:15PM by forever.

Re: Link Grabber?
Posted by: panzer
Date: June 28, 2010 02:28PM

Quote
disrupted
but mainly it's for regular websites.. probably panzer will benefit from this

He will. I am sure of it. grinning smiley

Have you found a way to harvest links as thumbnails leading to another page?

http://kmeleon.sourceforge.net/forum/read.php?9,107108



Edited 2 time(s). Last edit at 06/28/2010 02:30PM by panzer.

Re: Link Grabber?
Posted by: mhf
Date: June 28, 2010 06:16PM

forever - you could try Url Snooper - it's NOT a KM extension but a free-standing application, I think it will do what you want.

Re: Link Grabber?
Posted by: disrupted
Date: June 29, 2010 01:28AM

panxer, links extraxctor can extract all frefs including links from images or thumbnails, doesn't mter as long as it's a valid link

forever, this is what you want
http://kmext.sourceforge.net/files/filesindexer.7z
accessmenu(text-selection context>populate files
use only on ftp sites and servers..other sites ;http etc' menu will be grayed

to use:
on ftp server, select all the page (ctrl+a) or manually select all files you want and rightclick and select 'populate files' from the menu. the populates*txt files) will be loacted at:
k-meleon\tools\filesindexer\

demo


test pages:
ftp://rtfm.mit.edu/pub/netbsd
ftp://ftp.informatik.uni-stuttgart.de/pub/beos
ftp://papa.indstate.edu/winsock-l/WindowsNT/FTP
ftp://ftp.icm.edu.pl/vol/rzm1/software/blast/binaries/

Re: Link Grabber?
Posted by: forever
Date: June 29, 2010 02:06AM

Oh my go... ääähm disrupted ;)

this is exactly what i wanted to have

thank you so much.

you made my day ;)

Re: Link Grabber?
Posted by: disrupted
Date: June 29, 2010 04:39AM

smiling smiley was written in a rush maybe like 10 minutes cause i needed to finish before the match started:d but i think it's bug free

Re: Link Grabber?
Posted by: forever
Date: June 29, 2010 05:50AM

i tested it with some websites..... no bugs yet ;)

great

Re: Link Grabber?
Posted by: panzer
Date: June 29, 2010 02:31PM

Thanx Disrupted.

Re: Link Grabber?
Posted by: sickley
Date: September 15, 2010 09:35AM

Any way to do the same as links extractor but with plain text links instead of hyperlinks??

Re: Link Grabber?
Posted by: siria
Date: September 15, 2010 03:36PM

If you don't need it "cleaned up" and just use native KM tools, you can also try
1) View > Links
2) View > Source Code


It's very, very basic, but for rare use perhaps enough:
(....)
<li>< a href="ftp:/ /ftp.avm.de/programs/fritz/deutsch">deutsch</a>&nbsp;</li>
<li>< a href="ftp:/ /ftp.avm.de/programs/fritz/english">english</a>&nbsp;</li>
<li>< a href="ftp:/ /ftp.avm.de/programs/fritz/french">french</a>&nbsp;</li>
<li>< a href="ftp:/ /ftp.avm.de/programs/fritz/italian">italian</a>&nbsp;</li>
<li>< a href="ftp:/ /ftp.avm.de/programs/fritz/polish">polish</a>&nbsp;</li>
(....)


Needed that trick just recently to take a quick look at image paths (View > images / View > Source Code)
(Have inserted blanks as visibility workaround, thanx Soeren (or Doon?) for figuring out the < a prob ;-)



Edited 1 time(s). Last edit at 09/15/2010 03:41PM by siria.

Re: Link Grabber?
Posted by: sickley
Date: September 15, 2010 07:21PM

not quite what I was looking for, actually backwards lol. What im looking for is a macro that will detect text that is an html link but is not an actual hyperlink and then dump all those to a text file or something of the sorts. I know it's a long shot and ill probably end up seeing if I can find an external macro (such as auto-hotkey) and then see if I can link it to a macro in k-meleon, but was wondering if anyone had already seen or is using such a thing

Re: Link Grabber?
Posted by: barzel
Date: September 16, 2010 05:37PM

sickley, try this.

context menu>Page Properties>Extract plain text URLs
or
view menu>Extract plain text URLs


it extracts all plain text urls from the viewed page and saves it to "TextUrl.txt" in "My Documents" folder.

Hope that helps.

Attachments: TextUrlExtractor.zip (275.3 KB)  
Re: Link Grabber?
Posted by: sickley
Date: September 17, 2010 02:57AM

exactly what I was looking for! thanks barzel!! just need to edit the autoit script a little for a different output folder smiling smiley

Re: Link Grabber?
Posted by: disrupted
Date: September 22, 2010 09:19PM

thank you barzel, texturlextractor has been added to kmext/development

K-Meleon forum is powered by Phorum.