Novell is now a part of Micro Focus

Kwebget: Nice frontend for wget

Novell Cool Solutions: Feature
By Scott M. Morris

Digg This - Slashdot This

Posted: 13 Sep 2005

Applies to:

  • Platforms using KDE

If you've ever needed to mirror a site, or download it for offline browsing, I have a cool little application for you. It's called kwebget. In YAST, its description is as follows:

    "KWebGet is a frontend to the great 'wget'. It comes with nearly the same functionallity, but the user won't have to type such long commandline-arguments."

From its website, this additional explanation:

    "It can be used to download single Files, and to download complete Websites, which can be browsed offline."

So, for anyone who has used wget, kwebget is a nice gui for that app.

To check it out, make sure you have it installed. Open up YAST and search for the package called kwebget. When it comes up in the right pane, tick the checkbox next to it. Then, click ACCEPT:

Now to run it, open up the K Menu. Follow:

Internet => Data Exchange => Kwebget

NOTE: Sometimes, some of the dialogs pop up behind instead of in front. It does, however, give you a taskbar button you can click on to bring the window to the front. Complain to the author. :)

The splash screen comes up. When it disappears, a box appears asking you how you'd like to perform the session. For now, let's pick the wizard option:

A small window comes up, asking you what you'd like to name the project. Type in a name. It also asks you where you would like to store the downloaded files. Use the browse button to locate your target. When you're finished, click NEXT:

The next screen asks you what you want to download. For now, let's select "Mirror a whole site, for Off-line Browsing." Then, it asks you what user-agent you want kwebget to identify itself as. This is kind of like telling the server what "browser" it is. I just leave it as WGET. When you've made your selections, click NEXT:

The next window will ask you for the URL of the website you want to mirror. For this example, we'll just use here. Since this site does not require a username or password, we won't enter one. If we were downloading things from an FTP server, we might need a username/password here. Enter the website you wish to mirror, and click NEXT:

The next screen asks a few more details of what we want to do. For this example, let's be gentle on the web server, and select NUMBER OF LEVELS, and set it to "1" (it should be that by default). Then, let's select MAXIMUM AMOUNT OF MBYTES TO GET, and set it to "1" also (again, this should be the default). When you're ready, click NEXT:

The next window prompts for what to do in regards to retries and output messages. Tick the NUMBER OF RETRIES checkbox. Put "1" in that box. In the WAIT SECONDS box, let's put 30. If you wish, tick the DISABLE OUTPUT MESSAGES box. Then, click NEXT:

This next box asks you when you want to perform the operation. Let's leave it at START-NOW, and click NEXT:

A small box appears asking if you want to save the project. For this example, we won't, so we click NO:

kwebget then performs the downloads and finishes. Click DISMISS:

A small window appears asking if you want to start another operation or exit. Click YES to exit:

You can now browse to the folder where you saved the downloaded files. In this case, for me, the files are located at /home/scott/ You can just double-click the HTML file you want to open. In this case, since we identified ourselves as a non-standard browser, the server sent us a generic HTML page with no images or javascript. If you want to retrieve what you will see in your browser, change the user-agent on its respective window. When I open the index.html file, this is what I see:

So, for times when you need to quickly mirror a site, kwebget might be the tool that you need. SUSE Linux is full of excellent applications like this.

Novell Cool Solutions (corporate web communities) are produced by WebWise Solutions.

© Copyright Micro Focus or one of its affiliates