Open Hub
Black Duck Open Hub

Tags : Browse Projects

Select a tag to browse associated projects and drill deeper into the tag cloud.

LinkChecker

Compare

  Analyzed 4 months ago

Check websites and HTML documents for broken links. * recursive and multithreaded checking * output in colored or normal text, HTML, SQL, CSV, XML or a sitemap graph in different formats * HTTP/1.1, HTTPS, FTP, mailto:, news:, nntp:, Telnet and local file links support * restriction of link ... [More] checking with regular expression filters for URLs * proxy support * username/password authorization for HTTP and FTP and Telnet [Less]

45.2K lines of code

10 current contributors

5 months since last commit

3 users on Open Hub

Activity Not Available
3.0
   
0 Reviews
I Use This
Mostly written in Python
Licenses: gpl
Tags aref crawler html link-checker link_checking loadtest robot spider w3c web-crawler webcrawler web-spider 1 more...

PUMz

Compare

  Analyzed about 9 hours ago

PUMz is web clipping service project and upgrade project of pumware(pumware.sf.net).

2.95K lines of code

0 current contributors

over 20 years since last commit

1 users on Open Hub

Inactive
0.0
 
0 Reviews
I Use This
Mostly written in Java
Licenses: CC_Attrib...
Tags c# clipping c#net crawler csharp dotnet engine java korean mobile mobile_devices net 17 more...

Spidr

Compare

  Analyzed 1 day ago

Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

4.39K lines of code

1 current contributors

3 months since last commit

1 users on Open Hub

Very Low Activity
0.0
 
0 Reviews
I Use This
Mostly written in Ruby
Licenses: gpl, mit
Tags crawler rdoc robot rspec ruby rubygem spider spidr web web-crawler webcrawler web-spider 1 more...

Anemone

Compare

  Analyzed 44 minutes ago

Anemone is a Ruby library that makes it quick and painless to write programs that spider a website. It provides a simple DSL for performing actions on every page of a site, skipping certain URLs, and calculating the shortest path to a given page on a site. The multi-threaded design makes Anemone ... [More] fast. The API makes it simple. And the expressiveness of Ruby makes it powerful. [Less]

2.15K lines of code

0 current contributors

almost 12 years since last commit

1 users on Open Hub

Inactive
5.0
 
0 Reviews
I Use This
Mostly written in Ruby
Licenses: mit
Tags crawler rdoc ruby spider web web-crawler webcrawler web-spider webspider