texrex

I Use This!

Inactive

Analyzed about 18 hours ago. based on code collected about 22 hours ago.

Project Summary

An efficient tool to process (mainly) ARC files from Heritrix (HTML stripper, entity converter, boilerplate remover, language filter). Converts everything to UTF-8 using ICU. Also includes a conservative w-shingling implementation for near-duplicate detection. Uses multi-threading for single-machine parallelization.

In a Nutshell, texrex...

...
has had 545 commits made by 1 contributors
representing 21,003 lines of code
...
is mostly written in Pascal
with a well-commented source code
...
has a codebase with a long source history
maintained by nobody
with stable Y-O-Y commits
...
took an estimated 5 years of effort (COCOMO model)
starting with its first commit in June, 2011
ending with its most recent commit about 8 years ago

Quick Reference

Project Links:

Homepage
Download

Code Locations:

svn://svn.code.sf.net/p/texrex/c...

Similar Projects:

Managers:

Roland Schäfer

Licenses

GNU General Public License v3.0 or later

Permitted

Commercial Use

Modify

Distribute

Place Warranty

Use Patent Claims

Forbidden

Sub-License

Hold Liable

Required

Distribute Original

Disclose Source

Include Copyright

State Changes

Include License

Include Install Instructions

These details are provided for information only. No information here is legal advice and should not be used as such.

All Licenses

This Project has No vulnerabilities Reported Against it

Did You Know...

...
use of OSS increased in 65% of companies in 2016
...
you can subscribe to e-mail newsletters to receive update from the Open Hub blog
...
there are over 3,000 projects on the Open Hub with security vulnerabilities reported against them
...
search using multiple tags to find exactly what you need