Open Hub
Black Duck Open Hub

 Settings |  Report Duplicate

0
I Use This!
Inactive

Commits : Listings

Analyzed about 13 hours ago. based on code collected about 16 hours ago.
Apr 24, 2023 — Apr 24, 2024
Commit Message Contributor Files Modified Lines Added Lines Removed Code Location Date
initial import of draft django metadata portal
jlivni
More... over 14 years ago
Make the ingest code less dependent on the CWD, and make the file watcher derive from the file indexer for some basic functionality.
Matt Born
More... over 14 years ago
Derive indexer and watcher from a base class.
Matt Born
More... over 14 years ago
File indexing works with new syntax. Next up, file watching.
Matt Born
More... over 14 years ago
Broken commit reflecting my attempt to segregate the logic of feeding the converter from actually performing conversions.
Matt Born
More... over 14 years ago
Trying to get this to be a nicer python package; "inbound" seems like a vague package name.
Matt Born
More... over 14 years ago
Working up some changes to accomodate a broader range of converters with more information about them.
mattborn
More... over 14 years ago
Separate out the logic which decides which files to process from the logic which decides which processor to call on the files. This will make it easier to tie in to an arbitrary database, such as the RESTful database that is being developed.
mattborn
More... over 14 years ago
Organizing the root directory by products as the CivicDB ecosystem gets more complex.
mattborn
More... over 14 years ago
I am making a proof-of-concept portal implementation which will dump in to the converter code.
mattborn
More... over 14 years ago
Readme updated with basic instructions for the infrastructure I made up. TODO in the future: Tom suggests that we may want to have a less dynamic, dodgy method of deciding if we want to call the converter, possibly based on registering MIME types for each converter. Jay has asked for error output from failed conversion, which could be implemented with a pipe from the converter and an interface back to the data input portal. I should really remove the dependency on having the working directory be the same as the root directory, too.
Matt Born
More... over 14 years ago
Products now appear in the appropriate location.
Matt Born
More... over 14 years ago
Ingestion finds files, processes them if possible, and the output is generated. Next up: more fine-grained control over the sources and destinations of data, since we don't actually want data ending up in the hopper.
Matt Born
More... over 14 years ago
Ingestion logging for debugging purposes.
Matt Born
More... over 14 years ago
Ingestion now calls off to converters; however, converters can't quite figure out how to generate or write the output files yet.
Matt Born
More... over 14 years ago
CSV converter should support testing whether files appear to be CSV.
Matt Born
More... over 14 years ago
The ingestion code is getting more mature and fleshed out. Will begin testing automatically calling the converter when files are found.
Matt Born
More... over 14 years ago
Moved this file to the "converters" directory.
Matt Born
More... over 14 years ago
More organization for the ingestion.
Matt Born
More... over 14 years ago
Instead of manually constructing my XML, use Python's XML library.
mattborn
More... over 14 years ago
Locking framework for future database.
Matt Born
More... over 14 years ago
Neglected to delete this file after duplicating it into the "hopper" directory.
Matt Born
More... over 14 years ago
I've added a basic ingestion framework which does not currently function, but will watch a given directory for new or changed files and perform some callback upon finding them. Right now the callback is to print loud messages but in the future it might be to convert them and store the information in a persistent database of our metadata.
Matt Born
More... over 14 years ago
A quick take on CSV to XML conversion. The XML lacks DTD info and the CSV reading is not very robust, but works on the sample dataset.
Matt Born
More... over 14 years ago
first commit
Jay Nath
More... over 14 years ago