robots.txt exclusion protocol implementation for Go language (golang).
Contains logically separate parser and checker.
Parser may be used to check robots.txt file for correctness.
Checker may be used for may-i-visit-this-url kind of queries against parsed robots.txt data.
These details are provided for information only. No information here is legal advice and should not be used as such.