|Sarah Jamie Lewis f2ef624070 User Agent||3 weeks ago|
|IACR-eprint||3 weeks ago|
|amnesty||3 weeks ago|
|arxiv-cs.CR||3 weeks ago|
|bitcoin-releases||3 weeks ago|
|grin-annoucements||3 weeks ago|
|i2pblog||3 weeks ago|
|journalist-leighcuen||3 weeks ago|
|journalist-zackwhittaker||3 weeks ago|
|katzenpost-blog||3 weeks ago|
|monero||3 weeks ago|
|openprivacy-blog||3 weeks ago|
|privacy-international||3 weeks ago|
|proof-of-work||3 weeks ago|
|pt-reyes||3 weeks ago|
|reddit-rtlsdr||3 weeks ago|
|reveal||3 weeks ago|
|seashepherd||3 weeks ago|
|securedrop||3 weeks ago|
|tor-blog||3 weeks ago|
|weather||3 weeks ago|
|zcash-blog||3 weeks ago|
|zcash-fnd-blog||3 weeks ago|
|.gitignore||3 weeks ago|
|LICENSE||3 weeks ago|
|README.md||3 weeks ago|
|main.go||3 weeks ago|
|report-pic.png||3 weeks ago|
|report.template||3 weeks ago|
You either build your own information processing pipelines or you become subject to someone else's.
I wanted a tool that would provide the following features:
After investigating a few options I could find nothing that fit quite right.
Create a new folder to hold all of your feeds e.g.
mkdir feeds cd feeds
Create some feeds, each feed is a subfolder that contains a file
mkdir openprivacy-blog echo "https://openprivacy.ca/feed.xml 1440" > openprivacy-blog/feedinfo
feedinfo just contains a single line with the URL of the feed and how often to check for updates (in minutes, in this case 1440 is once per day)
You can now run
raccoon update to fetch all of your feeds over Tor. It will only attempt to fetch feeds that haven't been checked for the given update period.
To produce reports, you can run
raccoon report <report.template> and raccoon will produce a markdown/html hybrid of a report that can be piped to a utility like
markdown to produce a html report.
report.template file can be customized as needed, some basic guidelines to the format:
#are printed as-is (for injecting HTML or markdown specifically)
Report lines have the following (rought) format:
<folder-name> ALL|DAY|WEEK|[0-9]* (Title|Link|Description)*
Each report line can either print out a list of ALL items in the feed, or all items from the last DAY or the last WEEK, or a specific feed item (counting from 0)
For each feed item you can print out the Title, Link & Description or any combination.
Please see the report.template provided in this repository for a more complete example.
You can also download images (or technically any other file) using a file called
images in the directory (see the
pt-reyes folder) - this is useful if you want to download specific data (like satellite images) from a resource that updates fairly often.
You will need to be running a local
tor proxy on port
There is very little in the way of graceful error handling, contributions appreciated, please also feel free to submit issues & feature requests.