aboutsummaryrefslogtreecommitdiff
path: root/rp
AgeCommit message (Collapse)Author
2016-02-15Checkpoint while shuffling stuff around for new installation scheme.Rob Austein
Installation of everything but Debian packages is probably broken, and Debian packages are too at the moment due to (probably) minor errors in buildtools/debian-skeleton, but enough has changed that this really needs a snapshot checked in for backup. svn path=/branches/tk705/; revision=6257
2016-02-08Add note on TLS certificate validation.Rob Austein
svn path=/branches/tk705/; revision=6241
2016-01-29Tweaks to handle large RRDP deltas better.Rob Austein
svn path=/branches/tk705/; revision=6240
2016-01-29Whack rcynicng to produce an XML file which rcynic-html can parse:Rob Austein
needs further work, but produces somewhat-useful output now. Start merging command line argument (argparse) and config file (ConfigParser) support into a unified library module, in an attempt to reduce the amount of code duplication and reign in some of the configuration chaos. Trigger for this is all of the RP programs now needing SQL configuration. Whack rpki.rcynicdb.models to work with PostgreSQL, which has length restrictions on indexed columns. svn path=/branches/tk705/; revision=6239
2016-01-28Add HTTPS timeout control.Rob Austein
svn path=/branches/tk705/; revision=6238
2016-01-26Add (mostly) backwards-compatible iterator which handles findingRob Austein
authenticated RP data via either os.walk() or Django ORM database traversal. svn path=/branches/tk705/; revision=6236
2016-01-23Cleanup.Rob Austein
svn path=/branches/tk705/; revision=6235
2016-01-23Pre-fetch a small number of deltas ahead of what we're currentlyRob Austein
loading in RRDP delta processing loop, to keep the pipe full and avoid sitting idle while processing a long series of deltas. svn path=/branches/tk705/; revision=6234
2016-01-23Tweak logging. Rewrite object checking loop to be a bit clearer.Rob Austein
svn path=/branches/tk705/; revision=6233
2016-01-23Cleanup.Rob Austein
svn path=/branches/tk705/; revision=6232
2016-01-23Add multiple-URI TAL support to rcynicng.Rob Austein
Whack CA tools with a club until rcynicng works with our CA RRDP implementation. Add makemigrations target to top-level Makefile; this is a bit of a kludge, but sure beats doing this by hand. svn path=/branches/tk705/; revision=6230
2016-01-20Process deltas incrementally (one SQL commit per delta) and mutateRob Austein
existing RRDPSnapshot objects while applying deltas rather than creating new ones. This simplifies cleanup, avoids locking out the I/O loop for the duration of a long commit, and allows us to salvage whatever progress we were able to make if a network problem stops us partway through fetching a long series of deltas. svn path=/branches/tk705/; revision=6229
2016-01-20Handle TLS errors. Log a bit more about delta processing.Rob Austein
svn path=/branches/tk705/; revision=6228
2016-01-20Tweak cleanup code again.Rob Austein
svn path=/branches/tk705/; revision=6227
2016-01-16More exception handling (socket.error, IOError, ...).Rob Austein
svn path=/branches/tk705/; revision=6226
2016-01-16Clean up HTTPS error handling. Attempt to work around DjangoRob Austein
limitations copying large sets of related objects. svn path=/branches/tk705/; revision=6225
2016-01-15RRDP seems to work now, at least with RIPE's implementation.Rob Austein
svn path=/branches/tk705/; revision=6224
2016-01-14Rework final_cleanup() to have some chance of working with RRDP.Rob Austein
svn path=/branches/tk705/; revision=6223
2016-01-13Checkpoint of first cut at RRDP client code. RRDP client code not yetRob Austein
tested, and final_cleanup() needs work to avoid trashing RRDP state. svn path=/branches/tk705/; revision=6222
2016-01-11Add (preliminary) database cleanup code.Rob Austein
svn path=/branches/tk705/; revision=6221
2016-01-11Add rcynic-dump as a blunt instrument to let existing file-basedRob Austein
programs use rcynicng's output. Long term, such programs should read the database instead, but being able to diff directory trees is useful while testing. svn path=/branches/tk705/; revision=6220
2016-01-10First apparently-working version of rcynicng using database instead ofRob Austein
disk files. rcynic.xml output looks reasonable. Don't yet have any other tools which know how to walk the result database, so can't (yet) compare results with rcynic. Does not yet do any cleanup of old data, so will eventually consume all disk space in the universe until this is fixed. svn path=/branches/tk705/; revision=6219
2016-01-08Start converting rcynicng to use a database.Rob Austein
svn path=/branches/tk705/; revision=6218
2015-12-08Fall back to HTTP if we can't find an HTTPS URI for rpkiNotify; theRob Austein
latest specification says HTTPS, but enough of the existing code has not yet caught up that it's useful to see the HTTP URIs when the HTTPS ones are missing. svn path=/branches/tk705/; revision=6215
2015-12-07Finish prying RPKI conformance checks apart from object verification.Rob Austein
svn path=/branches/tk705/; revision=6214
2015-12-07Start decoupling RPKI profile conformance checks from objectRob Austein
verification per se. Clean up nasty mess in profile conformance checks for router certificates. svn path=/branches/tk705/; revision=6211
2015-12-07Move validation callback to Python.Rob Austein
svn path=/branches/tk705/; revision=6210
2015-12-06Fix rcynicng directory rotation code. Checkpoint along the way toRob Austein
cleanup of POW.c RPKI conformance checking code. svn path=/branches/tk705/; revision=6208
2015-11-29Fix confused handling of staleness flags.Rob Austein
svn path=/branches/tk705/; revision=6207
2015-11-29Simplify main object checking loop by moving loop over objectRob Austein
generations inside the loop over manifest entries. svn path=/branches/tk705/; revision=6206
2015-11-29Move more trivial tests from C to Python.Rob Austein
svn path=/branches/tk705/; revision=6205
2015-11-29rcynicng caught a bug in rpkid! Router certificates are forbiddenRob Austein
from having SIA extensions, unlike all other RPKI certificates which are required to have them. Start moving RPKI conformance checks which can be performed in Python out of POW.c, tag a bunch more for consideration. svn path=/branches/tk705/; revision=6204
2015-11-28yield when putting to task queue even though we expect the future toRob Austein
resolve immediately, just in case something throws an exception. Don't try to be clever about when to yield in main object checking loop: just trusting Tornado's scheduler to do the right thing seems to give better rsync throughput. svn path=/branches/tk705/; revision=6203
2015-11-28Clean up CheckTALTask.Rob Austein
svn path=/branches/tk705/; revision=6202
2015-11-28Handle staleness and staleness-tainting checks in Python.Rob Austein
svn path=/branches/tk705/; revision=6201
2015-11-28Record staleness tainting.Rob Austein
svn path=/branches/tk705/; revision=6200
2015-11-27Simplify manifest walking code: we don't need to walk both current andRob Austein
backup manifests, we just need to walk the best manifest we can find, twice. svn path=/branches/tk705/; revision=6198
2015-11-27Tweaks to bring rcynicng more into line with rcynic's behavior.Rob Austein
svn path=/branches/tk705/; revision=6196
2015-11-26Oops, RRDP now mandates HTTPS instead of HTTP.Rob Austein
svn path=/branches/tk705/; revision=6195
2015-11-25Starting to look like a validator. Still gets different somewhatRob Austein
results from the original rcynic, still some loose ends and unfinished bits, and no support for RRDP yet (which was sort of the ultimate point of the exercise), but approaching the point of being usable, and about an order of magnitude shorter than the C original. svn path=/branches/tk705/; revision=6194
2015-11-24Add stack forking. At this point the basic tasking structure looks complete.Rob Austein
svn path=/branches/tk705/; revision=6191
2015-11-23first pass on XML output. Incomplete, but enough to get a usefulRob Austein
summary from rcynic-text. svn path=/branches/tk705/; revision=6187
2015-11-23Sort out swamp of multiple generations of manifests and picking best CRL.Rob Austein
svn path=/branches/tk705/; revision=6186
2015-11-22Convert certificate tree walking code to use new tasking model.Rob Austein
Get full rsync code working, history cache and all. svn path=/branches/tk705/; revision=6184
2015-11-20Checkpoint. Not useful yet, but starting to come together. Tornado is awesome.Rob Austein
svn path=/branches/tk705/; revision=6182
2015-11-18Move StatusCode out of POW.c. New API still needs work, but thisRob Austein
makes the C code considerably simpler. svn path=/branches/tk705/; revision=6180
2015-11-18First test of new validation code. No major surprises. Much testingRob Austein
left to do, still need to add in stuff that we pushed out to Python rather than trying to do in C (eg, a lot of the URI tests), but basics seem to work. Checkpointing before attempting a major simplification of the StatusCode mechanism. svn path=/branches/tk705/; revision=6179
2015-11-17First baby steps towards testing new rpki.POW extended validation code.Rob Austein
svn path=/branches/tk705/; revision=6178
2015-11-11Configure pylint to use the pylint-django plugin, which (mostly)Rob Austein
understands Django's exotic metaclasses, which in turn allows us to re-enable a number of pylint checks we had disabled. While we were at this, stripped out a bunch of old pylint pragmas, then added back the subset that were really needed. As usual with pylint, this turned up a few real bugs along with an awful lot of noise. svn path=/branches/tk705/; revision=6162
2015-10-26"Any programmer who fails to comply with the standard naming, formatting,Rob Austein
or commenting conventions should be shot. If it so happens that it is inconvenient to shoot him, then he is to be politely requested to recode his program in adherence to the above standard." -- Michael Spier, Digital Equipment Corporation svn path=/branches/tk705/; revision=6152