aboutsummaryrefslogtreecommitdiff
path: root/rp/rcynic
AgeCommit message (Collapse)Author
2018-01-09[apnic-deprecated-tas] remove deprecated apnic trust anchorsTom Harrison
2017-01-14ARIN now allows download of their TAL without NDA, so include it.Rob Austein
2017-01-12Kludge to show TAL filename as "hostname" for TAL-related errors.Rob Austein
2016-07-19Implement new recommendation for HTTPS validation: try with validationRob Austein
enabled, if that fails, whine and retry with validation disabled. svn path=/branches/tk705/; revision=6448
2016-05-26Remove gratuitous None values from status database -- this appears toRob Austein
have been incomplete conversion from an older internal API, back when we still had Generation objects. In any case, status="None" in rcynic.xml is wrong, and has been giving rcynic-html indigestion. svn path=/branches/tk705/; revision=6440
2016-05-24More http:// => https:// changes in documentation links.Rob Austein
svn path=/branches/tk705/; revision=6436
2016-05-07Oops, TeX-style "--" numeric ranges in copyright comments are bad fitRob Austein
for XML. Apparently we were carefully changing just the XML files to use a single "-" to work around this. Enough already, just convert all copyright year ranges to single "-" and have done with this. svn path=/branches/tk705/; revision=6427
2016-05-07More copyright notices, what fun.Rob Austein
svn path=/branches/tk705/; revision=6426
2016-05-07Copyright notice update, first round: files that are entirely newRob Austein
since copyright holder of record changed. svn path=/branches/tk705/; revision=6425
2016-04-26Further consolidation of config file parsing, command line parsing,Rob Austein
and logging setup. Most programs now use the unified mechanism, although there are still a few holdouts: the GUI, which is a special case because it has no command line, and the rpki-rtr program, which, for historical reasons has its own implementation of the logging setup infrastructure. svn path=/branches/tk705/; revision=6390
2016-04-24Disable TALs for a couple more testbeds as we edge towards consideringRob Austein
the default configuration to be production rather than testing.w svn path=/branches/tk705/; revision=6388
2016-04-21Update the GUI to work with the new rcynicdb.Michael Elkins
svn path=/branches/tk705/; revision=6365
2016-04-03Move more programs to integrated config+argparse framework.Rob Austein
svn path=/branches/tk705/; revision=6346
2016-04-02Teach rcynicng to read command line defaults from rpki.conf. Some ofRob Austein
this takes the form of new rpki.config.parser methods which we may want to use in other programs, particularly the daemons. svn path=/branches/tk705/; revision=6345
2016-03-21[6322] broke "make test", fix by allowing rpkic to run with warningRob Austein
when RPKI_USER not found. svn path=/branches/tk705/; revision=6323
2016-03-20Clean up rcynic installation, run rcynicng instead of (old) rcynic, clean up ↵Rob Austein
rcynic-cron. NB: rpkigui-rcynic is currently broken and is therefore disabled in rcynic-cron. This needs to be fixed, but it was broken on this branch in any case, no real point in holding up the rest of this waiting for it. svn path=/branches/tk705/; revision=6321
2016-03-03Speed up snapshot loading and cleanup with huge data sets.Rob Austein
svn path=/branches/tk705/; revision=6307
2016-03-01Fix bug introduced while refactoring bulk SQL insertion.Rob Austein
svn path=/branches/tk705/; revision=6306
2016-03-01Somewhat cleaner version of bulk snapshot loader.Rob Austein
svn path=/branches/tk705/; revision=6305
2016-03-01Much faster loading of large RRDP snapshots. Code is messy and needsRob Austein
cleanup, but runs more than an order of magnitude faster in common case where the vast majority of objects in the snapshot are new, and (in theory) should not be significantly slower than what we were doing already in more complicated mixtures. svn path=/branches/tk705/; revision=6303
2016-02-29Doh, "session_id", not "uuid".Rob Austein
svn path=/branches/tk705/; revision=6302
2016-02-29Tighter syntax checks on snapshots and deltas, in lieu of RelaxNG validation.Rob Austein
svn path=/branches/tk705/; revision=6301
2016-02-29Use lxml.etree.iterparse() for delta files too.Rob Austein
svn path=/branches/tk705/; revision=6300
2016-02-29Stash unparsed XML in a temporary file so we can get off the phoneRob Austein
quickly when processing large snapshots which take (much) longer to load into SQL than to pull down from the net. Given this change, lxml.etree.iterparse() is a more suitable API than lxml.etree.XMLPullParser, so switch. This version can download and process a 120,000 object snapshot, albeit hideously slowly. svn path=/branches/tk705/; revision=6299
2016-02-27Helps to get the field names right when cleaning up.Rob Austein
svn path=/branches/tk705/; revision=6298
2016-02-27Use an incremental parser for snapshot files.Rob Austein
svn path=/branches/tk705/; revision=6297
2016-02-15Checkpoint while shuffling stuff around for new installation scheme.Rob Austein
Installation of everything but Debian packages is probably broken, and Debian packages are too at the moment due to (probably) minor errors in buildtools/debian-skeleton, but enough has changed that this really needs a snapshot checked in for backup. svn path=/branches/tk705/; revision=6257
2016-02-08Add note on TLS certificate validation.Rob Austein
svn path=/branches/tk705/; revision=6241
2016-01-29Tweaks to handle large RRDP deltas better.Rob Austein
svn path=/branches/tk705/; revision=6240
2016-01-29Whack rcynicng to produce an XML file which rcynic-html can parse:Rob Austein
needs further work, but produces somewhat-useful output now. Start merging command line argument (argparse) and config file (ConfigParser) support into a unified library module, in an attempt to reduce the amount of code duplication and reign in some of the configuration chaos. Trigger for this is all of the RP programs now needing SQL configuration. Whack rpki.rcynicdb.models to work with PostgreSQL, which has length restrictions on indexed columns. svn path=/branches/tk705/; revision=6239
2016-01-28Add HTTPS timeout control.Rob Austein
svn path=/branches/tk705/; revision=6238
2016-01-23Cleanup.Rob Austein
svn path=/branches/tk705/; revision=6235
2016-01-23Pre-fetch a small number of deltas ahead of what we're currentlyRob Austein
loading in RRDP delta processing loop, to keep the pipe full and avoid sitting idle while processing a long series of deltas. svn path=/branches/tk705/; revision=6234
2016-01-23Tweak logging. Rewrite object checking loop to be a bit clearer.Rob Austein
svn path=/branches/tk705/; revision=6233
2016-01-23Cleanup.Rob Austein
svn path=/branches/tk705/; revision=6232
2016-01-23Add multiple-URI TAL support to rcynicng.Rob Austein
Whack CA tools with a club until rcynicng works with our CA RRDP implementation. Add makemigrations target to top-level Makefile; this is a bit of a kludge, but sure beats doing this by hand. svn path=/branches/tk705/; revision=6230
2016-01-20Process deltas incrementally (one SQL commit per delta) and mutateRob Austein
existing RRDPSnapshot objects while applying deltas rather than creating new ones. This simplifies cleanup, avoids locking out the I/O loop for the duration of a long commit, and allows us to salvage whatever progress we were able to make if a network problem stops us partway through fetching a long series of deltas. svn path=/branches/tk705/; revision=6229
2016-01-20Handle TLS errors. Log a bit more about delta processing.Rob Austein
svn path=/branches/tk705/; revision=6228
2016-01-20Tweak cleanup code again.Rob Austein
svn path=/branches/tk705/; revision=6227
2016-01-16More exception handling (socket.error, IOError, ...).Rob Austein
svn path=/branches/tk705/; revision=6226
2016-01-16Clean up HTTPS error handling. Attempt to work around DjangoRob Austein
limitations copying large sets of related objects. svn path=/branches/tk705/; revision=6225
2016-01-15RRDP seems to work now, at least with RIPE's implementation.Rob Austein
svn path=/branches/tk705/; revision=6224
2016-01-14Rework final_cleanup() to have some chance of working with RRDP.Rob Austein
svn path=/branches/tk705/; revision=6223
2016-01-13Checkpoint of first cut at RRDP client code. RRDP client code not yetRob Austein
tested, and final_cleanup() needs work to avoid trashing RRDP state. svn path=/branches/tk705/; revision=6222
2016-01-11Add (preliminary) database cleanup code.Rob Austein
svn path=/branches/tk705/; revision=6221
2016-01-11Add rcynic-dump as a blunt instrument to let existing file-basedRob Austein
programs use rcynicng's output. Long term, such programs should read the database instead, but being able to diff directory trees is useful while testing. svn path=/branches/tk705/; revision=6220
2016-01-10First apparently-working version of rcynicng using database instead ofRob Austein
disk files. rcynic.xml output looks reasonable. Don't yet have any other tools which know how to walk the result database, so can't (yet) compare results with rcynic. Does not yet do any cleanup of old data, so will eventually consume all disk space in the universe until this is fixed. svn path=/branches/tk705/; revision=6219
2016-01-08Start converting rcynicng to use a database.Rob Austein
svn path=/branches/tk705/; revision=6218
2015-12-07Finish prying RPKI conformance checks apart from object verification.Rob Austein
svn path=/branches/tk705/; revision=6214
2015-12-07Start decoupling RPKI profile conformance checks from objectRob Austein
verification per se. Clean up nasty mess in profile conformance checks for router certificates. svn path=/branches/tk705/; revision=6211