aboutsummaryrefslogtreecommitdiff
path: root/rp
AgeCommit message (Collapse)Author
2016-03-21[6322] broke "make test", fix by allowing rpkic to run with warningRob Austein
when RPKI_USER not found. svn path=/branches/tk705/; revision=6323
2016-03-20Clean up rcynic installation, run rcynicng instead of (old) rcynic, clean up ↵Rob Austein
rcynic-cron. NB: rpkigui-rcynic is currently broken and is therefore disabled in rcynic-cron. This needs to be fixed, but it was broken on this branch in any case, no real point in holding up the rest of this waiting for it. svn path=/branches/tk705/; revision=6321
2016-03-19Internal sudo wrapper to deal with PostgreSQL access control issues.Rob Austein
svn path=/branches/tk705/; revision=6319
2016-03-19Pull changes from trunk. Closes #784.Rob Austein
svn path=/branches/tk705/; revision=6316
2016-03-03Speed up snapshot loading and cleanup with huge data sets.Rob Austein
svn path=/branches/tk705/; revision=6307
2016-03-01Fix bug introduced while refactoring bulk SQL insertion.Rob Austein
svn path=/branches/tk705/; revision=6306
2016-03-01Somewhat cleaner version of bulk snapshot loader.Rob Austein
svn path=/branches/tk705/; revision=6305
2016-03-01Much faster loading of large RRDP snapshots. Code is messy and needsRob Austein
cleanup, but runs more than an order of magnitude faster in common case where the vast majority of objects in the snapshot are new, and (in theory) should not be significantly slower than what we were doing already in more complicated mixtures. svn path=/branches/tk705/; revision=6303
2016-02-29Doh, "session_id", not "uuid".Rob Austein
svn path=/branches/tk705/; revision=6302
2016-02-29Tighter syntax checks on snapshots and deltas, in lieu of RelaxNG validation.Rob Austein
svn path=/branches/tk705/; revision=6301
2016-02-29Use lxml.etree.iterparse() for delta files too.Rob Austein
svn path=/branches/tk705/; revision=6300
2016-02-29Stash unparsed XML in a temporary file so we can get off the phoneRob Austein
quickly when processing large snapshots which take (much) longer to load into SQL than to pull down from the net. Given this change, lxml.etree.iterparse() is a more suitable API than lxml.etree.XMLPullParser, so switch. This version can download and process a 120,000 object snapshot, albeit hideously slowly. svn path=/branches/tk705/; revision=6299
2016-02-27Helps to get the field names right when cleaning up.Rob Austein
svn path=/branches/tk705/; revision=6298
2016-02-27Use an incremental parser for snapshot files.Rob Austein
svn path=/branches/tk705/; revision=6297
2016-02-19Add rp_key_dir, mostly to simplify testing with yamltest.Rob Austein
svn path=/branches/tk705/; revision=6271
2016-02-18Dedupe to avoid backing up the same database more than once.Rob Austein
svn path=/branches/tk705/; revision=6268
2016-02-17Add PostgreSQL and SQLite3 backup templates.Rob Austein
svn path=/branches/tk705/; revision=6267
2016-02-16Tweak file locations for root RPKI key, certificate, and TAL.Rob Austein
svn path=/branches/tk705/; revision=6265
2016-02-16Promote rpki-generate-root-certificate to supported status.Rob Austein
svn path=/branches/tk705/; revision=6264
2016-02-16Finally builds and installs properly on Ubuntu again;Rob Austein
no serious runtime testing yet. svn path=/branches/tk705/; revision=6262
2016-02-15Snapshot before whacking migrations.Rob Austein
svn path=/branches/tk705/; revision=6259
2016-02-15First round of silly bugfixes.Rob Austein
svn path=/branches/tk705/; revision=6258
2016-02-15Checkpoint while shuffling stuff around for new installation scheme.Rob Austein
Installation of everything but Debian packages is probably broken, and Debian packages are too at the moment due to (probably) minor errors in buildtools/debian-skeleton, but enough has changed that this really needs a snapshot checked in for backup. svn path=/branches/tk705/; revision=6257
2016-02-08Add note on TLS certificate validation.Rob Austein
svn path=/branches/tk705/; revision=6241
2016-01-29Tweaks to handle large RRDP deltas better.Rob Austein
svn path=/branches/tk705/; revision=6240
2016-01-29Whack rcynicng to produce an XML file which rcynic-html can parse:Rob Austein
needs further work, but produces somewhat-useful output now. Start merging command line argument (argparse) and config file (ConfigParser) support into a unified library module, in an attempt to reduce the amount of code duplication and reign in some of the configuration chaos. Trigger for this is all of the RP programs now needing SQL configuration. Whack rpki.rcynicdb.models to work with PostgreSQL, which has length restrictions on indexed columns. svn path=/branches/tk705/; revision=6239
2016-01-28Add HTTPS timeout control.Rob Austein
svn path=/branches/tk705/; revision=6238
2016-01-26Add (mostly) backwards-compatible iterator which handles findingRob Austein
authenticated RP data via either os.walk() or Django ORM database traversal. svn path=/branches/tk705/; revision=6236
2016-01-23Cleanup.Rob Austein
svn path=/branches/tk705/; revision=6235
2016-01-23Pre-fetch a small number of deltas ahead of what we're currentlyRob Austein
loading in RRDP delta processing loop, to keep the pipe full and avoid sitting idle while processing a long series of deltas. svn path=/branches/tk705/; revision=6234
2016-01-23Tweak logging. Rewrite object checking loop to be a bit clearer.Rob Austein
svn path=/branches/tk705/; revision=6233
2016-01-23Cleanup.Rob Austein
svn path=/branches/tk705/; revision=6232
2016-01-23Add multiple-URI TAL support to rcynicng.Rob Austein
Whack CA tools with a club until rcynicng works with our CA RRDP implementation. Add makemigrations target to top-level Makefile; this is a bit of a kludge, but sure beats doing this by hand. svn path=/branches/tk705/; revision=6230
2016-01-20Process deltas incrementally (one SQL commit per delta) and mutateRob Austein
existing RRDPSnapshot objects while applying deltas rather than creating new ones. This simplifies cleanup, avoids locking out the I/O loop for the duration of a long commit, and allows us to salvage whatever progress we were able to make if a network problem stops us partway through fetching a long series of deltas. svn path=/branches/tk705/; revision=6229
2016-01-20Handle TLS errors. Log a bit more about delta processing.Rob Austein
svn path=/branches/tk705/; revision=6228
2016-01-20Tweak cleanup code again.Rob Austein
svn path=/branches/tk705/; revision=6227
2016-01-16More exception handling (socket.error, IOError, ...).Rob Austein
svn path=/branches/tk705/; revision=6226
2016-01-16Clean up HTTPS error handling. Attempt to work around DjangoRob Austein
limitations copying large sets of related objects. svn path=/branches/tk705/; revision=6225
2016-01-15RRDP seems to work now, at least with RIPE's implementation.Rob Austein
svn path=/branches/tk705/; revision=6224
2016-01-14Rework final_cleanup() to have some chance of working with RRDP.Rob Austein
svn path=/branches/tk705/; revision=6223
2016-01-13Checkpoint of first cut at RRDP client code. RRDP client code not yetRob Austein
tested, and final_cleanup() needs work to avoid trashing RRDP state. svn path=/branches/tk705/; revision=6222
2016-01-11Add (preliminary) database cleanup code.Rob Austein
svn path=/branches/tk705/; revision=6221
2016-01-11Add rcynic-dump as a blunt instrument to let existing file-basedRob Austein
programs use rcynicng's output. Long term, such programs should read the database instead, but being able to diff directory trees is useful while testing. svn path=/branches/tk705/; revision=6220
2016-01-10First apparently-working version of rcynicng using database instead ofRob Austein
disk files. rcynic.xml output looks reasonable. Don't yet have any other tools which know how to walk the result database, so can't (yet) compare results with rcynic. Does not yet do any cleanup of old data, so will eventually consume all disk space in the universe until this is fixed. svn path=/branches/tk705/; revision=6219
2016-01-08Start converting rcynicng to use a database.Rob Austein
svn path=/branches/tk705/; revision=6218
2015-12-08Fall back to HTTP if we can't find an HTTPS URI for rpkiNotify; theRob Austein
latest specification says HTTPS, but enough of the existing code has not yet caught up that it's useful to see the HTTP URIs when the HTTPS ones are missing. svn path=/branches/tk705/; revision=6215
2015-12-07Finish prying RPKI conformance checks apart from object verification.Rob Austein
svn path=/branches/tk705/; revision=6214
2015-12-07Start decoupling RPKI profile conformance checks from objectRob Austein
verification per se. Clean up nasty mess in profile conformance checks for router certificates. svn path=/branches/tk705/; revision=6211
2015-12-07Move validation callback to Python.Rob Austein
svn path=/branches/tk705/; revision=6210
2015-12-06Fix rcynicng directory rotation code. Checkpoint along the way toRob Austein
cleanup of POW.c RPKI conformance checking code. svn path=/branches/tk705/; revision=6208
generated by cgit v1.2.3 (git 2.25.1) at 2025-05-11 12:31:35 +0000