aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2016-03-18Switch rsync upload to use daemon mode over ssh, to give server betterRob Austein
control over precisely what this rsync client is allowed to do. svn path=/branches/tk705/; revision=6313
2016-03-18rpki-pbuilder.py hacked for multiple repositories, now passes initial tests.Rob Austein
svn path=/branches/tk705/; revision=6312
2016-03-17Create log directory when missing.Rob Austein
svn path=/branches/tk705/; revision=6310
2016-03-14Drop Cache-Control: max-age for RRDP notification files to matchRob Austein
current RRDP specification, and get the URI right while we're at it. svn path=/branches/tk705/; revision=6309
2016-03-10Cleanup.Rob Austein
svn path=/branches/tk705/; revision=6308
2016-03-03Speed up snapshot loading and cleanup with huge data sets.Rob Austein
svn path=/branches/tk705/; revision=6307
2016-03-01Fix bug introduced while refactoring bulk SQL insertion.Rob Austein
svn path=/branches/tk705/; revision=6306
2016-03-01Somewhat cleaner version of bulk snapshot loader.Rob Austein
svn path=/branches/tk705/; revision=6305
2016-03-01Clean up after switching from XMLPullParser to iterparse: put modelsRob Austein
back the way they were before we started with XMLPullParser. svn path=/branches/tk705/; revision=6304
2016-03-01Much faster loading of large RRDP snapshots. Code is messy and needsRob Austein
cleanup, but runs more than an order of magnitude faster in common case where the vast majority of objects in the snapshot are new, and (in theory) should not be significantly slower than what we were doing already in more complicated mixtures. svn path=/branches/tk705/; revision=6303
2016-02-29Doh, "session_id", not "uuid".Rob Austein
svn path=/branches/tk705/; revision=6302
2016-02-29Tighter syntax checks on snapshots and deltas, in lieu of RelaxNG validation.Rob Austein
svn path=/branches/tk705/; revision=6301
2016-02-29Use lxml.etree.iterparse() for delta files too.Rob Austein
svn path=/branches/tk705/; revision=6300
2016-02-29Stash unparsed XML in a temporary file so we can get off the phoneRob Austein
quickly when processing large snapshots which take (much) longer to load into SQL than to pull down from the net. Given this change, lxml.etree.iterparse() is a more suitable API than lxml.etree.XMLPullParser, so switch. This version can download and process a 120,000 object snapshot, albeit hideously slowly. svn path=/branches/tk705/; revision=6299
2016-02-27Helps to get the field names right when cleaning up.Rob Austein
svn path=/branches/tk705/; revision=6298
2016-02-27Use an incremental parser for snapshot files.Rob Austein
svn path=/branches/tk705/; revision=6297
2016-02-26Tweak UpdateROAsTask to create new ROAs before worrying about updating old ones.Rob Austein
svn path=/branches/tk705/; revision=6296
2016-02-26Using a Tornado yield dictionary is elegant (not to mention cute), butRob Austein
using a single bulk IRDB query for all the child data that UpdateChildrenTask needs is a better solution. svn path=/branches/tk705/; revision=6295
2016-02-26Simplify UpdateChildrenTask.Rob Austein
svn path=/branches/tk705/; revision=6294
2016-02-26Tweak default rpkid timing parameters.Rob Austein
svn path=/branches/tk705/; revision=6293
2016-02-25Helps to add task back into the queue when postponing, doh.Rob Austein
svn path=/branches/tk705/; revision=6292
2016-02-25Tweak postponement code so that, if everything in the task queue hasRob Austein
already been postponed at least once, we stay with the current task rather than doing a forced round-robin. This may require further tweaks, eg, to flush the publication queue at regular intervals even if we're not postponing, but the intent is to allow tasks with complex setup to run to completion while remaining responsive, to avoid wasting all of our time on repeated setup overhead. svn path=/branches/tk705/; revision=6291
2016-02-25Need to pass PostponeTask exception up the line for it to work properly.Rob Austein
svn path=/branches/tk705/; revision=6290
2016-02-25Major simplifcation of rpkid's internal tasking system.Rob Austein
svn path=/branches/tk705/; revision=6289
2016-02-25Clean up allocation of CRL/manifest numbers. We might want to putRob Austein
both this and certificate serial number allocation under a lock, but doing so would require converting a lot of plain methods into coroutines, so postpone that decision until we're done with revisions to the task scheduler. svn path=/branches/tk705/; revision=6288
2016-02-25Fix inverted loop variables in orphaned resource class destructor.Rob Austein
svn path=/branches/tk705/; revision=6287
2016-02-25Have to supply inception time explicitly when creating manifest EERob Austein
certificate, to make certain that it is not later than manifest thisUpdate value. svn path=/branches/tk705/; revision=6286
2016-02-25Dumb error in install options.Rob Austein
svn path=/branches/tk705/; revision=6285
2016-02-25Update to track rpki.POW changes.Rob Austein
svn path=/branches/tk705/; revision=6284
2016-02-25Dumb errors constructing key for temporary dict() were causing us toRob Austein
generate duplicate ROAs. svn path=/branches/tk705/; revision=6283
2016-02-25Use sys.executable to avoid potential $PATH problem.Rob Austein
svn path=/branches/tk705/; revision=6282
2016-02-24Rewrite rpkic wrapper to avoid running sudo unnecessarily.Rob Austein
svn path=/branches/tk705/; revision=6281
2016-02-23Rework ROA postponement code to lower memory footprint.Rob Austein
svn path=/branches/tk705/; revision=6280
2016-02-21Be a bit more frugal with memory: serialize XML directly to disk, and,Rob Austein
in the case of snapshot files, serialize incrementally. svn path=/branches/tk705/; revision=6279
2016-02-21Don't really need delta XML in SQL either, just need the hash.Rob Austein
svn path=/branches/tk705/; revision=6278
2016-02-21We don't really need to store the full XML snapshot in SQL. We don'tRob Austein
really need to store the delta XML either, but that code's a bit more complicated, so leave it alone for the moment. svn path=/branches/tk705/; revision=6277
2016-02-21Some rpkid tweaks to work better with large data sets.Rob Austein
svn path=/branches/tk705/; revision=6276
2016-02-20Apparently we have to set the timeout in the HTTPRequest object.Rob Austein
svn path=/branches/tk705/; revision=6275
2016-02-20Don't traceback on synchronization errors.Rob Austein
svn path=/branches/tk705/; revision=6274
2016-02-19Task system tweaks, see if this fixes hangs on postponed tasks.Rob Austein
svn path=/branches/tk705/; revision=6273
2016-02-19Add http-client-timeout parameter, default to something more patientRob Austein
than one would use in an interactive program. svn path=/branches/tk705/; revision=6272
2016-02-19Add rp_key_dir, mostly to simplify testing with yamltest.Rob Austein
svn path=/branches/tk705/; revision=6271
2016-02-19Bye bye, upstart, hello ancient init.d script which is once again theRob Austein
only thing that works on all Debian-derived platforms. Sigh. Oh well, at least this way we can express our dependency on PostgreSQL and let the user tweak logging options using /etc/default/rpki-ca. svn path=/branches/tk705/; revision=6270
2016-02-18Whack yamltest.py until it works again with latest changes to rpkic, etc.Rob Austein
svn path=/branches/tk705/; revision=6269
2016-02-18Dedupe to avoid backing up the same database more than once.Rob Austein
svn path=/branches/tk705/; revision=6268
2016-02-17Add PostgreSQL and SQLite3 backup templates.Rob Austein
svn path=/branches/tk705/; revision=6267
2016-02-16Whack CA upstart script to track recent changes. Going to need toRob Austein
rewrite this to work properly with systemd and init.d/postgresql. svn path=/branches/tk705/; revision=6266
2016-02-16Tweak file locations for root RPKI key, certificate, and TAL.Rob Austein
svn path=/branches/tk705/; revision=6265
2016-02-16Promote rpki-generate-root-certificate to supported status.Rob Austein
svn path=/branches/tk705/; revision=6264
2016-02-16pubd needs to be able to write to the publication directories.Rob Austein
svn path=/branches/tk705/; revision=6263