aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2016-02-29Tighter syntax checks on snapshots and deltas, in lieu of RelaxNG validation.Rob Austein
svn path=/branches/tk705/; revision=6301
2016-02-29Use lxml.etree.iterparse() for delta files too.Rob Austein
svn path=/branches/tk705/; revision=6300
2016-02-29Stash unparsed XML in a temporary file so we can get off the phoneRob Austein
quickly when processing large snapshots which take (much) longer to load into SQL than to pull down from the net. Given this change, lxml.etree.iterparse() is a more suitable API than lxml.etree.XMLPullParser, so switch. This version can download and process a 120,000 object snapshot, albeit hideously slowly. svn path=/branches/tk705/; revision=6299
2016-02-27Helps to get the field names right when cleaning up.Rob Austein
svn path=/branches/tk705/; revision=6298
2016-02-27Use an incremental parser for snapshot files.Rob Austein
svn path=/branches/tk705/; revision=6297
2016-02-26Tweak UpdateROAsTask to create new ROAs before worrying about updating old ones.Rob Austein
svn path=/branches/tk705/; revision=6296
2016-02-26Using a Tornado yield dictionary is elegant (not to mention cute), butRob Austein
using a single bulk IRDB query for all the child data that UpdateChildrenTask needs is a better solution. svn path=/branches/tk705/; revision=6295
2016-02-26Simplify UpdateChildrenTask.Rob Austein
svn path=/branches/tk705/; revision=6294
2016-02-26Tweak default rpkid timing parameters.Rob Austein
svn path=/branches/tk705/; revision=6293
2016-02-25Helps to add task back into the queue when postponing, doh.Rob Austein
svn path=/branches/tk705/; revision=6292
2016-02-25Tweak postponement code so that, if everything in the task queue hasRob Austein
already been postponed at least once, we stay with the current task rather than doing a forced round-robin. This may require further tweaks, eg, to flush the publication queue at regular intervals even if we're not postponing, but the intent is to allow tasks with complex setup to run to completion while remaining responsive, to avoid wasting all of our time on repeated setup overhead. svn path=/branches/tk705/; revision=6291
2016-02-25Need to pass PostponeTask exception up the line for it to work properly.Rob Austein
svn path=/branches/tk705/; revision=6290
2016-02-25Major simplifcation of rpkid's internal tasking system.Rob Austein
svn path=/branches/tk705/; revision=6289
2016-02-25Clean up allocation of CRL/manifest numbers. We might want to putRob Austein
both this and certificate serial number allocation under a lock, but doing so would require converting a lot of plain methods into coroutines, so postpone that decision until we're done with revisions to the task scheduler. svn path=/branches/tk705/; revision=6288
2016-02-25Fix inverted loop variables in orphaned resource class destructor.Rob Austein
svn path=/branches/tk705/; revision=6287
2016-02-25Have to supply inception time explicitly when creating manifest EERob Austein
certificate, to make certain that it is not later than manifest thisUpdate value. svn path=/branches/tk705/; revision=6286
2016-02-25Dumb error in install options.Rob Austein
svn path=/branches/tk705/; revision=6285
2016-02-25Update to track rpki.POW changes.Rob Austein
svn path=/branches/tk705/; revision=6284
2016-02-25Dumb errors constructing key for temporary dict() were causing us toRob Austein
generate duplicate ROAs. svn path=/branches/tk705/; revision=6283
2016-02-25Use sys.executable to avoid potential $PATH problem.Rob Austein
svn path=/branches/tk705/; revision=6282
2016-02-24Rewrite rpkic wrapper to avoid running sudo unnecessarily.Rob Austein
svn path=/branches/tk705/; revision=6281
2016-02-23Rework ROA postponement code to lower memory footprint.Rob Austein
svn path=/branches/tk705/; revision=6280
2016-02-21Be a bit more frugal with memory: serialize XML directly to disk, and,Rob Austein
in the case of snapshot files, serialize incrementally. svn path=/branches/tk705/; revision=6279
2016-02-21Don't really need delta XML in SQL either, just need the hash.Rob Austein
svn path=/branches/tk705/; revision=6278
2016-02-21We don't really need to store the full XML snapshot in SQL. We don'tRob Austein
really need to store the delta XML either, but that code's a bit more complicated, so leave it alone for the moment. svn path=/branches/tk705/; revision=6277
2016-02-21Some rpkid tweaks to work better with large data sets.Rob Austein
svn path=/branches/tk705/; revision=6276
2016-02-20Apparently we have to set the timeout in the HTTPRequest object.Rob Austein
svn path=/branches/tk705/; revision=6275
2016-02-20Don't traceback on synchronization errors.Rob Austein
svn path=/branches/tk705/; revision=6274
2016-02-19Task system tweaks, see if this fixes hangs on postponed tasks.Rob Austein
svn path=/branches/tk705/; revision=6273
2016-02-19Add http-client-timeout parameter, default to something more patientRob Austein
than one would use in an interactive program. svn path=/branches/tk705/; revision=6272
2016-02-19Add rp_key_dir, mostly to simplify testing with yamltest.Rob Austein
svn path=/branches/tk705/; revision=6271
2016-02-19Bye bye, upstart, hello ancient init.d script which is once again theRob Austein
only thing that works on all Debian-derived platforms. Sigh. Oh well, at least this way we can express our dependency on PostgreSQL and let the user tweak logging options using /etc/default/rpki-ca. svn path=/branches/tk705/; revision=6270
2016-02-18Whack yamltest.py until it works again with latest changes to rpkic, etc.Rob Austein
svn path=/branches/tk705/; revision=6269
2016-02-18Dedupe to avoid backing up the same database more than once.Rob Austein
svn path=/branches/tk705/; revision=6268
2016-02-17Add PostgreSQL and SQLite3 backup templates.Rob Austein
svn path=/branches/tk705/; revision=6267
2016-02-16Whack CA upstart script to track recent changes. Going to need toRob Austein
rewrite this to work properly with systemd and init.d/postgresql. svn path=/branches/tk705/; revision=6266
2016-02-16Tweak file locations for root RPKI key, certificate, and TAL.Rob Austein
svn path=/branches/tk705/; revision=6265
2016-02-16Promote rpki-generate-root-certificate to supported status.Rob Austein
svn path=/branches/tk705/; revision=6264
2016-02-16pubd needs to be able to write to the publication directories.Rob Austein
svn path=/branches/tk705/; revision=6263
2016-02-16Finally builds and installs properly on Ubuntu again;Rob Austein
no serious runtime testing yet. svn path=/branches/tk705/; revision=6262
2016-02-15Add (back) initial migration for rpki.rcynicdb.Rob Austein
svn path=/branches/tk705/; revision=6260
2016-02-15Snapshot before whacking migrations.Rob Austein
svn path=/branches/tk705/; revision=6259
2016-02-15First round of silly bugfixes.Rob Austein
svn path=/branches/tk705/; revision=6258
2016-02-15Checkpoint while shuffling stuff around for new installation scheme.Rob Austein
Installation of everything but Debian packages is probably broken, and Debian packages are too at the moment due to (probably) minor errors in buildtools/debian-skeleton, but enough has changed that this really needs a snapshot checked in for backup. svn path=/branches/tk705/; revision=6257
2016-02-14Cleanup.Rob Austein
svn path=/branches/tk705/; revision=6256
2016-02-14Revised rpki-sql-setup approaching something halfway sane. Still needRob Austein
to tweak rpki-confgen.xml and Debian rpki-*.{pre,post}{inst,rm} scripts before we'll know if the new approach really works properly. svn path=/branches/tk705/; revision=6255
2016-02-13Snapshot current almost-working version of rpki-sql-setup,Rob Austein
before whacking it in a slightly different direction. svn path=/branches/tk705/; revision=6254
2016-02-13Add back some logging.Rob Austein
svn path=/branches/tk705/; revision=6253
2016-02-12Update settings.py installation glorp.Rob Austein
svn path=/branches/tk705/; revision=6252
2016-02-12Debug PostgreSQL setup code. Make [rcynic] database optional for now.Rob Austein
svn path=/branches/tk705/; revision=6251
generated by cgit v1.2.3 (git 2.25.1) at 2025-05-12 07:55:02 +0000