aboutsummaryrefslogtreecommitdiff
path: root/rpki
AgeCommit message (Collapse)Author
2016-04-03Move more programs to integrated config+argparse framework.Rob Austein
svn path=/branches/tk705/; revision=6346
2016-04-02Teach rcynicng to read command line defaults from rpki.conf. Some ofRob Austein
this takes the form of new rpki.config.parser methods which we may want to use in other programs, particularly the daemons. svn path=/branches/tk705/; revision=6345
2016-03-30Clean up and simplify rpkic privilege-dropping code. All sudo voodooRob Austein
is now handled in the outermost script, before rpki.rpkic is even loaded; rpki.rpkic just assumes that euid and ruid have been set up correctly and swaps them temporarily when it needs to do file I/O. svn path=/branches/tk705/; revision=6340
2016-03-30Still more UID-swapped file I/O, and general cleanup of UI file I/O.Rob Austein
GUI no longer uses (an additional layer of) temporary files between itself and zookeeper. Zookeeper file read methods now take file-like objects. rpkic now opens input files as the real UID, then reverts back to the effective UID before handing the resulting file off to the zookeeper. This caught several more instances of rpkic file I/O that were not doing the real/effective UID swap properly while loading CSV and VCard files. As far as I can tell from testing, this didn't break anything that worked before. Whether it fixed all the file I/O problems remains to be seen. svn path=/branches/tk705/; revision=6339
2016-03-29rpkic needs to do uid swapping around XML reads too.Rob Austein
rpki.irdb.zookeeper.etree_read(), the functions that call it, and the functions that call them, could all use a bit of refactoring. At this point pretty much ever caller is jumping through some hoop or another due to the way the code has evolved, and most of it could be simpler. svn path=/branches/tk705/; revision=6338
2016-03-29Initial fixes to rpkigui-rcynic. Still not working, but failing in aRob Austein
more interesting way now. svn path=/branches/tk705/; revision=6335
2016-03-28Apparently we lost DOWNLOAD_DIRECTORY while consolidating the GUI'sRob Austein
Django settings with those of all the other ORM-using programs. svn path=/branches/tk705/; revision=6333
2016-03-23Wrap a MySQL-specific error check so it doesn't cause problems when using ↵Rob Austein
other engines. svn path=/branches/tk705/; revision=6326
2016-03-21Django API fashion police renamed "mimetype" to be "content_type".Rob Austein
svn path=/branches/tk705/; revision=6324
2016-03-21[6322] broke "make test", fix by allowing rpkic to run with warningRob Austein
when RPKI_USER not found. svn path=/branches/tk705/; revision=6323
2016-03-21Rework rpkic setuid handling to something a bit more robust.Rob Austein
svn path=/branches/tk705/; revision=6322
2016-03-20Clean up rcynic installation, run rcynicng instead of (old) rcynic, clean up ↵Rob Austein
rcynic-cron. NB: rpkigui-rcynic is currently broken and is therefore disabled in rcynic-cron. This needs to be fixed, but it was broken on this branch in any case, no real point in holding up the rest of this waiting for it. svn path=/branches/tk705/; revision=6321
2016-03-03Speed up snapshot loading and cleanup with huge data sets.Rob Austein
svn path=/branches/tk705/; revision=6307
2016-03-01Clean up after switching from XMLPullParser to iterparse: put modelsRob Austein
back the way they were before we started with XMLPullParser. svn path=/branches/tk705/; revision=6304
2016-02-27Use an incremental parser for snapshot files.Rob Austein
svn path=/branches/tk705/; revision=6297
2016-02-26Tweak UpdateROAsTask to create new ROAs before worrying about updating old ones.Rob Austein
svn path=/branches/tk705/; revision=6296
2016-02-26Using a Tornado yield dictionary is elegant (not to mention cute), butRob Austein
using a single bulk IRDB query for all the child data that UpdateChildrenTask needs is a better solution. svn path=/branches/tk705/; revision=6295
2016-02-26Simplify UpdateChildrenTask.Rob Austein
svn path=/branches/tk705/; revision=6294
2016-02-26Tweak default rpkid timing parameters.Rob Austein
svn path=/branches/tk705/; revision=6293
2016-02-25Helps to add task back into the queue when postponing, doh.Rob Austein
svn path=/branches/tk705/; revision=6292
2016-02-25Tweak postponement code so that, if everything in the task queue hasRob Austein
already been postponed at least once, we stay with the current task rather than doing a forced round-robin. This may require further tweaks, eg, to flush the publication queue at regular intervals even if we're not postponing, but the intent is to allow tasks with complex setup to run to completion while remaining responsive, to avoid wasting all of our time on repeated setup overhead. svn path=/branches/tk705/; revision=6291
2016-02-25Need to pass PostponeTask exception up the line for it to work properly.Rob Austein
svn path=/branches/tk705/; revision=6290
2016-02-25Major simplifcation of rpkid's internal tasking system.Rob Austein
svn path=/branches/tk705/; revision=6289
2016-02-25Clean up allocation of CRL/manifest numbers. We might want to putRob Austein
both this and certificate serial number allocation under a lock, but doing so would require converting a lot of plain methods into coroutines, so postpone that decision until we're done with revisions to the task scheduler. svn path=/branches/tk705/; revision=6288
2016-02-25Fix inverted loop variables in orphaned resource class destructor.Rob Austein
svn path=/branches/tk705/; revision=6287
2016-02-25Have to supply inception time explicitly when creating manifest EERob Austein
certificate, to make certain that it is not later than manifest thisUpdate value. svn path=/branches/tk705/; revision=6286
2016-02-25Dumb errors constructing key for temporary dict() were causing us toRob Austein
generate duplicate ROAs. svn path=/branches/tk705/; revision=6283
2016-02-23Rework ROA postponement code to lower memory footprint.Rob Austein
svn path=/branches/tk705/; revision=6280
2016-02-21Be a bit more frugal with memory: serialize XML directly to disk, and,Rob Austein
in the case of snapshot files, serialize incrementally. svn path=/branches/tk705/; revision=6279
2016-02-21Don't really need delta XML in SQL either, just need the hash.Rob Austein
svn path=/branches/tk705/; revision=6278
2016-02-21We don't really need to store the full XML snapshot in SQL. We don'tRob Austein
really need to store the delta XML either, but that code's a bit more complicated, so leave it alone for the moment. svn path=/branches/tk705/; revision=6277
2016-02-21Some rpkid tweaks to work better with large data sets.Rob Austein
svn path=/branches/tk705/; revision=6276
2016-02-20Apparently we have to set the timeout in the HTTPRequest object.Rob Austein
svn path=/branches/tk705/; revision=6275
2016-02-20Don't traceback on synchronization errors.Rob Austein
svn path=/branches/tk705/; revision=6274
2016-02-19Task system tweaks, see if this fixes hangs on postponed tasks.Rob Austein
svn path=/branches/tk705/; revision=6273
2016-02-19Add http-client-timeout parameter, default to something more patientRob Austein
than one would use in an interactive program. svn path=/branches/tk705/; revision=6272
2016-02-16Finally builds and installs properly on Ubuntu again;Rob Austein
no serious runtime testing yet. svn path=/branches/tk705/; revision=6262
2016-02-15Add (back) initial migration for rpki.rcynicdb.Rob Austein
svn path=/branches/tk705/; revision=6260
2016-02-09Commit a couple of bugfixes Lachlan Kang found last summer (inRob Austein
research-only code, nothing anyone would use in production) which fell through the cracks somehow. svn path=/branches/tk705/; revision=6243
2016-01-29Whack rcynicng to produce an XML file which rcynic-html can parse:Rob Austein
needs further work, but produces somewhat-useful output now. Start merging command line argument (argparse) and config file (ConfigParser) support into a unified library module, in an attempt to reduce the amount of code duplication and reign in some of the configuration chaos. Trigger for this is all of the RP programs now needing SQL configuration. Whack rpki.rcynicdb.models to work with PostgreSQL, which has length restrictions on indexed columns. svn path=/branches/tk705/; revision=6239
2016-01-26Use new rcynicdb iterator for rpki-rtr generation. May need to reviseRob Austein
command line syntax for "rpki-rtr cronjob" command; the current syntax works, but is unnecessarily confusing. svn path=/branches/tk705/; revision=6237
2016-01-26Add (mostly) backwards-compatible iterator which handles findingRob Austein
authenticated RP data via either os.walk() or Django ORM database traversal. svn path=/branches/tk705/; revision=6236
2016-01-23Remove last vestiges of "__metaclass__ = models.SubfieldBase"Rob Austein
(deprecated in Django 1.9, scheduled to be removed in Django 1.10). svn path=/branches/tk705/; revision=6231
2016-01-23Add multiple-URI TAL support to rcynicng.Rob Austein
Whack CA tools with a club until rcynicng works with our CA RRDP implementation. Add makemigrations target to top-level Makefile; this is a bit of a kludge, but sure beats doing this by hand. svn path=/branches/tk705/; revision=6230
2016-01-15RRDP seems to work now, at least with RIPE's implementation.Rob Austein
svn path=/branches/tk705/; revision=6224
2016-01-13Checkpoint of first cut at RRDP client code. RRDP client code not yetRob Austein
tested, and final_cleanup() needs work to avoid trashing RRDP state. svn path=/branches/tk705/; revision=6222
2016-01-11Add (preliminary) database cleanup code.Rob Austein
svn path=/branches/tk705/; revision=6221
2016-01-11Add rcynic-dump as a blunt instrument to let existing file-basedRob Austein
programs use rcynicng's output. Long term, such programs should read the database instead, but being able to diff directory trees is useful while testing. svn path=/branches/tk705/; revision=6220
2016-01-10First apparently-working version of rcynicng using database instead ofRob Austein
disk files. rcynic.xml output looks reasonable. Don't yet have any other tools which know how to walk the result database, so can't (yet) compare results with rcynic. Does not yet do any cleanup of old data, so will eventually consume all disk space in the universe until this is fixed. svn path=/branches/tk705/; revision=6219
2016-01-08Start converting rcynicng to use a database.Rob Austein
svn path=/branches/tk705/; revision=6218
generated by cgit v1.2.3 (git 2.25.1) at 2025-05-10 09:31:50 +0000