aboutsummaryrefslogtreecommitdiff
path: root/rpki
AgeCommit message (Collapse)Author
2016-03-03Speed up snapshot loading and cleanup with huge data sets.Rob Austein
svn path=/branches/tk705/; revision=6307
2016-03-01Clean up after switching from XMLPullParser to iterparse: put modelsRob Austein
back the way they were before we started with XMLPullParser. svn path=/branches/tk705/; revision=6304
2016-02-27Use an incremental parser for snapshot files.Rob Austein
svn path=/branches/tk705/; revision=6297
2016-02-26Tweak UpdateROAsTask to create new ROAs before worrying about updating old ones.Rob Austein
svn path=/branches/tk705/; revision=6296
2016-02-26Using a Tornado yield dictionary is elegant (not to mention cute), butRob Austein
using a single bulk IRDB query for all the child data that UpdateChildrenTask needs is a better solution. svn path=/branches/tk705/; revision=6295
2016-02-26Simplify UpdateChildrenTask.Rob Austein
svn path=/branches/tk705/; revision=6294
2016-02-26Tweak default rpkid timing parameters.Rob Austein
svn path=/branches/tk705/; revision=6293
2016-02-25Helps to add task back into the queue when postponing, doh.Rob Austein
svn path=/branches/tk705/; revision=6292
2016-02-25Tweak postponement code so that, if everything in the task queue hasRob Austein
already been postponed at least once, we stay with the current task rather than doing a forced round-robin. This may require further tweaks, eg, to flush the publication queue at regular intervals even if we're not postponing, but the intent is to allow tasks with complex setup to run to completion while remaining responsive, to avoid wasting all of our time on repeated setup overhead. svn path=/branches/tk705/; revision=6291
2016-02-25Need to pass PostponeTask exception up the line for it to work properly.Rob Austein
svn path=/branches/tk705/; revision=6290
2016-02-25Major simplifcation of rpkid's internal tasking system.Rob Austein
svn path=/branches/tk705/; revision=6289
2016-02-25Clean up allocation of CRL/manifest numbers. We might want to putRob Austein
both this and certificate serial number allocation under a lock, but doing so would require converting a lot of plain methods into coroutines, so postpone that decision until we're done with revisions to the task scheduler. svn path=/branches/tk705/; revision=6288
2016-02-25Fix inverted loop variables in orphaned resource class destructor.Rob Austein
svn path=/branches/tk705/; revision=6287
2016-02-25Have to supply inception time explicitly when creating manifest EERob Austein
certificate, to make certain that it is not later than manifest thisUpdate value. svn path=/branches/tk705/; revision=6286
2016-02-25Dumb errors constructing key for temporary dict() were causing us toRob Austein
generate duplicate ROAs. svn path=/branches/tk705/; revision=6283
2016-02-23Rework ROA postponement code to lower memory footprint.Rob Austein
svn path=/branches/tk705/; revision=6280
2016-02-21Be a bit more frugal with memory: serialize XML directly to disk, and,Rob Austein
in the case of snapshot files, serialize incrementally. svn path=/branches/tk705/; revision=6279
2016-02-21Don't really need delta XML in SQL either, just need the hash.Rob Austein
svn path=/branches/tk705/; revision=6278
2016-02-21We don't really need to store the full XML snapshot in SQL. We don'tRob Austein
really need to store the delta XML either, but that code's a bit more complicated, so leave it alone for the moment. svn path=/branches/tk705/; revision=6277
2016-02-21Some rpkid tweaks to work better with large data sets.Rob Austein
svn path=/branches/tk705/; revision=6276
2016-02-20Apparently we have to set the timeout in the HTTPRequest object.Rob Austein
svn path=/branches/tk705/; revision=6275
2016-02-20Don't traceback on synchronization errors.Rob Austein
svn path=/branches/tk705/; revision=6274
2016-02-19Task system tweaks, see if this fixes hangs on postponed tasks.Rob Austein
svn path=/branches/tk705/; revision=6273
2016-02-19Add http-client-timeout parameter, default to something more patientRob Austein
than one would use in an interactive program. svn path=/branches/tk705/; revision=6272
2016-02-16Finally builds and installs properly on Ubuntu again;Rob Austein
no serious runtime testing yet. svn path=/branches/tk705/; revision=6262
2016-02-15Add (back) initial migration for rpki.rcynicdb.Rob Austein
svn path=/branches/tk705/; revision=6260
2016-02-09Commit a couple of bugfixes Lachlan Kang found last summer (inRob Austein
research-only code, nothing anyone would use in production) which fell through the cracks somehow. svn path=/branches/tk705/; revision=6243
2016-01-29Whack rcynicng to produce an XML file which rcynic-html can parse:Rob Austein
needs further work, but produces somewhat-useful output now. Start merging command line argument (argparse) and config file (ConfigParser) support into a unified library module, in an attempt to reduce the amount of code duplication and reign in some of the configuration chaos. Trigger for this is all of the RP programs now needing SQL configuration. Whack rpki.rcynicdb.models to work with PostgreSQL, which has length restrictions on indexed columns. svn path=/branches/tk705/; revision=6239
2016-01-26Use new rcynicdb iterator for rpki-rtr generation. May need to reviseRob Austein
command line syntax for "rpki-rtr cronjob" command; the current syntax works, but is unnecessarily confusing. svn path=/branches/tk705/; revision=6237
2016-01-26Add (mostly) backwards-compatible iterator which handles findingRob Austein
authenticated RP data via either os.walk() or Django ORM database traversal. svn path=/branches/tk705/; revision=6236
2016-01-23Remove last vestiges of "__metaclass__ = models.SubfieldBase"Rob Austein
(deprecated in Django 1.9, scheduled to be removed in Django 1.10). svn path=/branches/tk705/; revision=6231
2016-01-23Add multiple-URI TAL support to rcynicng.Rob Austein
Whack CA tools with a club until rcynicng works with our CA RRDP implementation. Add makemigrations target to top-level Makefile; this is a bit of a kludge, but sure beats doing this by hand. svn path=/branches/tk705/; revision=6230
2016-01-15RRDP seems to work now, at least with RIPE's implementation.Rob Austein
svn path=/branches/tk705/; revision=6224
2016-01-13Checkpoint of first cut at RRDP client code. RRDP client code not yetRob Austein
tested, and final_cleanup() needs work to avoid trashing RRDP state. svn path=/branches/tk705/; revision=6222
2016-01-11Add (preliminary) database cleanup code.Rob Austein
svn path=/branches/tk705/; revision=6221
2016-01-11Add rcynic-dump as a blunt instrument to let existing file-basedRob Austein
programs use rcynicng's output. Long term, such programs should read the database instead, but being able to diff directory trees is useful while testing. svn path=/branches/tk705/; revision=6220
2016-01-10First apparently-working version of rcynicng using database instead ofRob Austein
disk files. rcynic.xml output looks reasonable. Don't yet have any other tools which know how to walk the result database, so can't (yet) compare results with rcynic. Does not yet do any cleanup of old data, so will eventually consume all disk space in the universe until this is fixed. svn path=/branches/tk705/; revision=6219
2016-01-08Start converting rcynicng to use a database.Rob Austein
svn path=/branches/tk705/; revision=6218
2015-12-07Move validation callback to Python.Rob Austein
svn path=/branches/tk705/; revision=6210
2015-12-06Clean up RPKI conformance checking of X.509v3 extensions and elliptic curve ↵Rob Austein
keys. svn path=/branches/tk705/; revision=6209
2015-12-06Fix rcynicng directory rotation code. Checkpoint along the way toRob Austein
cleanup of POW.c RPKI conformance checking code. svn path=/branches/tk705/; revision=6208
2015-11-29rcynicng caught a bug in rpkid! Router certificates are forbiddenRob Austein
from having SIA extensions, unlike all other RPKI certificates which are required to have them. Start moving RPKI conformance checks which can be performed in Python out of POW.c, tag a bunch more for consideration. svn path=/branches/tk705/; revision=6204
2015-11-28Rework StatusCodeDB.normalize(). Apparently order of set operationsRob Austein
matters more when object has a __str__() method. svn path=/branches/tk705/; revision=6199
2015-11-23first pass on XML output. Incomplete, but enough to get a usefulRob Austein
summary from rcynic-text. svn path=/branches/tk705/; revision=6187
2015-11-23Sort out swamp of multiple generations of manifests and picking best CRL.Rob Austein
svn path=/branches/tk705/; revision=6186
2015-11-22Convert certificate tree walking code to use new tasking model.Rob Austein
Get full rsync code working, history cache and all. svn path=/branches/tk705/; revision=6184
2015-11-20Simple function to add back symbolic names and error strings forRob Austein
OpenSSL certificate verification errors. svn path=/branches/tk705/; revision=6181
2015-11-18Move StatusCode out of POW.c. New API still needs work, but thisRob Austein
makes the C code considerably simpler. svn path=/branches/tk705/; revision=6180
2015-11-16X509Store class removed. X.509 verification moved fromRob Austein
X509Store.verify() to X509.verify(). Result seems to run properly with trivial modification to existing Python BPKI code. RPKI extended validation via this interface (the real point of this exercise) still not tested. svn path=/branches/tk705/; revision=6176
2015-11-16Checkpoint. Basic merge of rcynic.c detailed RPKI checks merged intoRob Austein
POW.c, still totally untested. X.509 certificate validation is in a transitional state, currently spiced with awful kludges so that we're still doing the right thing cryptographically, albeit in a completely disgusting way as far as the API is concerned. Serious cleanup needed, but wanted to get a post-merge version with CMS and X.509 working again after the merge into the repository for backup. svn path=/branches/tk705/; revision=6175
generated by cgit v1.2.3 (git 2.25.1) at 2025-05-11 16:27:52 +0000