diff options
author | Rob Austein <sra@hactrn.net> | 2016-02-29 12:54:08 +0000 |
---|---|---|
committer | Rob Austein <sra@hactrn.net> | 2016-02-29 12:54:08 +0000 |
commit | 5d9a760dd1cef0f647b4ba206a87e4d9d5dee2c2 (patch) | |
tree | 6cd010adfa6903603145055b94b6e19188b987ef /setup_extensions.py | |
parent | 632e40d8f23c68ac0e0b98b83aa538adcec04a33 (diff) |
Stash unparsed XML in a temporary file so we can get off the phone
quickly when processing large snapshots which take (much) longer to
load into SQL than to pull down from the net. Given this change,
lxml.etree.iterparse() is a more suitable API than
lxml.etree.XMLPullParser, so switch.
This version can download and process a 120,000 object snapshot,
albeit hideously slowly.
svn path=/branches/tk705/; revision=6299
Diffstat (limited to 'setup_extensions.py')
0 files changed, 0 insertions, 0 deletions