(no subject)

[denise]

I've seen people wondering why imports are taking so @)#$(*& long. This might help shed some light:



#229690254 2011-04-08 08:13:11 [38 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Comments
State: failed at least once, will retry very soon, priority undefined.

#229690299 2011-04-08 08:13:31 [38 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Comments
State: failed at least once, will retry very soon, priority undefined.

#229691506 2011-04-08 08:17:12 [34 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Entries
State: failed at least once, will retry very soon, priority undefined.

#229693287 2011-04-08 08:22:58 [29 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Comments
State: failed at least once, will retry very soon, priority undefined.

#229693552 2011-04-08 08:23:24 [28 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Comments
State: failed at least once, will retry very soon, priority undefined.

#229694558 2011-04-08 08:26:19 [25 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Entries
State: failed at least once, will retry very soon, priority undefined.

#229696494 2011-04-08 08:30:26 [21 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Entries
State: failed at least once, will retry very soon, priority undefined.

#229697174 2011-04-08 08:31:00 [21 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Entries
State: failed at least once, will retry very soon, priority undefined.

#229699435 2011-04-08 08:37:17 [14 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Entries
State: failed at least once, will retry very soon, priority undefined.

#229699747 2011-04-08 08:38:02 [14 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Entries
State: failed at least once, will retry very soon, priority undefined.

#229700502 2011-04-08 08:39:28 [12 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Comments
State: failed at least once, will retry very soon, priority undefined.

#229701320 2011-04-08 08:41:23 [10 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Verify
State: failed at least once, will retry in Never, priority undefined.

#229704262 2011-04-08 08:43:44 [8 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Comments
State: failed at least once, will retry very soon, priority undefined.

#229705151 2011-04-08 08:44:30 [7 minutes ago] in DW::Worker::ContentImporter::LiveJournal::Comments
State: failed at least once, will retry very soon, priority undefined.


1) LJ is still under wicked load due to the DDoS they're experiencing. This can mean the site timing out when we try to contact them for the data.

2) Every time LJ is inaccessable when the importer tries to hit it, the job goes on pause to retry again in a few seconds. It retries up to five times before giving up.

3) There are lots and lots and lots of people trying to import right now. (This means that imports from sites other than LJ will be slow too, because they enter the queue behind all the LJ import jobs.)

If I had to guess, I'd say the existing import queue as it stands right this very minute would take at least 24 hours to clear, because of a combination of the three above items. Please, please, please be patient!

Comments

[dragonchilde]

I just wanted to say thank you for this feature; I know this is #oldpost and #threadzombieism here, but I wanted to thank you for the importer... i've had a DW journal for about a year and a half, but haven't done much with it. The recent issues at LJ had me worried for the loss of irreplaceable data... and with facebook stealing the majority of my active friends there away, I figured what the hey... I have little to lose.

And now, I've found that DW is my default. I LIKE it here better. It's cleaner, more stable, and truthfully... it's the ethics here that have really drawn me in. It feels like Old LJ.

I still love LJ, and I'll have an account there as long as they let me... but I think I'll make this my new home base. :)

[denise]

I'm glad you like it here :)

[dragonchilde]

If you guys keep up the exemplary company philosophy and work ethic... I think you'll set a whole new standard for web 2.0 business.

[denise]

I can only hope so! It would be nice to have a mini-revolution in the Web 2.0 world, heh.