Timeline for How can I more efficiently save nodes programatically with my custom module without cron?
Current License: CC BY-SA 3.0
6 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jan 19, 2013 at 3:12 | vote | accept | blue928 | ||
| Jan 19, 2013 at 1:30 | comment | added | mikeytown2 | Elysia Cron will let you manage multiple cron tasks. It's the easiest and simplest so I would start there. If you wish to speed up the execution of that task, I would checkout httprl as it will allow you to download in parallel and run node save inside of the event loop with the use of callbacks. When talking about millions of items, doing things in parallel will save a lot of time and server resources. | |
| Jan 19, 2013 at 1:26 | comment | added | blue928 | Great info, thank you so much! All of these are great directions and I look forward to digging into them. I wonder if Elysia Cron would not be a good start? If I understand the README and API examples on the project page correctly each of my functions now can simply be setup as a separate job that I can then execute simultaneously through the callbacks in the job items array? so if I setup one to fire every minute then ultimately they are all running simultaneously? | |
| Jan 18, 2013 at 20:50 | history | edited | mikeytown2 | CC BY-SA 3.0 |
added 43 characters in body
|
| Jan 18, 2013 at 19:27 | history | edited | mikeytown2 | CC BY-SA 3.0 |
added 795 characters in body
|
| Jan 18, 2013 at 19:12 | history | answered | mikeytown2 | CC BY-SA 3.0 |