Age | Commit message (Collapse) | Author | |
---|---|---|---|
2019-09-16 | move link crawler to bulk queue; give up on ssl or no-card errors | multiple creatures | |
2017-10-06 | Improve error handling on LinkCrawlWorker (#5250) | unarist | |
* Improve error handling on LinkCrawlWorker * Ignore TimeoutError and InvalidURIError too * Record errors to debug log * Enable dead job queue on LinkCrawlWorker Since most of acceptable errors were already ignored, only our side issue should go to dead job queue. * Ignore all http gem errors | |||
2017-04-04 | Separate background jobs into different queues. ATTENTION: new queue "pull" | Eugen Rochko | |
must be added to the Sidekiq invokation in your systemd file The pull queue will handle link crawling, thread resolving, and OStatus processing. Such tasks are more likely to hang for a longer time (due to network requests) so it is more sensible to not make the "in-house" tasks wait for them. | |||
2017-01-20 | Fix #463 - Fetch and display previews of URLs using OpenGraph tags | Eugen Rochko | |