Published onFebruary 28, 2017 (7y ago)How to build a scalable crawler to crawl million pages with a single machine in just 2 hoursDockerDevOpsWeb-CrawlerDistributed-CrawlerLearn to build a scalable Python web crawler using Docker, Celery, and RabbitMQ. No multiprocessing knowledge needed. Effortlessly scale wit...
Published onFebruary 25, 2017 (7y ago)How to build docker cluster with celery and RabbitMQ in 10 minutesPythonRabbitmqCeleryDockerDocker-ComposeBuild a Docker cluster with Celery and RabbitMQ for efficient distributed tasks. Learn with a step-by-step guide to handle large tasks on a ...