Differences

This shows you the differences between two versions of the page.

--- crawler:scrapyexamples [2015/05/15 01:27] – [Scrapy OpenSources] admin
+++ crawler:scrapyexamples [2022/10/29 16:15] (current) – external edit 127.0.0.1
@@ Line 188: / Line 188: @@
 </code>
 ===== Scrapy OpenSources =====
+Sort follow filter **Most stars**
+  * https://github.com/scrapinghub/portia
+  * https://github.com/gnemoug/distribute_crawler -> distribute spiders
   * https://github.com/darkrho/scrapy-redis -> distributed spiders with single redis for receiving items
-  * https://github.com/gnemoug/distribute_crawler -> distribute spiders
+  * https://github.com/geekan/scrapy-examples
   * https://github.com/holgerd77/django-dynamic-scraper -> Manage scrapy spiders via django admin
+  * https://github.com/scrapinghub/scrapyjs
   * https://github.com/scrapy/scrapyd
   * https://github.com/scrapinghub/scrapylib -> collection of code
@@ Line 198: / Line 202: @@
   * https://github.com/kalessin/finance -> Crawl finance data and store to mysql server
   * https://github.com/istresearch/scrapy-cluster
+  * https://github.com/scrapy/scrapely
   * https://github.com/octoberman/scrapy-indeed-spider
   * https://github.com/dcondrey/scrapy-spiders -> collection of spiders
@@ Line 218: / Line 223: @@
   * https://github.com/amferraz/9gag-scraper
   * https://github.com/junwei-wang/GoogleLoginSpider
-  * https://github.com/lodow/portia-proxy -> You can **annotate a web page** to identify the data you wish to extract
+  * https://github.com/lodow/portia-proxy -> You can **annotate a web page** to identify the data you wish to
+  * https://github.com/voliveirajr/seleniumcrawler -> scrapy with selenium
+extract
   * https://github.com/pelick/VerticleSearchEngine
   * https://github.com/eliangcs/pystock-crawler