Issues

Could not run the test crawl
CalculatedContent/cloud-crawler#21 · opened on May 11, 2014
10
on migrating to ruby 2.1
CalculatedContent/cloud-crawler#20 · opened on May 6, 2014
Could not find active_support-3.0.0 in any of the sources while running bundle install
CalculatedContent/cloud-crawler#19 · opened on Apr 30, 2014
4
Make CC AWS region independent
CalculatedContent/cloud-crawler#12 · opened on Aug 12, 2013
normalize urls before putting into bloomfilter
CalculatedContent/cloud-crawler#11 · opened on Jul 26, 2013
CC script for just getting all urls, nothing else
CalculatedContent/cloud-crawler#10 · opened on Jul 26, 2013
bloomfilter should be replaced with bloomd
CalculatedContent/cloud-crawler#9 · opened on Jul 26, 2013
long running batch jobs might be terminated
CalculatedContent/cloud-crawler#8 · opened on Jul 26, 2013
dsl instance_eval call should be tested and optimized
CalculatedContent/cloud-crawler#7 · opened on Jul 26, 2013
Driver should provide convenience loader for long curl jobs
CalculatedContent/cloud-crawler#6 · opened on Jul 26, 2013
qid / jid not created in batch job
CalculatedContent/cloud-crawler#5 · opened on Jul 26, 2013
http connection pool requires qid
CalculatedContent/cloud-crawler#4 · opened on Jul 26, 2013
save page store not in batch job
CalculatedContent/cloud-crawler#3 · opened on Jul 26, 2013
save batch not efficient for local long job
CalculatedContent/cloud-crawler#2 · opened on Jul 26, 2013
batch crawl job uses qid?
CalculatedContent/cloud-crawler#1 · opened on Jul 8, 2013