The Grafana dashboard for StormCrawler. Is a good starting point for monitoring the behaviour of your StormCrawler. This is typically used with Elasticsearch as a storage backend for the metrics generated by Storm but should work with any other Storm-compatible backend like Grafite or CloudWatch.

Is a consultancy and solution provider specialising in web crawling, natural language processing, document retrieval and information extraction. We advise, evaluate and implement solutions based on leading open source software. We aim to combine open source tools to provide efficient, reliable and low cost made-to-order solutions. Not only to we have an extensive knowledge of open source software, we are also active contributors and provide some of the resources.

Please note that GitHub no longer supports your web browser. We recommend upgrading to the latest Google Chrome. GitHub is a development platform inspired by the way you work. You can host and review code, manage projects, and build software alongside millions of other developers. Use at least one letter, one numeral, and seven characters.