Launching The Web Crawler
It's been a long road, but we are delighted to release our first product to market, the Raptor Web Crawler! But first a little background...
As a part of the process for building the Technical Auditing software, we have had to build a substantial amount of other things. Things like; the server architecture, frameworks, databases, workers & message queues. These are needed to perform and display all the technical audit checks which are a substantial component of the product. Additionally, for the tool to be able to analyse data, it must first crawl, scrape and collect that data..
With the technical auditing software being further from completion than we had hoped, we realised that we already have a fully functioning and robust web crawler. With all of the technology & functionality in place to be as good or better than all other web crawlers out there. With this in mind, we decided to make some front end tweaks and had a viable and competitive product to take to market.
New functionality, data and reports will be released for the web crawler over the coming weeks.