Revolution Analytics Targets R Language, Platform at Growing Need to Handle 'Big Data' Crunching

Updated: August 04, 2010

With RevoScaleR, we've focused on making analytical models not just scale to the big data sets, but run the analysis in a fraction of the time compared to traditional systems," says David Smith, vice president of Community and Marketing at Revolution Analytics. "For example, the FAA publishes a data set that contains every commercial airline take off and landing between 1987 and 2008. That's more than 13 gigabytes of data. By analyzing that data, we can figure out the likelihood of airline delays in one second."

A rows-and-columns approach

One second to analyze 13 GB of data should turn some heads because it takes 300 seconds with traditional methods. Under the hood of RevoScaleR is rapid fire access to data. For example, the RevoScaleR uses an XDF file format, a new binary big data file format with an interface to the R language that offers high-speed access to arbitrary rows, blocks and columns of data.

We've taken that one step further to develop a system that accesses the database by rows and columns at the same time



"The new SQL movement was all about going from relational databases to a flat file on a disk that offers fast to access by columns. A lot of the technology that's behind things like Twitter and Facebook take this approach," Smith said. "We've taken that one step further to develop a system that accesses the database by rows and columns at the same time, which is really well-attuned to doing these statistical computations."

RevoScaleR also relies on a collection of the most-common statistical algorithms optimized for big data, including high-performance implementations of summary statistics, linear regression, binomial logistic regression and crosstabs. Data reading and transformation tools let users interactively explore and prepare large data sets for analysis. And, extensibility lets expert R users develop and extend their own statistical algorithms.

Featured Research
  • Contact Center Implementation Best Practices

    Are you looking to add a contact center for your business but not quite sure of how to go about implementing one? You aren't alone, in fact, getting a modern contact center up and running efficiently and effectively is much more difficult than it was even five to ten years ago. more

  • Business Meeting Showdown

    It is no secret that communication and collaboration are at the heart of success and longevity for any business. However, as businesses become more global and more employees work remotely, video conferencing is being increasingly used as an alternative to face-to-face interactions. There are pros to both business travel and video conferencing such as personal connection and ease of use. However, there are cons as well ranging from travel delays to being technologically reliant. more

  • Mobile Communication Showdown

    It's no secret that businesses are becoming agiler and employees are spending more time away from their desks. The question isn't should we get rid of our landlines, but how quickly can we replace them?However, staying connected with your colleagues, clients, and customers is absolutely essential for cultivating long-term, lucrative relationships that will help your company achieve success. more

  • Signs you are Ready for Mobile BI

    With workforces moving more and more mobile on a daily basis, it is essential to ensure that your company is able to arm your employees with the analytics that they need to succeed. 89% of business leaders believe that Big Data will revolutionize business operations in the same way that the internet did. These numbers show the trend towards investing in a BI system. more

  • 15 Ways to Optimize Your Contact Center

    We live in a time where customer experience is seen as an important competitive differentiator. Given this, wouldn't you like to make sure that your contact center is fully optimized to meet your business needs? Deciding to upgrade and optimize your contact center is a big step, and one that shouldn't be done without due diligence and plenty of research. more