Revolution Analytics Targets R Language, Platform at Growing Need to Handle 'Big Data' Crunching

Updated: August 04, 2010

With RevoScaleR, we've focused on making analytical models not just scale to the big data sets, but run the analysis in a fraction of the time compared to traditional systems," says David Smith, vice president of Community and Marketing at Revolution Analytics. "For example, the FAA publishes a data set that contains every commercial airline take off and landing between 1987 and 2008. That's more than 13 gigabytes of data. By analyzing that data, we can figure out the likelihood of airline delays in one second."

A rows-and-columns approach

One second to analyze 13 GB of data should turn some heads because it takes 300 seconds with traditional methods. Under the hood of RevoScaleR is rapid fire access to data. For example, the RevoScaleR uses an XDF file format, a new binary big data file format with an interface to the R language that offers high-speed access to arbitrary rows, blocks and columns of data.

We've taken that one step further to develop a system that accesses the database by rows and columns at the same time



"The new SQL movement was all about going from relational databases to a flat file on a disk that offers fast to access by columns. A lot of the technology that's behind things like Twitter and Facebook take this approach," Smith said. "We've taken that one step further to develop a system that accesses the database by rows and columns at the same time, which is really well-attuned to doing these statistical computations."

RevoScaleR also relies on a collection of the most-common statistical algorithms optimized for big data, including high-performance implementations of summary statistics, linear regression, binomial logistic regression and crosstabs. Data reading and transformation tools let users interactively explore and prepare large data sets for analysis. And, extensibility lets expert R users develop and extend their own statistical algorithms.

Featured Research
  • Empty the Airport Lounge

    When it comes to budgeting, travel time and expenses typically make up one of the larger allocations for growing companies. But did you know that there was an alternative that could save you time, money, and spare your employees jet-lag? Businesses that utilize video conferencing see a 30% reduction in travel costs. And while you might think your employees will get upset about the loss of flight status, only 15% are worried about the reduced travel and their frequent flier status. more

  • 10 Reasons to Invest in Video Conferencing

    Have you been on the fence about implementing a video conferencing solution for your business? Not quite sure if your employees will utilize it or are concerned about the costs being too high? The modern workforce is adapting and evolving with more and more employees working remotely, it is essential that they have the tools to be able to communicate effectively. more

  • Checklist for Setting Up an In-House Contact Center

    As customer service continues to become the most important competitor differentiator, can you honestly state that your business ranks among the best in your industry? 93% of organizations expect that contact volume will either remain constant or increase over the next two years. It is absolutely essential that you have a contact center that has been set up for success. more

  • 2017 Business Intelligence Trends

    It's long been thought that business intelligence (BI) could only be utilized by highly trained analysts and was therefore unattainable for most businesses. However, advancements in BI have made it so that everyone can utilize BI solutions to help shape business decisions and drive companies bottom lines. more

  • Your Phone System and Your Bottom Line

    Businesses have been using phones to drive increases to their bottom lines for almost a century now. Telephony, much like the rest of the business world, has seen drastic changes with the increase in technological advancement. Voice Over Internet Protocol (VoIP), has enabled companies to connect with consumers at levels that have been seen as unheard of before. And trust us when we say this, it is doing wonders for the bottom line. more