Revolution Analytics Targets R Language, Platform at Growing Need to Handle 'Big Data' Crunching

Updated: August 04, 2010

With RevoScaleR, we've focused on making analytical models not just scale to the big data sets, but run the analysis in a fraction of the time compared to traditional systems," says David Smith, vice president of Community and Marketing at Revolution Analytics. "For example, the FAA publishes a data set that contains every commercial airline take off and landing between 1987 and 2008. That's more than 13 gigabytes of data. By analyzing that data, we can figure out the likelihood of airline delays in one second."

A rows-and-columns approach

One second to analyze 13 GB of data should turn some heads because it takes 300 seconds with traditional methods. Under the hood of RevoScaleR is rapid fire access to data. For example, the RevoScaleR uses an XDF file format, a new binary big data file format with an interface to the R language that offers high-speed access to arbitrary rows, blocks and columns of data.

We've taken that one step further to develop a system that accesses the database by rows and columns at the same time



"The new SQL movement was all about going from relational databases to a flat file on a disk that offers fast to access by columns. A lot of the technology that's behind things like Twitter and Facebook take this approach," Smith said. "We've taken that one step further to develop a system that accesses the database by rows and columns at the same time, which is really well-attuned to doing these statistical computations."

RevoScaleR also relies on a collection of the most-common statistical algorithms optimized for big data, including high-performance implementations of summary statistics, linear regression, binomial logistic regression and crosstabs. Data reading and transformation tools let users interactively explore and prepare large data sets for analysis. And, extensibility lets expert R users develop and extend their own statistical algorithms.

Featured Research
  • Why Q4 is the Perfect Time to Invest in Video Conferencing

    If you’re currently relying on an outdated video conferencing solution - or if you don’t have one at all - you’re in luck. While any time is a good time to invest in video conferencing, Q4 may be the best. One big reason is that Q4 is when you can get the best deals, but there are also other important factors like increased access to seasonal employees. more

  • 8 Ways to Get More From Your VoIP System

    Many businesses adopt VoIP to take advantage of the cost savings without spending enough time reviewing the features and benefits made available by different solutions. If this is true for your business, there’s a good chance you could be getting more from your VoIP system in the form of even lower costs or improved employee productivity. You may even find that your current software offers features that you aren’t taking advantage of! more

  • Best ERP Features and Benefits for Your Business

    Are you considering investing in ERP software for the first time? Or maybe you already have an ERP solution but you’re worried it’s becoming dated. If either of the above apply to you, read our latest guide on the top ERP features and benefits based on the size of your business. You may be surprised at how versatile and cost-effective it is becoming - regardless of if you own a small business or run a large enterprise. more

  • 9 Spooky Signs You Need a Contact Center Upgrade

    When was the last time you evaluated the performance of your current contact center and the software you are using? The results may be frightening! If it’s been awhile since you invested in contact center software, there is a good chance that your needs have changed or that there are better options available now. Fortunately, it’s relatively easy to determine if you need an upgrade or not. more

  • 7 Ways the Wrong Phone System Can Haunt Your Business

    The wrong phone system could be haunting your business - and we’re talking about problems more serious than ghosts and ghouls. From increased costs to issues with scaling, we’ve identified seven important ways that a less than ideal phone system could be holding you back. You’ll be surprised at how much of a difference this can make to your bottom line too. more