Nate Silver is famous for having correctly predicted the winner of all 50 states in the 2012 United States elections and Sid recommended his book so I could learn more about statistics for the A/B tests that we were running.
New data processing technologies and theories in education are moving much of the learning experience into the digital space — into massive open online courses (MOOCs). Two years ago Pearson contacted Aurelius about applying graph theory and network science to this burgeoning space.
Suppose you want to know when your great-grandmother was born. You can’t find the year recorded anywhere. But you did discover an undated letter from her father that mentions her birth and one curious detail: the 13-year and 17-year cicadas were swarming.
A secure permutation is one in which an attacker, given any subset of the permutation, cannot determine the order of any other elements. A simple example of this would be to take a cryptographically secure pseudo-random number generator, seed it with a secret key, and use it to shuffle your sequence.
Though there is some decent documentation, I found that setting up Hive with a HBase back-end to be somewhat fiddly. Hopefully this guide will help you get started quicker.
For the past few weeks I've been building a simple Lucene search application, searching all Lucene and Solr Jira issues, and using it instead of Jira's search whenever I need to go find an issue.
The good thing is that even complex functions (logistic regression, regression trees, etc) produce the same kind of outputs. But we found a problem that we could not fix: generating identical training subsets of observations…
"Everything should be made as simple as possible, but not simpler." These words have resonated with me recently, as I’ve heard pitches from one company after another, all of which are trying to cut through the complexity of data to make it accessible.
The floor of a real number x is the largest integer n ≤ x, written ⌊x⌋. The ceiling of a real number x is the smallest integer n ≥ x, written ⌈x⌉. The floor and ceiling have the following symmetric relationship
In my courses on R, I usually show how to insert a picture as a background for a graph. But it is also to see the picture as an object, and to insert it in a graph everywhere we like to see it.
In my course on claims reserving techniques, I mentioned the use of Poisson regression, even if incremental payments were not integers. For instance, we did consider incremental triangles...
Matt Schumpert took the stage at the InterOp Big Data Workshop in Las Vegas yesterday to talk about the myths and realities of Big Data. Matt is Director of Solutions Engineering at Datameer and has customers that include Visa, Sears, and three out of the worlds largest five banks. He’s an expert on Big Data and brought the following insights...
Arthur Charpentier's data link roundup takes a look at the mathematics of life in the city, the Batman equation, an accurate geek CT scan, and much more.
After months of intensive discussion (more than a 1000 emails in dozens of threads spread over two mailing lists, and a couple of hundred additional private emails), PEP 435 has been accepted and Python will finally have an enumeration type in 3.4!
The Big Data Workshop at InterOp Las Vegas wrapped up the morning with a presentation on Big Data requirements by John West, CTO and Founder of Fabless Labs. John kicked off with the challenge of having your enormous data set all ready to work with when you discover any one of the following problems...
Hadoop Beginner's Guide provides an introduction to how to get up and running with the core components of Hadoop, some higher level tools like Hive, integration tools like Sqoop and Flume, and it also provides some good starting information relating to operational issues with Hadoop.
Sometimes, just sometimes, what happens in Las Vegas shouldn’t stay in Las Vegas. That was clearly the case this morning when TIBCO CTO Matt Quinn took the stage to talk about the myths and realities of Big Data.
Continuing from part 1 of this blog series, we will focus on answer the question “Who are some of the folks working to make Hadoop more accessible to BI users?”
Yaniv Rodenski delivers a fifty minute talk about Hadoop on Azure.
How to get from a txt-file with short names and labels to a QGIS-Style (qml-file)? I used the below R-script to create a style for this legend table where I copy-pasted the parts I needed to a txt-file, like for the WRB-FULL (WRB-FULL: Full soil code of the STU from the World Reference Base for Soil Resources).
This example extracts the text contents of a PDF for use in other systems. This demonstrates some basic differences from Java: multi-line strings (hooray!), imports, primitive arrays, and what implementing an interface looks like.
If you used the Perrin condition to test whether numbers less than a billion are prime, you would correctly identify all 50,847,534 primes as primes. But out of the 949,152,466 composite numbers, you would falsely report 17 of these as prime.
Full detailed analysis of java.util.HashMap’s implementation, its internals and working concepts.
There’s no elementary formula for the circumference of an ellipse, but there is an elementary approximation that is extremely accurate.
Arthur Charpentier's regular roundup of stats and data science-related links points us to algorithms every data scientist should know, a free ebook on probabilistic programming and Bayesian methods for coders, and much much more.