Path: EDN Asia >> Design Centre >> Consumer Electronics >> Scientific results evaluation: Rules of Thumb
Consumer Electronics Share print

Scientific results evaluation: Rules of Thumb

10 Mar 2016  | Ransom Stephens

Share this page with your friends

In Part 1 of this series, we looked at the techniques for gauging systematic uncertainties. Now, I'll offer some rules of thumb for distinguishing strong results from weak. Yes, there's math, but it's simple arithmetic that you can do on a napkin (or your phone). Other tidbits are listed in tables.

Keep in mind that random processes can fluctuate in such a way as to mimic a signal when no signal exists. A significant result is one that could only be mimicked by an extraordinarily low probability random fluctuation. Our goal is to come up with a simple technique for estimating those probabilities as we read science articles from our Facebook feeds.


Rules of thumb
Let's start with a hypothetical example: Is the queen of England more popular than I am? I agree, common sense indicates that she is, but is her popularity statistically significant?


Figure 1: Popularity contest, Ransom vs the Queen. Photo source: Ransom's daughter and The Daily Mail.


If the Crown announced one morning that anyone could pop in for a cup of tea with the Queen, how many people would queue up at Windsor Castle? Let's say that 1,000,000 people show up (it's short notice after all). Similarly, I announce one morning that anyone is welcome to come over to Casa Ransom and have a nice hoppy ale. It's reasonable to expect that, perhaps, four people will come over. Five if my mother is in town (she loves that west coast hop water).

Rule of thumb 1: The statistical uncertainty, let's call it sigma (σ), of a sample of size N is given by the square root of N, N.



Statistical uncertainty indicates how random processes would cause an experiment to vary if it were carried out many times.

Table 1 and figure 2 show that 32% of the time (call it 30%), random processes will cause the same measurement to shift by more than one sigma away from the measured value. In other words (describing statistical principles in text is notoriously annoying) if you make the same measurement 100 times, expect 30 of them to differ from your result by more than one unit of uncertainty. Similarly, 5% of measurements will differ by more than two standard errors, about 0.3% by more than three sigma, and so on.


Table 1: The per cent of measurements in the right column will diverge from the measured result by at least the number of standard errors in the left column. (See this PDF from the Particle Data Group for a complete bluffers guide to stats.)


Figure 2: Random distribution by number of standard deviations, σ.



1 • 2 • 3 Next Page Last Page


Want to more of this to be delivered to you for FREE?

Subscribe to EDN Asia alerts and receive the latest design ideas and product news in your inbox.

Got to make sure you're not a robot. Please enter the code displayed on the right.

Time to activate your subscription - it's easy!

We have sent an activate request to your registerd e-email. Simply click on the link to activate your subscription.

We're doing this to protect your privacy and ensure you successfully receive your e-mail alerts.


Add New Comment
Visitor (To avoid code verification, simply login or register with us. It is fast and free!)
*Verify code:
Tech Impact

Regional Roundup
Control this smart glass with the blink of an eye
K-Glass 2 detects users' eye movements to point the cursor to recognise computer icons or objects in the Internet, and uses winks for commands. The researchers call this interface the "i-Mouse."

GlobalFoundries extends grants to Singapore students
ARM, Tencent Games team up to improve mobile gaming


News | Products | Design Features | Regional Roundup | Tech Impact