Why do scientists trust their experiments?
Why do scientists trust their experiments?
Imagine you're tasting five new ice cream flavors to find the best one. You want to make sure you're not picking the best flavor just because you liked the first one you tried.
To avoid picking favorites, you don't taste the first flavor. Instead, you mix up the flavors and let someone else decide which you liked best. This way, you don't let your first choice influence your final decision.
Example
You taste Flavor A, and it's good. You taste Flavors B, C, D, and E, and they're all good too. Someone else tastes them and says Flavor B is the best. You didn't know you liked Flavor A the most because you didn't taste it first.
Remember this
Double-blind experiments prevent bias by having someone other than you decide which treatment you're getting, making sure you don't pick favorites based on first impressions.
Text adapted from Wikipedia, licensed under CC BY-SA 4.0.
False discovery rate
Ever wonder how scientists avoid falsely claiming new discoveries?
the back-door criterion identifies: sufficient adjustment sets for causal estimation
Can we trust studies without random experiments?
an instrumental variable does: isolates causal effect when you can't randomize
Why can't we always trust what we see?
Kolmogorov–Smirnov test
Ever wondered how scientists know if two things are the same or not?
Bootstrapping (statistics)
Small sample sizes can mislead standard error estimates
Bias vs variance: high bias = underfitting, high variance = overfitting
Can a perfect fit to past data predict future events?
Swipe through more Machine Learning concepts
Open Pocket Polymath