Abstract
By now, you should be almost ready to get started running an experiment. In the previous chapter, we covered the first part of the Design Phase—formulating a hypothesis where applicable, identifying the measures of evidence by which we’ll answer the question, and determining conditions for being part of the experiment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Why not 100%? Because it’s impossible to completely guarantee you’ll always find the evidence.
- 2.
If you’re really interested and highly confident in your abilities, you can read Evan Miller’s Simple Sequential A/B Testing: www.evanmiller.org/sequential-ab-testing.html, but make sure you understand it before proceeding down that path.
- 3.
The reason for this is that significance calculations are based on the assumption of a fixed sample size. You can find an excellent explanation of this problem in Evan Miller’s How Not To Run an A/B Test: www.evanmiller.org/how-not-to-run-an-ab-test.html
- 4.
You can find the calculator here: www.evanmiller.org/ab-testing/sample-size.html
- 5.
The “Power Analysis Calculator” by Rik Higham, at http://experimentationhub.com/hypothesis-kit.html#power-analysis, allows you to set a fixed time window (minimum one week) and tells you what the possible MDE would be as a result.
- 6.
The Nuremberg Code is a set of ethical principles to guide experiments involving humans, developed after World War II.
- 7.
Kim Goodwin (https://twitter.com/kimgoodwin), Human-Centred Products, Mind The Product conference, 2018 (www.mindtheproduct.com/2018/11/how-can-we-build-human-centred-products-by-kim-goodwin/)
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2019 Paul Rissen
About this chapter
Cite this chapter
Rissen, P. (2019). Scale and Method. In: Experiment-Driven Product Development. Apress, Berkeley, CA. https://doi.org/10.1007/978-1-4842-5528-5_7
Download citation
DOI: https://doi.org/10.1007/978-1-4842-5528-5_7
Published:
Publisher Name: Apress, Berkeley, CA
Print ISBN: 978-1-4842-5527-8
Online ISBN: 978-1-4842-5528-5
eBook Packages: Professional and Applied ComputingApress Access BooksProfessional and Applied Computing (R0)