This has been a week of lots of changes. I've probably made 7-10 deployments of Sampa.com and Sampa site on the last 10 days or so. We got a new sign up pipeline and we've been measuring and fixing it.
Just to give one example, changing just 1 word (actually 2 words) on the sign up screen caused a drop of 14-16 failed sign ups per day. Before, 14-17 people per day were making the same mistake when trying to sign up to Sampa. After the phrase change it dropped to 0-2 per day.
We also are playing with other parts of our system a lot, the only problem is that we usually need to wait 36-48 hours after we've made a change to measure its impact. Ideally you want to wait a whole week so you avoid getting only weekdays or only weekend data, but we can't run a 10 week test. It's too long.
It's likely that we will continue doing that over the next 2-3 weeks, and doing some AB-Testing on this period as well. That should be fun.
I'm the Co-founder & CTO of 
