In February I started counting how many pages Sampa sites had on the Google index. All sites are out of three domains: *.sampasite.com, *.inthesphere.com and *.brainuse.com.
The first time I tracked, all three had less than 6,000 total pages indexed on Google. If I'm not incorrect, back then we had just about 8,000 sites, and we know that each site certainly has more than 1 page on average, more like 3 or 4. So Google wasn't doing a good job at indexing Sampa sites.
Over the next few months we added multiple features that could improve the number of indexed pages. First, we added Google Search. It was a pretty good integration and made it for a very interesting scenario on how to leverage Google Search and integrate it seamlessly with a site.
Then, we added Site Maps. And the third thing that we added was the Sampa directory. Before, there was no place on the web that would point to Sampa sites so how on earth would Google find those?
At first, the number of pages in the Google Index was increasing at about 10% per week, from 5,969 to 6,434 to 7,012, etc. Then on the end of May, we had an increase of 50% in a single week, from 19,232 to 29,020. Two weeks later we had an increase of 83% from 28,980 to 53,010.
Currently, we have 66,430 indexed pages on Google, which is an astounding 1,110% growth over the last 16 weeks.
The key here is that we passed some threshold on Google's algorithm that tells it to index more of our content. Great for us.
I'm the Co-founder & CTO of