Firstly, we needed a list of all the U.S. digital marketing agencies. We took a bold assumption that SEO agencies need to:
- Have a website (Right?!)
- Rank in Google Search (anywhere in the first 100 organic results/local results) for at least one of these terms in at least one of the 42K U.S. zip-codes:
- SEO agency
- Digital marketing agency
- SEO company
- PPC agency
- SEO services
- SEO consultant
- SEO expert
- Google Ads agency
- Have at least one of these terms in their homepage’s <title> tag: SEO, Marketing, PPC, Ads, AdWords, Digital, SEM, Link-Building.
Initially, we had around 13,200 websites left, but we still had to manually filter major SEO tools like Moz, Ahrefs, SEMrush, Raven, and others. Same goes for major SEO portals like SearchEngineJournal, SERoundTable, SearchEngineWatch, etc. Eventually, we were left with 13,105 SEO agencies.
Apologies to those agencies that blocked ScreamingFrog/Romanian IPs. We rotated a few User-Agents/HTTP headers. We also tried their JavaScript + Ajax rendering engine (real browser), but still, a few websites weren’t crawlable. Oh well…
Alas, we needed Moz’s Domain Authority to make the data even more interesting. This step was simple; We simply used ScreamingFrog in List mode to get the DA.
Leave a Reply