I get asked all the time – “Ryan, what is XYZ.com doing that we aren’t? Tell me why they’re ranking 1st for this keyword and we are not!!!”.
There’s so many algorithmic factors that we can’t see (or know about), it’s literally impossible to answer that question.
While we need to understand our competitors, it’s important not to obsess over them. Their website is different than yours and they have different resources than you – you can literally drive yourself crazy trying to reverse engineer their success.
With that being said, we still need to analyze them. I believe Google’s algorithm understands quality down the the keyword level. You should have a picture of Google believes is a “quality” result for each of the keywords you want to rank for.
1. How to find your competition
You probably know who your competition is off the top of your head – that doesn’t always mean they’re an SEO competitor.
We need to find your competitors at the keyword level – aka the ones you’re competing against for organic exposure in Google.
a. Use Google Search + MozBar
A simple search for your keywords will turn up websites the algorithm believes are the best. We can also layer on the MozBar, a free browser plugin, to layer on SEO metrics to each search result (download here https://moz.com/products/pro/seo-toolbar).
Google Search with Mozbar
As you can see, the Mozbar gives you additional information that will help you understand your competition at a quick glance:
- The PA (or Page Authority) of the result. PA is a metric that Moz developed to tell you how authoritative a page is. The higher the PA, the harder it is to outrank it.
- The DA (or Domain Authority) of the result. PA looks at the specific page result – DA looks at the entire domain. DA is a solid metric to understand the overall ranking power of an entire website. You should be comparing your DA / PA to the top results to see how you measure up.
- Number of links and referring domains to that particular page. Generally speaking, the more the links the harder that result will be to outrank.
Start by searching for terms ones have high conversion intent to see what Google turns up. You can scrape the top results to start to understand who your competitors are at the keyword level.
b. Use SEMRush to find common keywords
SEMRush is a paid tool, but is great competitive analysis (NOTE: you can use Ahrefs as well).
Simply entering your domain into the tool will pull back competitors based on the keywords you have in common.
Not only do you have a list of your competition, you also can determine the monthly traffic and the number of keywords they are ranking for in Google’s top 100 ranks.
SEMRush will also tell you, among other things, the top ranking keywords for your competition.
In the initial phase, let’s stick to analyzing 3 competing domains – we will dive deeper later in the campaign.
2. What to look for in their websites
Once you have a list of 3 competitors, we can begin to analyze factors to help reverse engineer their organic success.
a. Understand a competitor’s site build by crawling it
We use DeepCrawl, but Screaming Frog and SiteBulb are both awesome tools as well. A site crawl tells us a ton of information about a website:
- An overview of their website’s architecture and setup
- Full view of all the pages on their site
- Title tags, meta tags and other “on page” elements
If you’re a beginner to SEO, this is a somewhat technically advanced tactic. Generally speaking, a site crawl is more effective when you’re looking for deeper, actionable insights, as it helps turn over technical issues a website has.
b. Number of indexed pages
Go to Google Search and type in -> site:competitor.com. This will pull back the number of pages that Google is indexing on that site.
This tells you a number of things:
- How much content / type of content they have on their site
- A high level overview of how Google is indexing their website (in comparison to yours)
- A high level overview of the authority and indexation power that site has
- The size of their website in comparison to yours. This can give you an idea of the depth you need to build out on your site
Try and dig a little deeper here based on your vertical. For example, if you’re an ecommerce store, you’ll want to know how many products your competitors have.
Click around their site to find out if they’re using a subfolder architecture for products, then repeat the Google search.
This tells us how many indexed products are on their site –
c. Keyword rankings
It’s important to reverse engineer the keywords your competitors are using to drive the most traffic to their site. SEMRush (and Ahrefs) are great tools to do this, as they give you a website’s top keywords by search volume.
Spying on the competition can give you great insight into new keywords to add to your site, as well as improvement opportunities for existing pages.
Recommended for You
Webcast, January 16th: The Latest in Growth Hacking: Link Retargeting
d. Top pages
SEMRush (and Ahrefs) will also tell you the top pages based on number of keywords ranking. This gives you incredibly insights into a few things:
- Finding additional keywords for pages
- Finding keywords for content creation
- Visiting those pages manually and deconstructing their on page elements to understand how they’re ranking for so many keywords
Using this information you can break down the value of pages on a competitor’s website, and the potential to steal that value for yours. This also gives you the starting place for a keyword gap analysis, to understand where your website falls short in comparison to competitors.
e. Type of content
Looking at the same “pages” report, you can understand the type of content your competitors are using to drive so much traffic.
- Blog posts
- Resource guides
- Product / service pages
Understanding page type helps you understand the value of their traffic. For example, if a large majority of their traffic is going to pages with low purchase intent, they aren’t getting much value from that traffic. You want to analyze websites with both great content and sales pages to understand the full scope of pages you need on your site.
f. Quality of content / “On Page” optimizations
Looking at the top pages in SEMRush of Ahrefs, visit some of them to review them manually:
- How many words are on the page?
- Are they using images? Video?
- How good is the content (i.e. well written, informative, in depth, etc)?
- How are they optimizing their page titles? Subheadings?
- Is the site / page visually appealing?
- What type of call to actions are they using on their pages?
- Are they using internal links?
- Are they using external links?
Even with the advancements in SEO tools in the market, there’s still a need for manual review to really dig into the quality of your competitors.
g. Backlink profile
I like to link at links at the page level as opposed to domain level. It’s a lot easier to digest and you can derive far better insight for the types of links that are working in your industry.
For backlinks analysis, we use Ahrefs, a paid tool that’s well worth the cost (if you’re a serious SEO). We look at the “Backlinks” report, filtered for “One Link Per Domain” and “DOFOLLOW” only.
From there, you can do a quick analysis:
- What types of links are these pages getting (i.e. Huffington Post press mentions, forum comments, directory spam, blogger reviews, etc). This tells you a lot about the types of links you need to target for your pages.
- How often are these pages getting links (i.e. link velocity)? When we get to building links to your site, we want to create a natural pattern. We determine what’s “natural” based on the acquisition patterns of your competitors.
- Are there opportunities for you to steal the links? With a little extra digging, you can find out if you can score the link for your site too.
When you’re first beginning the campaign, this information helps you to understand how competitive the industry is. As we move on, this information will become valuable when we begin the link acquisition phase of your campaign.
h. Branded search
Branded search means the number of times a Google user searches for your company’s name or product. This is a HUGE indicator of quality to search engines, one that most SEO professionals overlook.
Branded search comes from a number of places:
- General market awareness and reach
- Offline advertisements (TV, radio, print, etc)
- Online advertisements (influencers, video views, social ads, etc)
I like to use Ahrefs Keyword Explorer to uncover the data.
It not only gives me an accurate search volume for the brand’s main keywords, but other semantic ones as well.
This helps you complete the picture for the popularity of a brand overall and their specific products.
3. What to do with competitor analysis
We record all of our findings in a Google Sheets template that tracks our site vs. 3 competitors.
It’s not enough to just have this data, your money is made in the analysis. We spend a lot of time internally reviewing the data and building actionable insights from it.
A few examples:
- Understanding how much content you should create
- Understanding how many links you’ll need to acquire
- Understanding if you should alter pricing, play with coupons, free giveaways, etc
- Understanding how long you’ll need to invest in solid SEO to overtake competitors (THIS IS KEY)
It’s difficult to read spreadsheets – if you’re working with a client or internal leadership team, this information is better suited in a slidedeck with visualizations to aid in your findings.
Detailed analysis should be pushed into the execution phase of your campaign. Our team does so by keeping a simple matrix in Google Sheets that has all of our findings, ready to be added to a client’s project plan.
If you’re using our project management system, we record our notes in the “Actions” tab. That way we can review internally and build an action plan based on our findings.
It’s not much, but it ensures we’re taking these insights and pushing them into our client’s individual project plans for execution in the future.
As mentioned, it’s important to understand your competitors, but not obsess over them. There’s so many factors that we humans can’t see, you can drive yourself crazy trying to deconstruct a competitor’s website.
Understand the competitive landscape, but focus mainly on your site – all the pieces will fall into place.