Good News: We Launched a New Index Early! Let’s Also Talk About 2015′s Mozscape Index Woes

Posted by LokiAstari

Good news, everyone: November’s Mozscape index is here! And it’s arrived earlier than expected.

Of late, we’ve faced some big challenges with the Mozscape index — and that’s hurt our customers and our data quality. I’m glad to say that we believe a lot of the troubles are now behind us and that this index, along with those to follow, will provide higher-quality, more relevant, and more useful link data.

Here are some details about this index release:

  • 144,950,855,587 (145 billion) URLs
  • 4,693,987,064 (4 billion) subdomains
  • 198,411,412 (198 million) root domains
  • 882,209,713,340 (882 billion) links
  • Followed vs nofollowed links
    • 3.25% of all links found were nofollowed
    • 63.49% of nofollowed links are internal
    • 36.51% are external
  • Rel canonical: 24.62% of all pages employ the rel=canonical tag
  • The average page has 81 links on it
    • 69 internal links on average
    • 12 external links on average
  • Correlations with Google Rankings:
    • Page Authority: 0.307
    • Domain Authority: 0.176
    • Linking C-Blocks to URL: 0.255

You’ll notice this index is a bit smaller than much of what we’ve released this year. That’s intentional on our part, in order to get fresher, higher-quality stuff and cut out a lot of the junk you may … Read the rest

November 12, 2015  Tags: , , , , , , , , , , ,   Posted in: SEO / Traffic / Marketing  No Comments

New Features in OSE’s Spam Score & the Mozscape API

Posted by randfish

This week, we launched a feature inside Open Site Explorer that I’m very excited about – the Spam Score Histogram, found by clicking on the “spam analysis” tab:

The histogram is particularly useful for visualizing the distribution of potentially spammy links that show up in a site’s link profile. Above, for example, we’re looking at Moz.com, with a strong distribution of sites that have 0-5 spam flags. According to our research, that means the vast majority of those sites are unlikely to be penalized or banned by Google.

For more detail on Moz’s Spam Score, check out the original blog post and my Whiteboard Friday.

The new histogram view lets us do nice comparisons like these:

Houzz.com has a very large list of sketchy-looking sites linking to them (many seem to be very thin content sites from China, curiously).

Competitor (well, sort-of-competitor), Porch.com, has a much smaller link profile with a very different distribution. Their link profile looks even healthier than Moz’s to me!

But, the new spam score histogram isn’t the only new feature. We’ve also got a new power available to API users – the ability to query data from the previous … Read the rest

June 17, 2015  Tags: , , , , ,   Posted in: SEO / Traffic / Marketing  No Comments

Mozscape in the Wild: How The API is (and Could be) Used

Posted by Ryan_Watson

Did you know that there are over 90 billion URLs are packed into our Mozscape API? That’s a lot of links. So many links, in fact, that it can be daunting to dream up all of the many ways that you could put those links to good use. When we originally built Linkscape (the predecessor to Mozscape), we mainly had one thing in mind… SEO and backlinks.

But there’s a whole lot more than that.

Links are only the beginning, it’s what those links can tell us that’s so darn interesting. Which is why I wanted to call out all of the amazing ways that developers (and marketers) are using Mozscape data to better their work, as well as encourage new uses of Mozscape data that have yet to be explored. (Feel free to jump in and create your own API key any time.)

How Mozscape is Being Used Today

Mozscape's wealth of links can be used in a variety of ways: from SEO audits, to domain valuations, to excel integration. Here at Moz, we have only begun to scratch the surface of how we can utilize the API. We currently use it to run … Read the rest

May 26, 2013  Tags: , , ,   Posted in: SEO / Traffic / Marketing  No Comments

Mozscape API Wiki Update

Posted by Zach Corleissen

Greetings, Mozfolk! My name is Zach, and I'm a technical writer here at SEOmoz.

We've consistently heard from you that Mozscape needs better documentation. I'm pleased to tell you: your requests have been granted! The Mozscape wiki just underwent a thorough update and review by developers, help teamsters, and testers. We incorporated your feedback from help tickets and forums to make Mozscape easier for new users to learn, and more functional for experienced users to reference.

Hopefully this documentation update helps you get the most value from Mozscape. If you haven't taken a look through our documentation yet, we hope it encourages you to see how Mozscape data can help your business grow.

Legacy documentation: a (very) brief history

Like documentation at most startups, the legacy documentation for Mozscape was inconsistent. Not all features were documented; for example, metadata supports a command called index_stats, which returns information about the contents of the current Mozscape Index update. It's been in production for a while, but hasn't been documented until now. (Check it out, it's pretty cool.)

When features changed, sometimes the changes weren't documented. Well-intentioned authors added and edited content in ways that weren’t always … Read the rest

May 16, 2013  Tags: , ,   Posted in: SEO / Traffic / Marketing  No Comments

May 2013 Mozscape Index Is Live!

Posted by bradfriedman

Hey Mozheads, Brad here! It's a beautiful Friday here in Seattle, and I hope the day finds you well wherever you are.

We've got a May Mozscape index for you to check out! As always, the new data can be seen on Open Site Explorer, the Mozbar, your PRO campaigns, and the Mozscape API.

This is a very special release, you guys. This is the first Mozscape index that was processed by our virtual private cloud in Virginia! This is a big part of our long-term strategy to streamline our processing for maximum freshness and value. For now, some of our indexes will be from our Elastic Compute Cloud clusters and some will be from our VPC in Virginia while we figure out how best to use our resources.

Our histogram shows that the index was crawled from the second half of March through the first half of April.

Crawl histogram for May 3, 2013 Mozscape index

And now, the juicy details — metrics for this latest index:

  • 90,875,257,743 (91 billion) URLs
  • 8,514,925,232 (8.5 billion) Subdomains
  • 163,482,796 (163 million) Root Domains
  • 917,461,264,950 (917 billion) Links
  • Followed vs. Nofollowed

    • 2.15% of all links found were nofollowed
    • 56.4% of nofollowed links are
  • Read the rest

May 3, 2013  Tags: , , ,   Posted in: SEO / Traffic / Marketing  No Comments



TechNetSource on Facebook




TechNetSource » Mozscape