Spiderbots Can’t Read

In my life as a freelance copywriter I learn a good many things, much of it is basically useless trivia but some of it is absolutely essential to my 21st Century life. Most of what I have been writing revolves around discussing, explaining or expressing an opinion on something to do with internet marketing. Dull, I know, but a guy’s gotta eat right? Anyway, in the course of my researches into the ins and outs of things like search marketing and click through rates I often run across something that is relevant to my efforts as a blogger.


Penguin Comes to Town


Penguins on the Attack

Several months ago Google altered its search algorithm and this became the hot button issue in the online marketing world. Essentially this update to the equation that Google uses to decide who makes the first page of the Search Engine Results Pages (SERPs) called Penguin was aimed at removing the junk from the SERPs by finding pages that were pointless compilations of keyword stuffed gibberish or which were linked to pages of keyword stuffed gibberish called link schemes.

As is the case in grammar, keywords are the words within the content of a web page that are central to its topic and which the spiderbots use to index the page. The thinking once ran along the lines of if six keywords is good then sixty keywords is fantastic. Link schemes are an insidious form of spam that either creates link farm content with many, many links pointing to it or, usually in combination with these pages, sends out trillions of spam comments to blogs. Either way, the object is to build ‘link juice’ for other junk pages. They are the cyber equivalent of highway advertising billboards that are erected along roads that nobody wants to travel.

The online marketing world was abuzz with apocalyptic predictions of the end of Search Engine Optimization (SEO) and the industry changed its buzz word to ‘Content Marketing’ (wild bunch, internet marketers). While this is generally good for me because someone has to write all of that content the Penguin Update also gave me useful insight into what NOT to do with my own blog if I wanted to rank well in the SERPs (which I do).


The Two Don’ts

What I learned not to do revolves around two different aspects of running a blog. Penguin targeted low quality sites which were filled with unnatural content. That is to say, content that isn’t written in a natural way but really just slapped together to contain a set keyword density. Pages like this, usually illegible, are designed to scam advertisers who’s Pay Per Impression (PPM) ends up on the page and they had grown in number until they had begun to choke the SERPs with useless results. The move against keyword stuffed pages like this has also been good for me as it has made it easier for my naturally written content to rise in the SERPs. So the first DON’T that I learned was don’t over use keywords in my blog posts in an effort to get an edge in the SERPs. Do write naturally.

The second DON’T that I learned was don’t accept everybody’s links. Just because you think that they are a good guy doesn’t mean that they don’t have cyber cooties. I learned this the hard way when this website suddenly disappeared from the SERPs and my visitors dried up to a trickle of faithful followers (I know who you are).


Spiderbots Can’t Read

“Why has this happened to me?” I asked. “Has my incisive social commentary suddenly become droll?” Thankfully the gods of cyberspace enlightened me in a binary epiphany and I checked the links on my website. “Eureka!” I ran through the suburban streets of Essendon naked in emulation of Archimedes (okay, I said “Woo Hoo!). The trouble was a link that was (formerly) in my blog roll to a friend’s website. This fellow cybernaut was approving spam comments posted by the link farms as real engagement and Google had pegged him as a link scheme page too. I know that he’s not a spammer but spiderbots can’t read.

The upshot was that after I removed his infectious link my page rank returned to a respectable 3 out of 10 (Wikipedia is only an 8) almost overnight. The take away is that bloggers need to be careful about which comments they approve and they have to be discerning about who’s pages they list in their blog roll or link to in posts. Fortunately the difference between a good link and a bad link are easy to spot.


Not All Links are Created Equal

Including links in your blog is still very important to the general SEO. Links tell the crawlers that you are engaged with other pages on the web and it judges you partly by the quality of those pages. Search engines attribute levels of authority to websites and pages like Wikipedia have a high credibility rating and so linking from an anchor text in a blog post to a Wikipedia page tells the crawler that you have taken the time to link to your source and so it gives you a little link juice. Many websites have a good authority rating with Google (like this one) and linking to them can establish your place on the net for the search engines and improve your place in the SERPs.

grim reaper

The Bad Link Fairy

Another kind of link that is especially good for your blog are links that point to you. This means that when someone puts your page on their blog roll or gives you a track back or a ping back you are getting a little bit more kudos with the spiderbots, unless those pages are link schemes, or look like link farms to the search engines. This is why it is vital to vet the comments on your blog now and to be selective about giving ping backs and other cyber validation to potential Black Hat SEO websites.



For most bloggers, especially many of the ones that read this blog, most of this is never going to matter very much. The first key takeaway is that concentrating on good, high quality content that is naturally written and includes images or video content that matches the copy will be ranked well. For most of the blogs that I follow personally this really means that they should just keep doing what they are doing already and try and do it better every time.

The second takeaway is that for the most part comments aren’t worth the trouble that they can cause most of the time. The average engagement level for blogs is around two comments for every hundred visitors (my own rate is just below this) so no matter how gratifying they are they don’t generally contribute much to the quality or the content of the blog- there are exceptions. I have decided to continue to accept comments here in the interests of offering a fair right of reply but I trash anything that is unreadable or even looks like spam.

It is also important to check out any websites before you post a link to them on your own blog. The e-mail that they send you may sound like they are genuine when all that they are doing is using a more sophisticated form of spam to attract traffic to their shitty websites. One school of thought among SEO professionals is that you shouldn’t swap links with anyone who has a lower page rank than you do and as medieval as it sounds it may just be the right strategy.


If you liked this blog post then you may want to read these as well.

More on Blogging SEO:

Writing Blog Posts that the Search Engines Will Love

Writing Blog Posts that the Search Engines Will Love cont.

Writing Blog Posts that the Search Engines Will Love- final

Pointers for Effective Blog Writing

Spiderbots Are Crawling Through My Relationships

How to get the most out of your keywords and tags


About dgmattichakjr

D G Mattichak jr was born in 1963 in Syracuse New York and immigrated to Melbourne Australia with his family in 1972. He was educated in one of Melbourne’s exclusive private schools before studying art at Preston Technical College. D G Mattichak jr has been a student of the occult arts since the early 1980s and has become well known in Australian magickal circles and, in recent years, around the world due to a string of essays on a variety of occult subjects http://www.scribd.com/dmattichak/shelf . He discovered the “key to the order & value of the English alphabet” from Aleister Crowley’s Book of the Law in 1983 and has since used this English Qabalah to unlock the secrets of Thelemite magick. Success in these methods admitted him to the highest levels of attainment in various Hermetic disciplines and until recently he has been passing on his knowledge to private students, many of whom have gone on to become notable occultists in their own right. After almost three decades of study and development D G Mattichak jr has finally been able to distil his knowledge of magick and Thelema into a book- A Comment on the Verses of the Book of the Law, the first in a planned series of books on Hermeticism and Thelemite magick, revealing, for the first time in over a century, the secrets of magick that have been hidden in Crowley’s magnum opus, the Book of the Law. D G Mattichak jr currently lives in Melbourne Australia with his artist wife Michelle and their two cats. He has had a long career as an al a carte chef in Melbourne’s vibrant hospitality scene and now spends his time writing blogs on cooking, writing and, in the guise of Master Ankh af na Khonsu, about magick. He is also one of the founding members of the Mt Franklin Annual Pagan Gathering and regularly contributes to its official website http://mountfranklinannualpagangathering.blogspot.com/ as both an administrator and as an author. D G Mattichak jr’s first book Loot was released in 2009. His books are available through amazon.com at http://www.amazon.com/s/ref=nb_sb_noss?url=search-alias=stripbooks&field-keywords=D G Mattichak&x=13&y=20 .
This entry was posted in authors, blogging, Computers, D G Mattichak jr, writers and tagged , , , , , , , , , , . Bookmark the permalink.

11 Responses to Spiderbots Can’t Read

  1. Thank you. I learned a lot from your cyber knowledge and seem to be doing the right thing. I like to look thru my spam now and then just to see what these spam farms look like. And if I get a comment from someone who just has an email addy and not a blog I never approve that, and always check out their blog first to see if it is real. I am impressed with how WP blocks spam for me. The only problem I have had is since my blog is about witchcraft I think a couple Christian blogs have “liked” it just to get their image on my page, and have yet to figure out how to stop that, and even reported them for what I would call religious persecution to WP.

    • I don’t know how to stop likes from unpleasant sources. Especially if you don’t want to give the Christians any link juice. Go and like them back- perhaps you could leave a comment while you’re at it.

      • I did post a comment on their blog that they were obviously Christians trying to get their link onto a witch’s blog and that I considered it to be religious harassment. Thanks for your feedback because I tried to block this kind of “like” but could not find any solution except as I said to complain about their technique and assumed motivation to WP.

    • I used to get this kind of harassment. Here’s a workaround that seemed to work for me. Log out of your own WordPress account first. Then post a comment on THEIR blog but using THEIR website/email address. Or (as I prefer) use a known spamsite address. That way, they get hit with their own stuff. Of course, technique not to be used if in breach of your local laws. (Geddit?)

  2. This is probably the most readable, concise account of this topic I’ve ever read.

  3. Ed Hurst says:

    Would you believe I’ve been harassed by some of the same people?

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s