SEO Book.com |
Posted: 09 Aug 2016 12:24 PM PDT So far this year publishers have lost 52% their Facebook distribution due to:
Instant Articles may have worked for an instant, but many publishers are likely where they were before they made the Faustian bargain, except they now have less control over their content distribution and advertising while having the higher cost structure of supporting another content format. When Facebook announced their news feed update to fight off clickbait headlines, it sure sounded a lot like the equivalent of Google's Panda update. Glenn Gabe is one of the sharpest guys in the SEO field who regularly publishes insightful content & doesn't blindly shill for the various platform monopolies dominating the online publishing industry & he had the same view I did.
Further cementing the "this is Panda" view was an AdAge article quoting some Facebook-reliant publishers. Glad we have already shifted our ways. Nice to see them moving in the same direction we are. etc. ... It felt like reading a Richard Rosenblatt quote in 2011 about Demand Media's strong working relationship with Google or how right after Panda their aggregate traffic level was flat.
A couple years later Richard Rosenblatt left the company. Since the Google Panda update eHow has removed millions of articles from their site. As a company they remain unprofitable a half-decade later & keep seeing YoY media ad revenue declines in the 30% to 40% range. Over-reliance on any platform allows that platform to kill you. And, in most cases, you are unlikely to be able to restore your former status until & unless you build influence via other traffic channels:
Recovering former status requires extra investment far above and beyond what led to the penalty. And if the core business model still has the same core problems there is no solution. "I feel pretty confident about the algorithm on Suite 101." - Matt Cutts Some big news publishers are trying to leverage video equivalents of a Narrative Science or Automated Insights (from Wochit and Wibbitz) to embed thousands of autogenerated autoplay videos in their articles daily. But is that a real long-term solution to turn the corner? Even if they see a short term pop in ad revenues by using some dumbed-down AI-enhanced low cost content, all that really does is teach people that they are a source of noise while increasing the number of web users who install ad blockers. And the whole time penalized publishers try to recover the old position of glory, the platform monopolies are boosting their AI skills in the background while they eat the playing field. The companies which run the primary ad networks can easily get around the ad blockers, but third party publishers can't. As the monopoly platforms broadly defund ad-based publishing, they can put users "in control" while speaking about taking the principle-based approach:
Google recently worked out a deal with Wikimedia to actually cite the source of the content shown in the search results:
While the various platforms ride the edge on what is considered reasonable disclosure, regulatory bodies crack down on individuals participating on those platforms unless they are far more transparent than the platforms are:
The whole "eating the playing field" is a trend which is vastly under-reported, largely because almost everyone engaged in the ecosystem needs to sell they have some growth strategy. The reality is as the platform gets eaten it only gets harder to build a sustainable business. The mobile search interface is literally nothing but ads in most key categories. More ads. Larger ads. Nothing but ads. And a bit of scrape after the ads to ensure the second or third screen still shows zero organic results.
And more scraping, across more categories.
What's more, even large scaled companies in big money fields are struggling to monetize mobile users. On the most recent quarterly conference call TripAdvisor executives stated they monetize mobile users at about 30% the rate they monetize desktop or tablet users. What happens when the big brand advertisers stop believing in the narrative of the value of precise user tracking?
For mobile to work well you need to be a destination & a habit. But there is tiny screen space and navigational searches are also re-routed through Google hosted content (which will, of course, get monetized). In fact, what would happen to an advertiser if they partnered with other advertisers to prevent brand bidding? Why that advertiser would get sued by the FTC for limiting user choice:
If the above restraint of competition & market distortion is worth suing over, how exactly can Google make the mobile interface AMP exclusive without earning a similar lawsuit?
Are many publishers in a rush to support Google AMP after the bait-n-switch on Facebook Instant Articles? Categories: |
Neofeudal Web Publishing Best Practices Guide Posted: 20 Jun 2016 12:44 PM PDT At the abstract level, if many people believe in something then it will grow. The opposite is also true. And in a limitless, virtual world, you can not see what is not there. The Yahoo DirectoryBefore I got into search, the Yahoo! Directory was so important to the field of search there were entire sessions at SES conferences on how to get listed & people would even recommend using #1AAA-widgets.com styled domains to alphaspam listings to the top of the category. The alphaspam technique was a carry over from yellow page directories - many of which have went through bankruptcy as attention & advertising shifted to the web. Go to visit the Yahoo! Directory today and you get either a server error, a security certificate warning, or a redirect to aabacosmallbusiness.com. Poof. It's gone. Before the Yahoo! Directory disappeared their quality standards were vastly diminished. As a webmaster who likes to test things, I tried submitting sites of various size and quality to different places. Some sites which would get rejected by some $10 directories were approved in the Yahoo! Directory. The Yahoo! Directory also had a somewhat weird setting where if you canceled a directory listing in the middle of the term they would often keep it listed for many years to come - for free. After many SEOs became fearful of links the directory saw vastly reduced rates of submissions & many existing listings canceled their subscriptions, thus leaving it as a service without much of a business model. DMOZAt one point Google's webmaster guidelines recommended submitting to DMOZ and the Yahoo! Directory, but that recommendation led to many lesser directories sprouting up & every few years Google would play a whack-a-mole game and strip PageRank or stop indexing many of them. Many have presumed DMOZ was on its last legs many times over the past decade. But on their 18th birthday they did a spiffy new redesign. Different sections of the site use different color coding and the design looks rather fresh and inviting. However improved the design is, it is unlikely to reverse this ranking trend. Lacking EngagementWhy did those rankings decline though? Was it because the sites suck? Or was it because the criteria to rank changed? If the sites were good for many years it is hard to believe the quality of the sites all declined drastically in parallel. What happened is as engagement metrics started getting folded in, sites that only point you to other sites become an unneeded step in the conversion funnel, in much the same way that Google scrubbed affiliates from the AdWords ecosystem as unneeded duplication. What is wrong with the user experience of a general web directory? There isn't any single factor, but a combination of them...
If a directory mostly links to lower quality sites Google can choose to either not index it or not trust links from it. And even if a directory generally links to trustworthy sites, Google doesn't need to rank it to extract most the value from it. The trend of lower traffic to the top tier general directory sites has happened across the board. Many years ago Google's remote rater guidelines cited Joeant as a trustworthy directory. Their traffic chart looks like this. And the same sort of trend is true for BOTW, Business.com, GoGuides.org, etc. There is basically nothing a general web directory can do to rank well in Google on a sustainable basis, at least not in the English language. Even if you list every school in the city of Winnipeg that page can't rank if it isn't indexed & even if it is indexed it won't rank well if your site has a Panda-related ranking issue. There are a couple other issues with such a comprehensive page:
Knock On EffectsIn addition to those web directories getting fewer paid submissions, most are likely seeing a rise in link removal requests. Google's "fear first" approach to relevancy has even led them to listing DMOZ as an unnatural link source in warning emails to webmasters. What's more, many people who use automated link clean up tools take the declining traffic charts & low rankings of the sites as proof that the links lack value or quality. That means anyone who gets hit by a penalty & ends up in warning messages not only ends up with less traffic while penalized, but they also get extra busy work to do while trying to fix whatever the core problem is. And in many cases fixing the core problem is simply unfeasible without a business model change. When general web directories are defunded it not only causes many of them to go away, but it also means other related sites and services disappear.
Now perhaps general web directories no longer really add much value to the web & they are largely unneeded. But there are other things which are disappearing in parallel which were certainly differentiated & valuable, though perhaps not profitable enough to maintain the "relevancy" footprint to compete in a brand-first search ecosystem. Depth vs BreadthUnless you are the default search engine (Google) or the default social network everyone is on (Facebook), you can't be all things to all people. If you want to be differentiated in a way that turns you into a destination you can't compete on a similar feature set because it is unlikely you will be able to pay as much for traffic-driven partnerships as the biggest players can. Can niche directories or vertical directories still rank well? Sure, why not. Sites like Yelp & TripAdvisor have succeeded in part by adding interactive elements which turned them into sought after destinations. Part of becoming a destination is intentionally going out of their way to *NOT* be neutral platforms. Consider how many times Yelp has been sued by businesses which claimed the sales team did or was going to manipulate the displayed reviews if the business did not buy ads. Users tend to trust those platforms precisely because other users may leave negative reviews & that (usually) offers something better than a neutral and objective editorial tone. And that user demand for those reviews, of course, is why Google stole reviews from those sorts of sites to try to prop up the Google local places pages. It was a point of differentiation which was strong enough that people wanted it over Google. So Google tried to neutralize the advantage. BlogsThe above section is about general directories, but the same concept applies to almost any type of website. Consider blogs. A decade ago feed readers were commonplace, bloggers often cross-linked & bloggers largely drove the conversation which bubbled up through mainstream media. Google Reader killed off RSS feed readers by creating a fast, free & ad-free competitor. Then Google abruptly shut down Google Reader. Not only do whimsical blogs like Least Helpful or Cute Overload arbitrarily shut down, but people like Chris Pirillo who know tech well suggest blogging is (at least economically) dead. Many of the people who are quitting are not the dumb, the lazy, and the undifferentiated. Rather many are the wise trend-aware players who are highly differentiated yet find it impossible to make the numbers work:
In the current market Google can conduct a public relations campaign on a topic like payday loans, have their PR go viral & then if you mention "oh yeah, so Google is funding the creation of doorway pages to promote payday loans" it goes absolutely nowhere, even if you do it DURING THE NEWS CYCLE. So much of what exists is fake that anything new is evaluated from the perception of suspicion. While the real (and important) news stories go nowhere & the PR distortions spread virally, the individual blogger ends up feeling a bit soulless if they try to make ends meet:
If you can't get your own site to grow enough to matter then maybe it makes sense to contribute to someone else's to get your name out there. I recently received this unsolicited email:
That person was not actually a member of that site's team, but they had found a way to get their content published on it. In part because that sort of stuff exists, Google tries to minimize the ability for reputation to flow across sites. The large platforms are so smug, so arrogant, they actually state the following sort of crap in interviews:
Sure you can bust your ass to build up Facebook, but when their business model changes (bye social gaming companies, hello live streaming video) best of luck trying to follow them. And if you starve during the 7 lean years in between when your business model is once again well aligned with Facebook you can't go back in time to give yourself a meal to un-starve. Content FarmsEhow.com has removed *MILLIONS* of pages of content since getting hit by Panda. And yet their ranking chart looks like this What is crazy is the above chart actually understates the actual declines, because the shift of search to mobile & increasing prevalence of ads in the search results means estimates of organic search traffic may be overstated significantly compared to a few years prior. A half-decade ago a bootstrapped eHow competitor named ArticlesBase got some buzz in TechCrunch because they were making about $500,000 a month on about 20 million monthly unique visitors. That business was recently listed on Flippa. They are getting about a half-million unique monthly visitors (off 95%) and about $2,000 a month in revenues (off about 99.6%). The negative karma with that site (in terms of ability to rank) is so bad that the site owner suggested on Flippa to publish any new content from new authors onto different websites: "its not going to get to 0 as most of the traffic is not google today, but we would suggest to push out the fresh daily incoming content to new sites - thats where the growth is." Now a person could say "eHow deserves to die" and maybe they are right. BUT one could easily counter that point by noting...
The wrappers around the content & masthead logos change, but by and large the people and strategies don't change anywhere near as quickly. Web Portals & News SitesAs the mainstream media gets more desperate, they are more willing to partner with the likes of Demand Media to get any revenue they can. You see the reality of this desperation in the stock charts for newspaper companies. Or how about this chart for Yahoo.com. It doesn't look particularly bad, especially if you consider that Yahoo has shut down many of their vertical sites. Underlying flat search traffic charts misses declining publisher CPMs and the click traffic mix shift away from organic toward paid search channels as search traffic shifts to mobile devices & Google relentlessly increases the size of the search ads. Yahoo may still rank #3 for keyword x, but if that #3 ranking is below the fold on both mobile and desktop devices they might need to rank #1 to get as much traffic as #3 got a couple years ago. Yahoo! was once the leading search portal & now they are worth about 1/5th of LinkedIn (after backing out their equity stakes in Alibaba and Yahoo! Japan). The chart is roughly flat, but the company is up for a fire sale because organic search result displacement & the value of traffic has declined quicker than Yahoo! can fire employees & none of their Hail Mary passes worked.
The same line of thinking was used to justify the Tumblr acquisition, which has went nowhere fast - just like their 50+ other acquisitions. Yahoo! shut down many verticals, fired many workers, sold off some real estate & is exploring selling their patents. Chewing Up the Value ChainSmaller devices that are harder to use means the gateways have to try to add more features to maintain relevance. As they add features, publishers get displaced:
And if converting on mobile is hard or inconvenient, many people will shift to the defaults they know & trust, thus choosing to buy on Amazon rather than a smaller ecommerce website. One of my friends who was in ecommerce for many years stated this ultimately ended up becoming the problem with his business. People would email him back and forth about the product, related questions, and basically go all the way through the sales process with getting him to answer every concern & recommend each additional related product needed, then at the end they would ask him to price match Amazon & if he couldn't they would then buy from Amazon. If he had more scale he might have been able to get a better price from suppliers and compete with Amazon on price, but his largest competitor who took out warehouse space also filed for bankruptcy because they were unable to make the interest payments on their loans. We live in a society which over-values ease-of-use & scale while under-valuing expertise. Look at how much consolidation there has been in the travel market since Google Flights launched & Google went pay-to-play with hotel search. Expedia owns Travelocity & Orbitz. Priceline owns Kayak. Yahoo! Travel simply disappeared. TripAdvisor is strong, but even they were once a part of Expedia. How different are the remaining OTAs? One could easily argue they are less differentiated than this article about the history of the travel industry makes Skift against other travel-related news sites. How many markets are strong enough to support the creation of that sort of featured editorial content? Not many. And most companies which can create that sort of in-depth content leverage the higher margins on shallower & cheaper content to pay for that highly differentiated featured content creation. But if the knowledge graph and new search features are simply displacing the result set the number of people who will be able to afford creating that in-depth featured content is only further diminished. Over 5 years ago Bing's Stefan Weitz mentioned they wanted to move search from a web of nouns to a web of verbs & to "look at the web as a digital representation of the physical world." Some platforms are more inclusive than Google is & decide to partner rather than displace, but Bing's partnership with Yelp or TripAdvisor doesn't help you if you are a direct competitor of Yelp or TripAdvisor, or if your business was heavily reliant on one of these other channels & you fall out of favor with them. Chewing Up Real EstateThere are so many enhanced result features in the search results it is hard to even attempt to make an exhaustive list. As search portals rush to add features they also rush to grab real estate & outright displace the concept of "10 blue links." There has perhaps been nothing which captured the sentiment better than
The following is paraphrased, but captures the intent to displace the value chain & the roll of publishers.
What role do publishers have in the above process? Unpaid data sources used to train algorithms at Facebook & Google? Individually each of these assistive search feature roll outs may sound compelling, but ultimately they defund publishing.
Not a "Google Only" ProblemPeople may think I am unnecessarily harsh toward Google in my views, but this sort of shift is not a Google-only thing. It is something all the large online platforms are doing. I simply give Google more coverage because they have a history of setting standards & moving the market, whereas a player like Yahoo! is acting out of desperation to simply try to stay alive. The market capitalization of the companies reflect this. Google & Facebook control the ecosystem. Everyone else is just following along.
The same sort of behavior is happening in China, where Google & Facebook are prohibited from competing. As publishers get displaced and defunded online platforms can literally buy the media: "There's very little downside. Even if we lose money it won't be material," Alibaba's Mr. Tsai said. "But the upside [in buying SCMP] is quite interesting." The above quote was on Alibaba buying the newspaper of record in Hong Kong. As bad as entire industries becoming token purchases may sound, that is the optimistic view. :D Facebook's Instant Articles and Google's AMP those make a token purchase unnecessary: "I don't think it's any secret that you're going to see a bloodbath in the next 12 months," Vice Media's Shane Smith said, referring to digital media and broadcast TV. "Facebook has bought two-thirds of the media companies out there without spending a dime." Those services can dictate what gets exposure, how it is monetized, and then adjust the exposure and revenue sharing over time to keep partners desperate & keep them hooked.
Give them just enough (false) hope to stay partnered. All the while track user data more granularly & run AI against it to disintermediate & devalue partners. TV networks are aware of the risks of disintermediation and view Netflix with more suspicion than informed SEOs view Google:
And just like Netflix, Facebook will move into original content production. The WikiWikipedia is certainly imperfect, but it is also a large part of why other directories have went away. It is basically a directory tied to an encyclopedia which is free and easy to syndicate. Every large search & discovery platform has an incentive for Wikipedia to be as expansive as possible. The bigger Wikipedia gets, the more potential answers and features can be sourced from it. More knowledge graph, more instant answers, more organic result displacement, more time on site, more ad clicks. Even if a knowledge graph listing is wrong, the harm done by it doesn't harm the search service syndicating the content unless people create a big deal of the error. But if that happens then people will give feedback on how to fix the error & that is a PR lead into the narrative of how quickly search is improving and evolving.
Sergy Brin donates to fund the expansion of Wikipedia. Wikipedia rewrites more webmaster content. Google has more knowledge graph grist and rich answers to further displace publishers. I recently saw the new gray desktop search results Google is tested. When those appear the knowledge graph appears inline with the regular search results & even on my huge monitor the organic result set is below the fold. The problem with that is if your brand name is the same brand name that is in the knowledge graph & you are not the dominant interpretation then you are below the fold on all devices for your core brand UNLESS you pay Google for every single click. How much should a brand like The Book of Life pay Google for being a roadblock? What sort of tax is appropriate & reasonable? How high will you bid in a casino where the house readjusts the shuffle & deal order in the middle of the hand? I recently did a search on Bing & inside their organic search results they linked to a Mahalo-like page called Bing Knows. I guess this is a feature in China, but it could certainly spread to other markets. If they partnered with an eBay or Amazon.com and put a "buy now" button in the search results they'd have just about completely closed the loop there. Broad CommodificationThe reason I started this article with directories is their role is to link to sites. They are categorized collections of links which have been heavily commodified & devalued to the point they are rendered unnecessary and viewed adversely by much of the SEO market (even the ones with decent editorial standards). Just like links got devalued, so did domain names. And, as mentioned above in the parts about blogging, content farms, web portals & news sites ... the same trend is happening to almost every type of content. Online ad revenues are still growing quickly, but they are not flowing through to old media & many former leading bloggers consider blogging dead. Big platform players like Google and Facebook broaden cross-device user tracking to create new relevancy signals and extract most the value created by publisher. The more information the platform owns the more of a starving artist the partners become. As partners become more desperate, they overvalue growth (just like Yahoo! with Polyvore):
Disruption is not a strategy, but the whole point of accelerating it & pushing it (without an adequate plan for "what's next") is to re-establish feudal lords. The web is a virtual land where the commodity which matters most is attention. If you go back in time, lords maintained wealth & control through extracting rents. A few years ago a quote like the following one may have sounded bizarre or out of place
But if you view it through the some historical context it isn't hard to understand
Google funding LendUp & ranking their doorway pages while hitting the rest of the industry is Google bestowing "monopoly charters on their favorite merchants." HeadwindsThe issue is not that the value of anything drops to zero, but rather a combine set of factors shrinks down the size of the market which can be profitably served. Each of these factors eat at margins...
The least sexy consultant pitch in the world: "Sure I can probably rank your website, but it will take a year or two, cost you at least $80,000 per year, and you will still be below the fold even if we get to #1 because the paid search ads fill up the first screen of results." That isn't going to be an appealing marketing message for a new small business with a limited budget. The Formula"The open web is pretty broken. ... Railroad, electricity, cable, telephone—all followed this similar pattern toward closedness and monopoly, and government regulated or not, it tends to happen because of the power of network effects and the economies of scale" - Ev Williams. The above article profiling Ev Williams also states: "An April report from the web-analytics company Parse.ly found that Google and Facebook, just two companies, send more than 80 percent of all traffic to news sites." The same general trend is happening to almost every form of content - video, news, social, etc..
Hey, sure your traffic is declining & your revenue is declining faster. You are getting squeezed out, but if you trust the primary players responsible for the shift & rely on Instant Articles or Google's AMP this time will be different. ...or maybe not... Facts & OpinionsWhen I saw some Google shills syndicating Google's "you can't copyright facts" pitch without question I cringed, because I knew where that was immediately headed. A year later the trend was obvious.
So now we get story pitches where the author tries to collect a few quote sources to match the narrative already in their head. Surely this has gone on for a long time, but it has rarely been so transparently obvious and cringeworthy as it is today.
And if you stray too far from facts into opinions & are successful, don't be surprised if you end up on the receiving end of proxy lawsuits:
The desperation is so bad news sites don't even attempt to hide it. And part of what is driving that is bot-driven content further eroding margins on legitimate publishing. Google not only ranks those advertorials, but they also promote some of the auto-generated articles which read like:
I changed a few words in each sentence of that quote to make it harder to find the source as I wasn't trying to out them specifically. But the auto-generated content was ranked by Google & monetized via inline Google AdSense ads promoting the best marijuana stocks to invest in and warning of a pending 80% stock market crash coming soon this year. Hey at least it isn't a TOTALLY fake story! Publishers get the message loud and clear. Tronc wants to ramp up on AI driven video content at scale:
All is well, news & information are just externalities to a search No big deal. "With newspapers dying, I worry about the future of the republic. We don't know yet what's going to replace them, but we do already know it's going to be bad." - Charlie Munger Build a BrandBuild a brand, that way you are protected from the rapacious tech platforms. Or so the thinking goes. But that leads back to the above image where The Book of Life is below the fold on their own branded search query because there is another interpretation Google feels is more dominant. The big problem with "brand as solution" is you not only have to pay to build a brand, but then you have to pay to protect it. And the number of search "innovations" to try to siphon off some late funnel branded traffic and move it back up the funnel to competitors (to force the brand to pay again for their own brand to try to displace the "innovations") will only continue growing. And at any point in time if Disney makes a movie using your brand name as the name of the movie, you are irrelevant and need of a rebrand overnight, unless you commit to paying Google for your brand forever. Having an offline location can be a point of strength and a point of differentiation. But it can also be a reason for Google to re-route user traffic through more Google owned & controlled pages. Further, most large US offline retailers are doing horrible. Almost all the offline growth is in stores selling dirt cheap unbranded imported stuff like Dollar General or Family Dollar & stores like Ross and TJ Maxx which sell branded item remainders at discount prices. And as Amazon gets more efficient by the day, other competitors with high cost structures & less efficient operations grow relatively less efficient over time. The Wall Street Journal recently published an article about a rift between Wal-Mart & Procter & Gamble: "They sell crappy private label, so you buy Swiffer with a crappy refill," said one of the people familiar with the product changes. "And then you don't buy again." In trying to drive sales growth, P&G is resorting to some Yahoo!-like desperate measures, included meetings where "Some workers donned gladiator-like armor for the occasion." Riding on other platforms or partners carries the same sorts of risks as trusting Google or Facebook too much. Even owning a strong brand name and offline distribution does not guarantee success. Sears already spun out their real estate & they are looking to sell the Kenmore & Craftsman brands. The big difference between the web and offline platforms is the marginal cost of information is zero, so they can quickly & cheaply spread to adjacent markets in ways that physically constrained offline players can not & some of the big web platforms have far more data on people than governments do. It is worth noting one of the things that came out of the Snowden leaks is spooks were leveraging Google's DoubleClick cookies for tracking users. As desperate stores/platforms see slowing growth they squeeze for margins and seek to accelerate growth any way possible. Chasing growth ultimately leads to the promise of what differentiates them disappearing. I recently bought some "hand crafted" soaps on Etsy, which shipped from Shenzen. And for as much as I like shopping on Amazon, I was uninspired when a seller recently sent me this. The above sort of activity is what is going on in the real world even among brands which are not under attack. The domestic economic landscape is getting quite ugly:
And the local abusive tech monopolies are now firmly promoting the TPP: "make it more difficult for TPP countries to block Internet sites" = countries should have less influence over the web than individual Facebook or Google engineers do. In a land of algorithmic false positives that cause personal meltdowns and organizational breakdowns there is nothing wrong at all with that!
Luckily the world can depend on China to drive growth and it will save us. Or maybe there is a small problem with that line of thinking...
Can any experts chime in on this? Let's see... First, there is Wal-Mart selling off their Chinese e-commerce operation to the #2 Chinese ecommerce company & then there's this from the top Chinese ecommerce company:
Categories: |
You are subscribed to email updates from SEO Book. To stop receiving these emails, you may unsubscribe now. | Email delivery powered by Google |
Google Inc., 1600 Amphitheatre Parkway, Mountain View, CA 94043, United States |