Preparing InfoBots
by Frederic Filloux
The survival of the news industry depends, for a large part, on its ability to create services on top of their contents streams. But getting into personalized services requires a major leap forward for which “Conversational Bots” could become strategic tools.
Great news content is no longer enough. No serious publisher can expect growth or monetizeable loyalty — read: a sizable ARPU — without adding a layer of services that generate reader stickiness. This is the vision shared by the most sophisticated segment of the publishing world. And yet, to my dismay, I keep bumping into news providers (often established, legacy players) still obsessed with stuffing mobile pages with interstitials and auto-play videos. For these, days are numbered. The herd will get thinner.
Forward thinkers see the following forces in play:
— In the long run, big newsroom investments, hiring the best talent money can buy, devising the cleverest packages won’t be enough to grow our readership.
— There is no end in sight for our business models struggles. Making readers pay is extremely difficult; it requires the deployment of truly unique (and costly) editorial contents, an option reserved to only a handful of publishers. As for the free, ad-supported model, it is also in jeopardy because audiences migrate en masse to mobile where monetization is thin.
— Going full steam ahead to social looks fine. But once publishers realize they have surrendered their distribution channels (see last week’s Monday Note about social driven unicorns), social might feel like golden handcuffs —plated ones.
— We need to become indispensable to our readers as a way to address audience leakage caused by social and aggregators.
Those are the reasons why everyone is considering new sets of value-added services layers. Some envision building smart aggregators whose content will get a seal of quality granted by media brands —it could work, even if it sounds a bit pretentious. Many regret to have missed another train, such as the oft-mentioned Nuzzel (see a recent Monday Note this sophisticated aggregator.)
A small set of players are projecting themselves a step further and want to completely rethink the relationship between media and readers/users.
Today, reader interaction is mostly based on push mode. The publisher sends all sorts of news on its platforms (website, apps), and on third-party social channels: basic ones involve Facebook and Twitter, others spread their stuff over 20 platforms – most of the time without direct monetization.
What bots can do, a few scenarios
Relying on bots could reverse the process. There are two categories of bots: transactional and conversational. Applied to news, the transactional bot is pretty crude, it could work like this:
“—Hey, get me the latest news about Apple vs. the FBI”.
The bot then would tap into aggregators such as Google News, or into a predetermined set of publications I’d have painstakingly pre-entered. Unfortunately, chances are that, in my 3:00am reading, I’d have already ingested a great deal about Tim Cook’s not-so-futile resistance. In that example, the filter is dumb. It is either too large and will deluge me with useless stuff, or too narrow, unable to build upon my interests and provide me with truly novel, unseen pieces of information that might reside outside of my usual perimeter.
In fact, the transactional bot is no more than a digital assistant dedicated to search. The input could be textual, I’m in a train, like this, borrowed from the clever Quartz mobile app which mimics text messaging:
…or it could be a vocal, I’m at home or in my car and I talk to my phone. If it to boils down to that, I better stick to a well-arranged RSS Feed (remember, RSS related-applications are the most used by you, readers of the Monday Note), enhanced by a IFTTT setup or to a Nuzzel-like service in which my social sphere acts as a curator.
Such “Transactional Bot” needs to be supplemented by a much more sophisticated iteration with a “Conversational Bot” that knows a lot about me and never forgets anything.
I could work like this:
At 7am, when I’m caffeinated and ready to start, or after a day of work which kept me away from the news cycle, I reconnect and my InfoBot speaks to me:
“—Hey Frederic, while you were away, I got this for you: The fight between the FBI and Tim Cook is heating up. You might want to look at this Washington Post editorial, a NYTimes legal analysis, and a technical piece about encryption in The Intercept. Which one do you want?
— Get me the Post editorial and The Intercept thing. What else?
— I have the latest filing issued Friday by the US Attorney, a 35-page PDF, do you want me to download it to your devices?
— Yes, get it. What’s new on the election?
— Donald Trump criticizes the Pope, keeps insulting Megyn Kelly and leads in the polls by 18 points.
— Maybe later. Find me a long read for tonight.
— Vanity Fair has a large piece titled the ‘The Tech Bubble’s Short-Sellers’. And there is a one in Nature by Vilayanur Ramachandran about PTSD. TheVF issue is $4.99, the Nature piece is $1.50. Shall I proceed?
— OK, get me both. What else might you have?
— Michael Lewis’ next book is available in pre-order on Amazon. Interested?
— Send me the summary first.
— OK, will do. There is also a developing story in Iran: the creators of the Gershad application have been arrested. I found a short note on Al Arabya.
— The Gershad app? What’s that?
— You read a story in Wired titled: ‘In Iran, youth rely on a Waze-like app to evade the morality police’ you shared it.
— Oh, yes! Follow that please. And send the link to (…)”
At this point, it gets interesting because of the bot’s toolbox:
- NLP (Natural Language Processing) to understand requests and shoot back responses.
- Finding items I didn’t view, meaning it keeps tabs on my reading lists.
- Assessing the depth my interest in a subject. Yes, I’m actually interested in reading Justice Department filings about Apple. But I’ll be more superficial about the primary in South Carolina.
- It remembers my centers of interests, not as a set dumb of averages, but weighed within the news cycle’s context, or outside of it. For example, it knows I’ve read most articles and books written by Michael Lewis and also that I’m interested in neurosciences to the point I shared lectures by Harvard’s professor Vilayanur Ramachandran a couple of years ago.
- It makes a selection based on story length, relevancy, freshness.
- It taps into my subscriptions and, on my behalf, performs occasional purchases.
- It detects low noise topics and guesses my interests in those. The courageously “subversive” Gershad app is not at the top of news, but it’s on my own radar.
- It connects to other services I use, mail, note-taking apps, or collaborative tools such as Slack where I’ll share material with my team.
For this, technologies already exist… to some extent. They need to be harnessed together, which is not a small task. Several large players are already on it, such as Google Now and Microsoft Cortana, advancing with prudent steps. iPhone’s Siri opts for a different path: It’s a “stateless” app, no background, no memory and it doesn’t use any dataset about me (aside of my vocal patterns.)
Two questions in conclusion for today.
One: How to make the bot suggest, recommend or guess what’s best for me? The short answer is “Profiling” and “Opt-in”. The long answer will be outlined in next week’s Monday Note. Let’s just say these two items are critical to the future of news publishing.
Two: Who should build such an InfoBot? For publishers, it could become a game changer. But, for cultural, competitive and financial reasons I don’t see any of them going for it. Funded and technology-infused by Jeff Bezos, The Washington Post is a possible exception. More realistically, I would lean towards a tech-oriented pure player approaching the news business from the technology side. A Nuzzel-like, maybe, with $100m in funding.



In this era of overwhelming content quantity…
– what makes me aware of a site is citations on other sites or google ads when I’m searching. I don’t do Social, so I’m atypical.
– what gets me to a site is quality content
– what keeps me coming back is quality comments. I find it strange this is entirely missing from your analysis ?
Ars Technica is really the standout for me. It is the only rather large-scale and somewhat generalist site (IT, Science, IT Law), were the comments are consistently worth reading, which usually only happens in very small sites (including Monday Note ^^). For some articles, *most* of the content is in the comments; for most articles, the comments add significant insight, info, value.
They don’t seem to be doing anything out of this world to keep comments quality up: I haven’t spotted aggressive admins, comments are user-rated… Authors and other staffers do regularly join in the discussion, and Ars’s headlines and articles mostly eschew polemics, which certainly helps the audience self-select.
There are counter examples: I quit Slashdot a while back because it only aggregates others’ news and the comments went down the drain (and/or I got less tolerant of that ^^); on the other hand, a site like Elitist Jerks was so aggressively and negatively moderated (you get banned for asking a duplicate question, the first time, not deleted, not relocated, banned for some time) that everyone I know dropped them.
It seems user participation /comments is hard to get right, and varies wildly w/ audience. The Verge mostly disabled / hid them; on generalists sites the signal-to-hysteria ratio is so high it’s not worth combing through them. Attached forums are strangely disconnected from their main site: in French IT, major site Les Numeriques has very meh forums (low traffic, low quality), smaller site Hardware.fr has much higher quantity and quality.
This site would do well to have an Ars-style like/dislike pair of buttons. I’d use the upvote for this comment.
BTW, any notion of how many Arsians both contribute those fine comments AND pay a subscription?
Not actual numbers. You can eyeball the subscriptor / nonsubscriptor ratio with the “et subscriptor” mention next to the commenter’s handle and rank.
I remember 5/6 years ago how AT was lambasted for blocking ad-blockers. Well before ad-blocking hit the headlines. I can’t find the source but AFAIR, subscription is low-single digit (percentage-wise)
>> NLP (Natural Language Processing) to understand requests and shoot back responses.
Actually, to shoot back responses you need Natural Language Generation: https://en.wikipedia.org/wiki/Natural_language_generation
Yes, absolutely. Thanks.
Hmm. For some reason, this vision makes me want to throw away my smart phone and go back to an old-fashioned feature phone.
Your choice, obviously. But as long as you can choose to get or not to get this service, I don’t see the issue.
Also, I’m almost tempted to let Google know everything I do to see if it makes Google Now better. I’m currently not using gmail nor Chrome and amateurishly blocking tracking (custom hosts.txt, EFF’s antitracking addon, adblocker), yet gNow does offer some nice content suggestions (based on my google searches I guess). I’m wondering if it might be worth opening my data floodgates.
Twitter is exactly the interactive referral network you ask for, just not mechanical/smart. Only smart. Too bad tipsters don’t get credit/referral fees. Or maybe that’s kill it. Tho the Zara example suggests it might work
Hi Walt – it’s actually just turning ‘smart’ with algorithmic filtering. However, the problem is this creates echo chambers – so it’s not necessarily the ‘smart’ we want.
Oh, the long answer is with DharmicData, we are already building the algorithms to make this happen
Thanks for the photo of the IBM 704.
Sent me down the rabbit hole this morning.
I still don’t understand why my parents did not buy me one for my 6th birthday.
Nice overview and predictions. I enjoy Google News for everything global warming … and so have set up an extended daily search on that term. Alas about a third of the news stories were anti-science propaganda. Nice that the news agent now allows exclusions.
So my bot link for global warming news is https://news.google.com/news/section?cf=all&hl=en&pz=1&ned=us&csid=f45fdb838e279188&siidp=4266f795edb513f20aab58cc84091281fd44
And it has a small list of bogus news sources that are clearly listed incase anyone wants to build a list of sources that are entirely global warming deniers.
But instead, shouldn’t any news bot offer a rigorous validation filter that would check a few sources and test buzzwords? Not something to completely test, but just something to scrape off the crud that keeps floating to the top.
Hi Frederic,
Nice analysis – completely agree that publishers need to do more to interact with their audience and provide the ‘service’ that you describe above.
My issue is with the fact we need bots to do this. As you describe – we are long way off from developing bots which could provide an adequate service, particularly in a B2B context. I believe that platforms need to exist to offer publishers a forum to provide a service to specific users who opt in. This would be far more profitable and also offer greater insight to readers.