Reddit is now blocking big search engines and their AI web crawlers from bringing up relevant posts unless they pay up, and Google already has

Date:
Fri, 26 Jul 2024 12:36:13 +0000

Description:
Say goodbye to helpful Reddit posts in your browser unless youre using Google Chrome.

FULL STORY ======================================================================

If you dont use Google as your search engine, then you wont see Reddit posts in your search results or at least not recent content from Reddit, anyway.

This is the state of play in the search world now, following a fresh move by Reddit, as explained by spokesperson Tim Rathschmidt in a statement provided to The Verge .

Ratchschmidt said: We have been in discussions with multiple search engines. We have been unable to reach agreements with all of them, since some are unable or unwilling to make enforceable promises regarding their use of
Reddit content, including their use for AI.

So, only Google will be able to surface recent Reddit posts, according to the report - though rival search engines like Bing will still show results for older content on the site.

Like many people, I often use site:reddit.com in searches when I want more personal, human answers, for example when I'm looking for help navigating a tough spot in a videogame or skincare recommendations or I even just add the word Reddit at the end of my search query to bring up the best results. Right now, however, if you try this on any other search engine than Google youre probably going to wind up pretty disappointed and staring at outdated Reddit posts.

Earlier in the year Google struck a deal with Reddit worth $60million to
allow its hungry AI bots to feast on Reddit's sweet, sweet content. Said deal followed a Reddit blackout last year (a protest against API changes) that
left Google seriously in the lurch without access to a swathe of subreddits .
You scratch my back, Ill scratch yours

So, it seems like Reddit is playing a strong hand here, in this game of data scraping and blocking AIs from hoovering up its posts and presenting them as results for queries. As The Verge further observes, last month, Reddit
updated its robots.txt file to stop web crawlers from doing exactly this hammering home the fact that Reddit data is not for free.

A spokesperson for Microsoft, Caitlin Roulston, previously acknowledged that: Microsoft respects the robots.txt standard, and we honor the directions provided by websites that do not want content on their pages to be used with our generative AI models.

Overall, these are gutsy moves on Reddit's part, attempting to draw firm
lines regarding AI being entitled to data for free.

Right now, if you try to use the handy Reddit tag on search engines like
Bing, youll still get Reddit posts related to your query but theyll be several years old. If you need more recent advice, youll have to be searching with Google, at least for the time being - until other search engines are ready to stump up some cash for the privilege. You might also like... OpenAI officially takes on Google with SearchGPT but not everybody gets access for now I finally found a practical use for AI, and I may never garden the same way again ChatGPTs long-awaited new Voice Mode will roll out to Plus subscribers 'next week'



======================================================================
Link to news story: https://www.techradar.com/computing/artificial-intelligence/reddit-is-now-bloc king-big-search-engines-and-their-ai-web-crawlers-from-bringing-up-relevant-po sts-unless-they-pay-up-and-google-already-has


--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)