 |  |  |  |  |
The text file that runs the internet
| |||||||||
|
The text file that runs the internet
| | |||||||
 |
 |
| | Thread Tools |
15th February 2024, 11:34
| #1 |
| [M] Reviewer  Join Date: May 2010 Location: Romania
Posts: 148,738
 |  The text file that runs the internet The robots.txt file governs a give and take; AI feels to many like all take and no give. But there’s now so much money in AI, and the technological state of the art is changing so fast that many site owners can’t keep up. And the fundamental agreement behind robots.txt, and the web as a whole — which for so long amounted to “everybody just be cool” — may not be able to keep up either. https://www.osnews.com/story/138589/...-the-internet/ |
|  |
|
| Thread Tools | |
| |
