medecinelibre, hace 11 meses en @Crazypedia @KeithAmmann @atomicpoet @fediversenews then, the community would pile on the author of the search engine which disrespects the robot.txt directives, as usual, and the search engine would probably shut down
@Crazypedia @KeithAmmann @atomicpoet @fediversenews then, the community would pile on the author of the search engine which disrespects the robot.txt directives, as usual, and the search engine would probably shut down