empireOfLove@lemmy.one to Privacy Guides@lemmy.oneEnglish · 1 year agoOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.comexternal-linkmessage-square75fedilinkarrow-up1398arrow-down10cross-posted to: technology@lemmy.mllemmy_ca_support@lemmy.ca
arrow-up1398arrow-down1external-linkOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.comempireOfLove@lemmy.one to Privacy Guides@lemmy.oneEnglish · 1 year agomessage-square75fedilinkcross-posted to: technology@lemmy.mllemmy_ca_support@lemmy.ca
minus-squareSpectacle8011@lemmy.comfysnug.spacelinkfedilinkEnglisharrow-up3·1 year agoI’m surprised they’re not just using Common Crawl.
I’m surprised they’re not just using Common Crawl.