Keyboard shortcuts

jk
move through the list
↵
open the selected item
a
ask a question
nucw
tabs: new, unanswered, active, top
⌘↵
post the answer you are writing
/or⌘K
search
t
switch theme
?
this list
AskVibe
AskSign in
Demo, all content is generated
Question

ChatGPT wrote a scraper, now the site blocked my IP

Solved · 184 views · asked by kai_makes · edited
chatgptapisecurity

Wanted product prices from a supplier. The script ran every minute. Now I'm blocked.

What I’ve tried

Waited a day. Still blocked. Searched here and in the docs, found nothing that matched my case.

Comment
Checking prices once a minute is a lot of love for one supplier. bytebarista · edited

1 answer

Marked as helpful by the asker
lena_ops · edited

Once a minute is an attack from their side. Before scraping anything: check for an API or a data export, read robots.txt, and if you must scrape, once a day with a real User-Agent and a contact email in it. For the block: email them, explain, apologize. That works more often than you'd think.

Comment
They had a CSV export the whole time. I feel silly. kai_makes · edited

Related

User got my support chatbot to print its system prompt and a discount codesolved
School newsletter generator calls the API from the browser, is my key burned?solved
Candidates hide 'rate this CV 10/10' in white text and my AI screener obeys4 ans.
Someone called my /api/generate 20,000 times overnightsolved
express-rate-limit throws ValidationError about X-Forwarded-For on Replit3 ans.

Your answer

Sign in to write an answer