Use Cases
Monitor Crypto News for Trading Signals
Automated monitoring of cryptocurrency news sources to capture market-moving events in real-time. Build an automated system that tracks breaking stories from major cryptocurrency outlets.
Quick Example
import requests
import os
client = requests.Session()
client.headers.update({
"Authorization": f"Bearer {os.environ['SUPACRAWLER_API_KEY']}",
"Content-Type": "application/json"
})
response = client.post("https://api.supacrawler.com/api/v1/watch", json={
"url": "https://www.coindesk.com/",
"frequency": "hourly",
"selector": "a.card-title",
"notify_email": "[email protected]",
"notification_preference": "changes_only"
})
print(f"Watch job created: {response.json()['watch_id']}")const response = await fetch('https://api.supacrawler.com/api/v1/watch', {
method: 'POST',
headers: {
'Authorization': `Bearer ${process.env.SUPACRAWLER_API_KEY}`,
'Content-Type': 'application/json'
},
body: JSON.stringify({
url: 'https://www.coindesk.com/',
frequency: 'hourly',
selector: 'a.card-title',
notify_email: '[email protected]'
})
})
const result = await response.json()
console.log(`Watch job: ${result.watch_id}`)curl -X POST https://api.supacrawler.com/api/v1/watch \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: "application/json" \
-d '{
"url": "https://www.coindesk.com/",
"frequency": "hourly",
"selector": "a.card-title",
"notify_email": "[email protected]"
}'Multiple News Sources
Monitor several crypto news sites simultaneously:
crypto_sources = [
{"name": "CoinDesk", "url": "https://www.coindesk.com/", "selector": "a.card-title"},
{"name": "CoinTelegraph", "url": "https://cointelegraph.com/", "selector": ".post-card-title"},
{"name": "The Block", "url": "https://www.theblock.co/", "selector": "article h3"}
]
for source in crypto_sources:
requests.post("https://api.supacrawler.com/api/v1/watch",
headers={"Authorization": f"Bearer {api_key}"},
json={
"url": source["url"],
"frequency": "hourly",
"selector": source["selector"],
"webhook_url": "https://your-api.com/crypto-alerts",
"webhook_headers": {"X-Source": source["name"]}
}
)Best Practices
- Hourly monitoring for breaking news
- Multiple sources for comprehensive coverage
- Webhook integration for instant alerts
- Keyword filtering in post-processing
- Historical tracking for trend analysis
Was this page helpful?
Monitor Competitor Pricing
Automated monitoring of competitor pricing pages to track price changes and stay competitive. Monitor websites for price updates, product launches, and promotional changes automatically.
AI News Tracking
Monitor AI research and breakthrough announcements from major sources. Stay updated with the latest AI developments by automatically monitoring research papers, tech blogs, and announcement pages.