Tab tracking
Choose which tabs to scrape (Videos, Short videos, Forums). Uncheck all to turn off tab tracking and reduce cost. Takes effect on the next scraper run.
Search terms
Terms the scraper will search for (one per line). Takes effect on the next scraper run.
All Users
Loading watchdog log...
To enable full monitoring (live feed, workers, cookies, logs), install the monitoring endpoints on the EC2 server:
- SSH in:
ssh -i yelp-api.pem ubuntu@13.39.247.222 - Copy
monitoring_endpoints.pyto/home/ubuntu/yelp_search_automation/ - Add to the Flask app:
from monitoring_endpoints import monitoring_bp; app.register_blueprint(monitoring_bp) - Set env:
export YELP_MONITOR_TOKEN="your-secret-token"(on both EC2 and homeaglow-google/.env) - Restart:
sudo systemctl restart gunicorn
GET /monitor/healthWorkers, cookies, pending queue, extracted today, Chrome processes.
GET /monitor/recent?limit=50Last N processed emails with name, URL, location, found/not-found status. Powers the live feed.
GET /monitor/pending?limit=50Emails currently in the pending queue with total count.
GET /monitor/stats?days=7Daily extraction counts: total, found, not_found per day.
GET /monitor/logs?source=watchdog&lines=100Tail watchdog or worker logs. Sources: watchdog, worker.
The file monitoring_endpoints.py
is in the yelp-scraper repo at ~/glo-workspace/yelp-scraper/.
All endpoints require Bearer token auth.
| Uploaded | File | Total | Progress | Status | |
|---|---|---|---|---|---|
| Loading... | |||||
Advanced filters
| Company | Domain | Match | Status | Raised | Public | Latest round | Rounds | Completeness | Last scraped | Actions |
|---|---|---|---|---|---|---|---|---|---|---|
| Loading... | ||||||||||