Adaptive web scraping framework that handles single requests to full-scale crawls with auto-rotating selectors.