Web Scraping AI Tool Directories -- 2

I want a full scrape of every tool listed on the ten AI-directory sites below so I can analyse the landscape in one consolidated dataset: [login to view URL] — 4,000+ futurepedia [login to view URL] — 27,000+ Market Clarity There’s An AI For That — 41,000+ ProductHunt (AI category) — 10,000+ (approx, cumulative launches) AIxploria — 3,000+ (approx) [login to view URL] — 10,000+ (approx) TheAISurf / AIChief — 5,000+ (approx) [login to view URL] — 8,000+ (approx) [login to view URL] — 2,000+ (approx) AI Mojo — 1,000+ (approx) For each tool I will at minimum need its name, a short description and the canonical URL. If the page also exposes pricing details, ratings, reviews or any other structured fields, please capture those too; the richer the dataset, the better. I’m flexible on output—CSV, JSON or an Excel sheet all work for me—so feel free to choose the most convenient format in your pipeline and we can convert later if needed. I would also like the underlying Python (or similar) script so I can rerun the extraction whenever the directories update. Please respect each site’s [login to view URL] and usage terms, and code the scraper with polite request intervals to avoid rate-limiting. Once you have an initial sample ready, share it so I can confirm the field structure before you harvest the full data.

Project ID: 40334593