In order to truly understand the complexity of a web scraping project, I would generally like the following information:
What website are you attempting to scrape?
On that website, what specific elements are they interested in?
What format would you like the data to be extracted to and how would you like that data formatted?
Approximately how many pages will they be scraping?
How regularly do they require this data?
After discussing this information, I will look at the website and build a sample project to understand how complex it will be.
Things to consider are:
how structured is the data?
Is the layout they are requesting possible?
Maintenance
One-time web scraping of a site is generally considered complex. If there is a need to web scrape on a schedule, we can talk about processes and delivery processes.