In some projects there si a need to collect a big ammount of data in many different formats from the Web/Cloud, ir order to do so we need web scraping so we can get that data, parse it, apply some logic and finally store it somewhere or send it back to a final service.
There are many techniques for doing this from the simple classic commands to some more elaborated software or custom software that I have implemented before for some special cases.