Apify-etl is a collection of git repositories to provide ETL (extract, transform, and load) functionalities.

  • It uses apify web scraper to extract data from websites.
  • Normalizer repo to transform the data.
  • Loader to insert the transformed data into the a relational database.

I have also included a CLI utility and a server to process webhook events from apify server.