Poetry
and Travel
and send them to a S3 bucket. We want to be able to do this on demand or on a schedule.
category
and scrapes the books in this category. Notice that we are using Optimized extractors here. Notice also that the API returns an array of of the scraped books data.
books
api twice (one with category Poetry
and another with category Travel
) and send the result to a S3 bucket. We will create a job that does this on demand.
Creating jobs can be done via UI or API. For this example, we will use the UI. Checkout Jobs API overview for more info.
<YOUR_ACCESS_KEY_ID>
and <YOUR_SECRET_ACCESS_KEY>
with your AWS access keys. Checkout create job reference for more info.
S3 payload