Step 2: Connect the Page List Expansion

Create a list of page numbers and split them into individual items for batching.

1. Add the Initialize Page List node and set an array assignment named counter to [1,2,3,4,5,6,7,8,9,10].
2. Add Expand Page Numbers and set Field to Split Out to counter.
3. Connect Form Submission Trigger → Initialize Page List → Expand Page Numbers.

Step 3: Set Up Batch Processing and Scraping

Iterate through page numbers in batches and send each page to the scraping API.

1. Add Batch Iterator and connect Expand Page Numbers to its input.
2. Add Request Product Scrape and set URL to https://api.olostep.com/v1/scrapes and Method to POST.
3. In Request Product Scrape, set JSON Body to { "url_to_scrape": "https://www.amazon.com/s?k={{ $('Form Submission Trigger').item.json['search query'] }}&page={{ $json.counter }}", "formats": [ "json" ], "wait_before_scraping": 6000, "remove_css_selectors": "default", "llm_extract": { "schema": { "type": "array", "description": "A list of products listed on Amazon.", "items": { "type": "object", "properties": { "title": { "type": "string", "description": "The title of the product." }, "url": { "type": "string", "description": "The full url for the product." } }, "required": [ "title", "url" ] } } }, "screen_size": { "screen_type": "desktop", "screen_width": 1920, "screen_height": 1080 } }.
4. In Request Product Scrape, add a header with Authorization set to Bearer [CONFIGURE_YOUR_TOKEN].
5. Connect Batch Iterator → Request Product Scrape.

Step 4: Parse, Validate, and Normalize Product Data

Extract JSON from the scrape result, expand products, validate URLs, and normalize fields.

1. Add Parse Result Data and set a field parsedJson with value {{ $json.result.json_content.replace(/\\/g, '') }}.
2. Add Expand Parsed List and set Field to Split Out to parsedJson.
3. Add Validate URL Prefix and configure the condition: String notStartsWith with Left Value {{ $json.url }} and Right Value https://www.amazon.com.
4. Add Normalize Product Fields and set url to =https://www.amazon.com{{ $json.url }} and title to {{ $json.title }}.
5. Connect Request Product Scrape → Parse Result Data → Expand Parsed List → Validate URL Prefix.
6. From Validate URL Prefix, route the true output to Normalize Product Fields, and the false output directly to Append to Data Table.

Step 5: Configure the Data Table Output and Delay

Save each product and throttle requests between batches.

1. Add Append to Data Table and choose a Data Table from Data Table ID (currently [YOUR_ID]).
2. In Append to Data Table, map url to {{ $json.url }} and title to {{ $json.title }}.
3. Add Delay Step and connect Append to Data Table → Delay Step → Batch Iterator to continue looping.

Step 6: Test and Activate Your Workflow

Verify a full run and then enable the workflow for production use.

1. Click Execute Workflow and submit the form in Form Submission Trigger with a sample search query.
2. Confirm each page number passes through Batch Iterator and that Request Product Scrape returns JSON.
3. Check that products are split in Expand Parsed List, validated in Validate URL Prefix, normalized in Normalize Product Fields, and appended in Append to Data Table.
4. When the output looks correct, toggle the workflow to Active to use it in production.