Step 2: Connect Google Sheets

Multiple nodes read and write job data and keyword summaries in Google Sheets.

1. In Retrieve Keyword Sheet, set Document to [YOUR_ID] and select the Sheet named All Keywords combined.
2. In Load Daily Job Rows, set Document to [YOUR_ID] and Sheet to 15 July 2025.
3. In Append Daily Jobs, confirm the column mappings include expressions like {{ $json.title == undefined ? "No records found in last 24 hours": $json.title }} and {{ $('Iterate Keyword List').item.json.Keywords }}.
4. In Refresh Keyword Totals, set Keywords to {{ $('Iterate Keyword List').item.json.Keywords }} and Total Count 15-07-2025 to {{ $('Filter Recent Jobs').first().json.title == undefined ? "0" : $('Filter Recent Jobs').all().length }}.
5. In Store Clean Listings and Reload Clean Listings, keep the same Document and Sheet targets to preserve data flow.
6. In Update Summary Table and Fetch Summary Data, select the All Keywords combined sheet to maintain reporting totals.

Credential Required: Connect your googleApi credentials to all Google Sheets nodes (9+ nodes handle keywords, job rows, and summaries).

Step 3: Configure the Apify Scraping Requests

These nodes start the Apify actor, poll for completion, wait, and fetch the dataset.

1. In Start Apify Actor, set URL to https://api.apify.com/v2/acts/[YOUR_ID]/runs and ensure Method is POST.
2. Set JSON Body in Start Apify Actor to the provided payload, including "query": "{{ $json.Keywords }}" and "maxJobAge": { "value": 23, "unit": "hours" }.
3. In Poll Actor Status, set URL to https://api.apify.com/v2/actor-runs/{{ $json.data.id }} and keep waitForFinish as 150.
4. In Pause Before Dataset, set Amount to 20 seconds.
5. In Get Scraped Dataset, set URL to https://api.apify.com/v2/datasets/{{ $json.data.defaultDatasetId }}/items.

Credential Required: Connect your httpHeaderAuth credentials to Start Apify Actor, Poll Actor Status, and Get Scraped Dataset.

Step 4: Set Up Keyword Iteration and Job Filtering

This stage loops through keywords, runs the scrape, filters the results, and writes daily rows.

1. Connect Retrieve Keyword Sheet to Iterate Keyword List to loop through each keyword.
2. Iterate Keyword List outputs to both Load Daily Job Rows and Start Apify Actor in parallel.
3. In Filter Recent Jobs, keep the JavaScript that filters by the last 23 hours to ensure only fresh postings are retained.
4. In Append Daily Jobs, verify the mapping for Keyword Title uses {{ $('Iterate Keyword List').item.json.Keywords }}.
5. Confirm the loop back from Refresh Keyword Totals to Iterate Keyword List is intact to process all keywords.

Step 5: Deduplicate and Store Clean Listings

After loading daily rows, duplicates are removed and clean listings are stored and reloaded for statistics.

1. In Deduplicate Job Posts, keep the Set-based logic that compares title and description and skips “No records found in last 24 hours.”
2. In Store Clean Listings, ensure the mappings include {{ $json.title }}, {{ $json.description }}, and {{ $json['Keyword Title'] }}.
3. In Purge Sheet Rows, keep Number to Delete set to {{ $('Load Daily Job Rows').all().length }} to clear old data.
4. Verify Purge Sheet Rows outputs to Reload Clean Listings for the summary calculation stage.

Step 6: Build the Summary and Email Report

Aggregate keyword totals, create a report body, and send a daily email.

1. In Compute Keyword Stats, keep the code that compares $('Reload Clean Listings').all() to $('Store Clean Listings').all().
2. In Update Summary Table, map Keywords to {{ $json.keyword }} and Total Count 15-07-2025 to {{ $json.count }}.
3. In Compose Report Body, verify the output structure includes date: "15-07-2025" and counts_by_type.
4. In Dispatch Daily Email, set Send To to [YOUR_EMAIL], and keep the message expressions such as {{ $('Deduplicate Job Posts').all().length }} and {{ $json.counts_by_type.Web }}.

Credential Required: Connect your gmailOAuth2 credentials to Dispatch Daily Email.

Step 7: Test and Activate Your Workflow

Run the workflow manually to verify data flow, then activate it for production use.

1. Click Execute Workflow and confirm Manual Execution Start triggers the full sequence.
2. Check Google Sheets to confirm Append Daily Jobs adds rows and Update Summary Table updates counts.
3. Verify Dispatch Daily Email sends a message with totals populated from {{ $json.counts_by_type.Web }} and {{ $json.counts_by_type.Mobile }}.
4. Once confirmed, switch the workflow to Active for production use.