Daily Crawl Statistics

3 days · 2026-08-03 → 2026-08-05 (SGT) · rendered 2026-08-05 05:11 SGT
5223
New SWE postings (7d)
148258
Postings archived (7d)
10149
Active postings
1425
Enrich backlog

Last run: enrich · 2026-08-05 03:58 SGT · success · unmapped tech terms: 4706

1. New SWE postings per day

274008-03: 4912491208-0308-04: 3708-0408-05: 27408-05

2. Daily crawl detail

Date (SGT)RunsStatusIngest timePages ArchivedNewSWEUpdated ClosedErrorsLLM calls/hits
2026-08-05 increnrich partial 8m46s 300 30000 556 274 2630 0 1 218 / 1409
2026-08-04 increnrich partial 8m45s 300 30000 94 37 3059 0 1 29 / 1356
2026-08-03 increnrichreport partial 29m13s 884 88258 9499 4912 26 0 5 3890 / 769

Archived = every posting written to raw/ (all categories, before filtering). New = candidate postings first stored that day; SWE = the subset classified as software engineering. Closed = postings whose closed_at landed that day.

3. Tech stack in postings crawled (last 7 days)

python1703aws1452sql1384azure1147java1079javascript945docker834kubernetes824linux663git662react605google-cloud604machine-learning578go559typescript495
Counters come from ingest_run; stored/closed counts from job, bucketed by SGT calendar day. Numbers are computed by SQL from public MyCareersFuture data. Methodology: docs/03-data-model.md · Compliance: public job and company data only, no personal data.