Daily Crawl Statistics

30 days · 2026-10-07 → 2026-11-05 (SGT) · rendered 2026-11-05 15:12 SGT
1327
New SWE postings (7d)
151654
Postings archived (7d)
10859
Active postings
0
Enrich backlog

Last run: enrich · 2026-11-05 03:16 SGT · success · unmapped tech terms: 13303

1. New SWE postings per day

328010-07: 23810-0710-08: 23210-09: 21910-10: 25310-11: 3010-1110-12: 3010-13: 23610-14: 24110-15: 23510-1510-16: 32810-17: 28710-18: 4210-19: 3210-1910-20: 20910-21: 22810-22: 21810-23: 21410-2310-24: 21810-25: 1810-26: 1910-27: 24310-2710-28: 24410-29: 21010-30: 29110-31: 27310-3111-01: 2211-02: 2711-03: 21511-04: 24411-05: 25511-05

2. Daily crawl detail

Date (SGT)RunsStatusIngest timePages ArchivedNewSWEUpdated ClosedErrorsLLM calls/hits
2026-11-05 increnrich success 4m24s 149 14900 457 255 1043 0 0 202 / 53
2026-11-04 increnrich success 3m27s 118 11800 416 244 668 0 0 197 / 47
2026-11-03 increnrich success 2m24s 83 8300 402 215 270 0 0 169 / 47
2026-11-02 increnrichreport success 2m18s 79 7900 85 27 653 0 0 14 / 13
2026-11-01 reconcileenrich success 26m18s 885 79254 75 22 9116 2743 0 17 / 9
2026-10-31 increnrich success 4m25s 148 14800 480 273 1191 0 0 184 / 90
2026-10-30 increnrich success 4m24s 147 14700 535 291 1090 0 0 214 / 76
2026-10-29 increnrich success 4m25s 148 14800 456 210 1087 0 0 171 / 40
2026-10-28 increnrich success 3m20s 111 11100 428 244 690 0 0 203 / 40
2026-10-27 increnrich success 2m20s 79 7900 440 243 235 0 0 189 / 54
2026-10-26 increnrichreport success 2m13s 77 7700 59 19 620 0 0 6 / 13
2026-10-25 reconcileenrich success 26m31s 890 79653 43 18 9227 2767 0 15 / 5
2026-10-24 increnrich success 4m38s 143 14300 436 218 1079 0 0 163 / 56
2026-10-23 increnrich success 4m20s 146 14600 416 214 1095 0 0 184 / 30
2026-10-22 increnrich success 4m31s 154 15400 439 218 1097 0 0 174 / 42
2026-10-21 increnrich success 3m32s 120 12000 432 228 689 0 0 179 / 48
2026-10-20 increnrich success 2m30s 87 8700 391 209 298 0 0 169 / 40
2026-10-19 increnrichreport success 2m24s 82 8200 56 32 735 0 0 22 / 10
2026-10-18 reconcileenrich success 27m13s 899 80161 63 42 9568 2544 0 28 / 15
2026-10-17 increnrich success 4m25s 148 14800 560 287 1308 0 0 247 / 39
2026-10-16 increnrich success 4m31s 152 15200 654 328 1108 0 0 266 / 62
2026-10-15 increnrich success 4m43s 151 15100 457 235 1115 0 0 199 / 38
2026-10-14 increnrich success 3m31s 119 11900 429 241 725 0 0 202 / 35
2026-10-13 increnrich success 2m23s 81 8100 432 236 266 0 0 207 / 29
2026-10-12 increnrichreport success 2m18s 79 7900 68 30 671 0 0 15 / 15
2026-10-11 reconcileenrich success 26m49s 895 79820 53 30 9486 2640 0 29 / 5
2026-10-10 increnrich success 4m16s 143 14300 481 253 1132 0 0 421 / 37
2026-10-09 increnrich partial 4m15s 140 14000 477 219 1095 0 205 205 / 16
2026-10-08 increnrich success 4m29s 149 14900 451 232 1240 0 0 216 / 18
2026-10-07 increnrich partial 3m29s 117 11700 446 238 820 0 1 223 / 14

Archived = every posting written to raw/ (all categories, before filtering). New = candidate postings first stored that day; SWE = the subset classified as software engineering. Closed = postings whose closed_at landed that day.

3. Tech stack in postings crawled (last 7 days)

aws370sql359python356azure254javascript234kubernetes211java202docker201react172git171linux163machine-learning153google-cloud140terraform136llm126
Counters come from ingest_run; stored/closed counts from job, bucketed by SGT calendar day. Numbers are computed by SQL from public MyCareersFuture data. Methodology: docs/03-data-model.md · Compliance: public job and company data only, no personal data.