Field note · November 6, 2023
Five minutes with posted_on in data-job-postings
3,500 rows, 966 distinct values, and the one fact about posted_on that changes how you query it.
Someone asked what is in posted_on on data-job-postings, and the honest answer took one query.
3,500 rows, no nulls, 966 distinct values. Date the ad went live.
It runs from 2023-01-01 to 2025-09-27, covering 966 distinct days.
It is a date rather than a timestamp, so there is no time zone to get wrong here. That is worth noticing, because the moment a column like this gains a time component, every daily aggregate silently shifts for anyone not in UTC.
select
count(*) as rows,
count(posted_on) as present,
count(*) - count(posted_on) as nulls,
count(distinct posted_on) as distinct_values
from data_job_postings;Check the range before filtering on it. Half the "the dashboard is empty" reports we have seen are a date filter outside the data's actual range, and the query is not wrong so nothing errors.
Where this bites: 966 populated days is what any window function over this column has to work with. A seven-day lag counts rows, not days — so if a day is missing, lag(7) quietly compares against eight days ago and the week-over-week number is wrong in a way that looks plausible.
The grain is one row per posting, which is the context every one of those numbers depends on. None of them survive a change of grain, which is why "profile the column" and "profile the table" are the same job. Full schema, and the CSV, on the dataset page.