Runs the full title-cleaning and classification pipeline over a Part VII
compensation data frame, batching by filing (OBJECTID) across worker
processes. Returns one row per person-title.
Arguments
- df
A Part VII compensation data frame.
- batch_size
Number of filings per worker batch.
- workers
Number of parallel workers; defaults to half the cores.
- preserve_input
If
TRUE, return the original columns intact with the classification fields appended (joined by a synthetic row key). IfFALSE(default), return the pipeline's standardized columns.
Details
By default the returned frame uses the pipeline's standardized (renamed,
cleaned, and pruned) columns. Set preserve_input = TRUE to instead return
the original input frame untouched — every original column kept verbatim
in name and value, including columns the pipeline would normally rename or
drop — with the classification fields appended. Because a multi-title person
expands into multiple rows, each original row is repeated once per title.