Skip to contents

Most research on nonprofit leadership starts with one question per organization: who is the chief executive? Part VII seldom answers it directly: - Many filers list a CEO or executive director. - Many others list a “President” who may be the paid head or the volunteer board chair. - Some list only board officers and a bookkeeper. - Some organization types name their chief executive with a title of their own: a union’s business manager, a club’s general manager, a Legion post’s adjutant.

On 2019-2023 filings that pay anyone, a title alone names the CEO for 64% of 501(c)(3) charities. For unions, lodges, benefit trusts, cemeteries and veterans posts it names the CEO for only 0-13%.

titleclassifier finds the CEO in layers. Each layer is described below, in the order the pipeline applies it:

1. Standard title (step 07)    "Exec. Dir." -> EXECUTIVE DIRECTOR
2. Title level (step 08)       EXECUTIVE DIRECTOR is a CEO-level title
3. Rules (step 09)             designated by title -> imputed from pay ->
                               unpaid full-time leader -> otherwise run by the board
4. CEO thesaurus (step 09)     for 11 organization types, the type's own CEO
                               title, and the stipend titles that are never a CEO
5. 990-EZ (step 09)            no checkboxes: a model replaces the rules,
                               with a guard; the thesaurus still applies

The result is in role.final == "CEO", with how the CEO was found in role.ceo, and how the filing is led in org.leadership:

role.ceo The CEO is …
designated named by a CEO-level title, in an officer position
co-ceo one of two or more designated CEOs
interim designated, with an INTERIM or ACTING status
imputed the highest-paid plausible leader when no title names one, or an unpaid full-time leader
thesaurus the chief-executive title of the organization’s type
model named by the 990-EZ role model
org.leadership The filing …
designated, thesaurus, imputed, model has a CEO, found this way
board_governed pays people but has no plausible leader: the board runs it
no_paid pays no one

1. From the title to a CEO-level title

Steps 01 to 07 clean the title and map it to one of a few hundred standard titles (title.standard). Step 08 gives each standard a level. Eight standards are CEO level:

standard title variants mapped to it examples
CEO 99 CEO, HOS, HEAD, CEO BHS, CEO CFO
CO-CEO 3 CO-CEO, CO-DIRECTOR, CO-DIRECTOR CMOA
EXECUTIVE DIRECTOR 43 ED, EXECDIR, EXECUTIVE DR, EXECUTIVE DIRECTOR, EXECUTIVE DRIECTOR
GENERAL DIRECTOR 2 DIRECTOR GENERAL, GENERAL DIRECTOR
PASTOR 19 RABBI, PASTOR, PRIEST, MINISTER, EVANGELIST
PRESIDENT 28 PRESIDENT AN, CORP PRESIDENT, PRESIDENT SCH O, CAMPUS PRESIDENT, PARENT PRESIDENT
PRINCIPAL 10 PRINCIPAL, ES PRINCIPAL, HS PRINCIPAL, MS PRINCIPAL, PRINCIPAL IN
SUPERINTENDENT 2 SUPERINTENDE, SUPERINTENDANT

The crosswalk decides what a title means on its own. The titles that matter most for the CEO are the ones it cannot settle:

filed title standard title level or board role
President & CEO CEO CEO
Pres/CEO CEO CEO
Exec. Dir. EXECUTIVE DIRECTOR CEO
Chief Exec Officer CEO CEO
Executive Director/Founder EXECUTIVE DIRECTOR CEO
Executive Director/Founder FOUNDER OFFICER
Head of School CEO CEO
Superintendent CEO CEO
Senior Pastor PASTOR CEO
Associate Pastor PASTOR CEO
President BOARD PRESIDENT board: CHAIR
Chairman BOARD PRESIDENT board: CHAIR
Chancellor BOARD PRESIDENT board: CHAIR
Director BOARD MEMBER board: MEMBER
Executive Vice President EXECUTIVE VICE PRESIDENT OFFICER
General Manager GENERAL MANAGER MANAGER
Business Manager BUSINESS MANAGER STAFF
Fund Administrator FUND ADMINISTRATOR MANAGER
Adjutant BOARD SECRETARY board: SECRETARY
  • PRESIDENT is a board title. On its own, PRESIDENT maps to BOARD PRESIDENT. The crosswalk files the volunteer reading, the more common one across all filers. Step 09 decides whether a particular president runs the organization.
  • PRESIDENT & CEO collapses to CEO (step 04). A paired title names the CEO outright.
  • CHANCELLOR is rewritten in step 07: a paid chancellor becomes CEO, an unpaid one BOARD PRESIDENT. (These examples are unpaid.) In a university, a better-paid president outranks a paid chancellor (section 3).
  • GENERAL MANAGER, BUSINESS MANAGER, FUND ADMINISTRATOR and ADJUTANT are staff or board titles in general. In a club, a union, a benefit trust or a veterans post, they name the chief executive. Section 3 handles them.

2. The rules

Step 09 (resolve_roles()) reads each person’s checkboxes, pay and hours along with the title, and decides the filing’s CEO in this order. Each rule applies only if the earlier ones found no CEO.

  1. Designated. A person with a CEO-level title is the CEO, unless the checkboxes put them on the board only. Two or more designated CEOs are each co-ceo; a designated CEO with an INTERIM status (INTERIM, ACTING) is interim.
  2. Imputed from pay. The highest-paid plausible leader is the CEO. A plausible leader:
    • is paid;
    • has the officer box, or a leadership title (president, director, manager, administrator, chief, …);
    • works 15+ hours a week or is paid $25,000+;
    • reports at least 5 hours a week, if they report hours at all. Presidents are exempt: older filings often show a paid president at 0.1 hours;
    • is not a board chair with the trustee box working under 25 hours a week. That pattern is a paid chair, not an executive;
    • does not hold a stipend title in the CEO thesaurus (section 3).
  3. An unpaid full-time leader. On a full 990, an unpaid person with a leader or chair title, 35+ hours a week and the officer box is the CEO (imputed). The founder-president of an all-volunteer organization and the superior of a religious order are examples. If several people tie for the most hours, as in a student group whose officers all report 50, no one is named.
  4. Otherwise no CEO. A filing that pays people but has no plausible leader is board_governed; one that pays no one is no_paid.

Two further rules keep stipends from making executives: - The stipend rule. A board title held under 10 hours a week for under $25,000 is a board seat, even with the officer box: a titular president with a stipend. - Past and elect. A past president or president-elect (a FORMER or FUTURE status from step 06) holds a board seat, not the office.

A designated: org.type none; org.leadership designated
title pay hours boxes title only step 09
President & CEO 410,000 55 O CEO CEO (designated)
Chair of the Board 0 5 TO BOARD CHAIR BOARD
Chief Financial Officer 260,000 50 O OFFICER OFFICER
Treasurer 0 3 TO BOARD TREASURER BOARD
B imputed: org.type none; org.leadership imputed
title pay hours boxes title only step 09
President 85,000 40 TO BOARD CHAIR CEO (imputed)
Vice President 0 2 T BOARD VICE CHAIR BOARD
Program Director 42,000 40 MANAGER MANAGER
C unpaid full-time: org.type none; org.leadership imputed
title pay hours boxes title only step 09
President 0 45 TO BOARD CHAIR CEO (imputed)
Vice President 0 5 TO BOARD VICE CHAIR BOARD
Treasurer 0 3 TO BOARD TREASURER BOARD
D board-governed: org.type none; org.leadership board_governed
title pay hours boxes title only step 09
President 6,000 5 TO BOARD CHAIR BOARD
Secretary 0 2 TO BOARD SECRETARY BOARD
Bookkeeper 18,000 10 STAFF STAFF
  • A. The CEO is designated by title.
  • B. No title names a CEO, so the paid, full-time president with the officer box is imputed. The unpaid vice president is a board seat.
  • C. Nobody is paid. The president works 45 hours a week with the officer box, so the president is the unpaid full-time leader.
  • D. The president’s $6,000 for 5 hours a week is a stipend (the stipend rule), and a bookkeeper is not a plausible leader, so the board runs the organization.

3. Organization types with their own CEO titles

Some kinds of organization name their chief executive with a title the rules read as something else. Some also pay board officers stipends that the pay rule mistakes for executive pay. Labeling all five years of 150 organizations (FINDINGS.md F-031) showed where step 09 picked the wrong person or none. The CEO thesaurus (ceo.thesaurus, from data-raw/crosswalks/ceo-thesaurus.csv) records the fixes by organization type.

Finding the organization type

org_types() gives each filing one of 11 types, or none. It uses, in order of preference:

  1. an org.type column you supply (the examples here do this);
  2. NTEE code and 501(c) subsection columns joined from the IRS Business Master File (for example with panel990::bmf_retrieve()), mapped by org_type_from_codes();
  3. the organization’s name and the titles in its Part VII, by org_type_from_name().
Type From the codes From the name or titles
veterans 501(c)(19), (c)(23) AMERICAN LEGION, VFW, AMVETS, DAV; an ADJUTANT or QUARTERMASTER on Part VII
fraternal 501(c)(8), (c)(10) LODGE, ELKS, MASONIC, MOOSE, EAGLES, KNIGHTS OF COLUMBUS, GRANGE; EXALTED RULER, WORSHIPFUL, POTENTATE
union 501(c)(5), NTEE J or none LOCAL 123, UNION, BROTHERHOOD, TEAMSTERS, IBEW, AFSCME; a BUSINESS AGENT or BUSINESS MANAGER
club 501(c)(7) COUNTRY, GOLF, YACHT, ATHLETIC, TENNIS or SWIM CLUB
coop 501(c)(12) COOPERATIVE, CO-OP, ELECTRIC MEMBERSHIP, WATER SUPPLY, TELEPHONE
trust 501(c)(9), (c)(17) TRUST FUND, WELFARE FUND, PENSION, BENEFIT PLAN, VEBA
cemetery 501(c)(13) CEMETERY, MEMORIAL PARK, BURIAL
university NTEE B41-B43, not a foundation or alumni group UNIVERSITY, COLLEGE, SEMINARY
ministry NTEE X CHURCH, MINISTRY, CONGREGATION, PARISH, DIOCESE; a PASTOR, REVEREND or BISHOP
fire NTEE M24 FIRE DEPARTMENT, FIRE COMPANY, VOLUNTEER FIRE, HOSE CO
orchestra NTEE A68, A69 ORCHESTRA, SYMPHONY, PHILHARMONIC

When codes are present, the subsection settles the membership types: a 501(c)(3) “Union Rescue Mission” is not a union. The name can only add a type that a missing or wrong NTEE code would have given (university, fire, orchestra, ministry). The output records the result in org.type and its source in org.type.source (supplied, codes, inferred or none).

The thesaurus entries

Each entry pairs an organization type with a title pattern, matched against the cleaned title (title.v7), and an effect:

  • ceo. The holder runs that kind of organization, if paid at least min_pay and working at least min_hours a week. Unreported hours do not rule a paid holder out.
  • not_ceo. A holder paid under min_pay and, where min_hours is set, working under min_hours a week is on a stipend. They are never made the CEO, by title or by pay.
  • outranks. Titles a ceo holder wins over even when the filing already has a CEO.
th <- get_ceo_thesaurus()
knitr::kable(th[, c("org_type", "title_pattern", "effect", "min_hours", "min_pay", "outranks")])
org_type title_pattern effect min_hours min_pay outranks
veterans ceo 20 25000
veterans TREASURER|FINANCE OFFICER|QUARTERMASTER|TRUSTEE|SECRETARY|ADJUTANT)not_ceo 35 30000
fraternal SECRETARY|RECORDER|TREASURER)not_ceo 35 40000
club GENERAL MANAGER|CLUB MANAGER|GM)ceo 20 25000 SUPERINTENDENT|GOLF|PROFESSIONAL|\b|CHEF|CONTROLLER|DIRECTOR OF
club POOL|SNACK|CANTEEN|BAR|GROUNDS) MANAGERnot_ceo NA 25000
coop GENERAL MANAGER|GM)ceo 20 25000
trust ^(FUND |PLAN |TRUST |BENEFITS? )?A?D?MINISTRATORceo 20 25000
union BUSINESS MANAGER|BUS MGR)ceo 20 25000 PRESIDENT
university ^PRESIDENTceo 20 50000 CHANCELLOR|PROVOST|VICE PRESIDENT|
ministry ^(SENIOR |LEAD |GENERAL |HEAD )?PASTOR\b|\b|\b|RABBI\b|RECTORceo 20 0
fire ^(FIRE )?CHIEF$|^FIRE CHIEFceo 20 25000
fire SECRETARY|TREASURER)not_ceo 35 40000
cemetery not_ceo NA 1

The entries by type:

Type Who runs it Who does not Board titles to know
veterans the post or department adjutant, paid $25k+ for 20+ h/wk treasurer, finance officer, quartermaster, trustee, secretary or adjutant on a stipend (under $30k and 35 h/wk) the COMMANDER is the board chair; a DEPARTMENT SENIOR VICE COMMANDER the vice chair
fraternal no single title: usually a paid executive or none the lodge secretary, recorder or treasurer on a stipend (under $40k and 35 h/wk) EXALTED RULER, WORSHIPFUL MASTER and POTENTATE are the chair; wardens, rabbans and knights are members
club the general manager (or club manager, GM), $25k+ and 20+ h/wk; outranks a better-paid superintendent, golf pro, chef, controller or “director of” a pool, snack, canteen, bar or grounds manager paid under $25k the PRESIDENT is the board chair
coop the general manager, $25k+ and 20+ h/wk
trust the fund, plan, trust or benefits administrator, $25k+ and 20+ h/wk the CHAIRMAN and TRUSTEES are the board
union the business manager, $25k+ and 20+ h/wk; outranks a paid president the PRESIDENT is the board chair even when paid
university the president, $50k+ and 20+ h/wk; outranks a provost or vice president, and a chancellor paid no more than the president the board CHAIR
ministry the senior, lead, general or head pastor, a bishop, overseer, rabbi or rector, 20+ h/wk, paid or not; an associate or youth pastor does not match
fire the paid full-time fire chief ($25k+, 20+ h/wk) the company’s secretary or treasurer on part-time pay (under $40k and 35 h/wk)
cemetery an unpaid superintendent
orchestra no entry: an executive director or president & CEO usually names the CEO

How an entry is applied

  1. not_ceo titles are removed from the running before the rules: they are not designated and not imputed.
  2. The rules of section 2 run.
  3. The best-paid holder of a ceo title becomes the CEO (role.ceo = "thesaurus") in three cases:
    • the filing has no CEO;
    • its CEO was only imputed from pay or named by the 990-EZ model;
    • its CEO’s title is one the entry outranks.
    A CEO designated by a CEO-level title, such as an executive director, stays the CEO.

Each example filing is run twice: as is, and with the thesaurus switched off (the rules of section 2 alone).

Club: org.type club; org.leadership thesaurus
title pay hours boxes title only step 09 without the thesaurus
President 0 3 TO BOARD CHAIR BOARD BOARD
General Manager 180,000 50 K MANAGER CEO (thesaurus) MANAGER
Golf Course Superintendent 210,000 50 H MANAGER MANAGER CEO
Treasurer 0 2 TO BOARD TREASURER BOARD BOARD

Club. The golf course superintendent is the best-paid person, so pay alone would make the superintendent the CEO. The general manager runs the club, and the club entry ranks the general manager above the superintendent.

Union local: org.type union; org.leadership thesaurus
title pay hours boxes title only step 09 without the thesaurus
President 160,000 40 TO BOARD CHAIR BOARD CEO
Business Manager 150,000 50 O STAFF CEO (thesaurus) OFFICER
Recording Secretary 8,000 5 TO BOARD SECRETARY BOARD BOARD

Union local. A union president is often paid, and here earns more than the business manager. The president is still the elected chair. The business manager runs the local, and the union entry ranks them above the president.

Legion department: org.type veterans; org.leadership thesaurus
title pay hours boxes title only step 09 without the thesaurus
Department Commander 0 10 TO BOARD CHAIR BOARD BOARD
Department Adjutant 48,000 40 O BOARD SECRETARY CEO (thesaurus) OFFICER
Treasurer 60,000 40 O BOARD TREASURER OFFICER CEO

Veterans. The department adjutant runs the department. The treasurer is better paid, so pay alone would pick the treasurer. The commander is the board chair.

Lodge: org.type fraternal; org.leadership board_governed
title pay hours boxes title only step 09 without the thesaurus
Exalted Ruler 0 5 TO BOARD CHAIR BOARD BOARD
Secretary 24,000 20 O BOARD SECRETARY OFFICER CEO
Treasurer 3,000 3 O BOARD TREASURER BOARD BOARD

Lodge. The secretary has the officer box and $24,000 for 20 hours a week: enough for the pay rule to name a CEO. In a lodge that is a stipend. The fraternal entry keeps the secretary from being the CEO, and the lodge is run by its board. Before this entry, lodge secretaries were made CEO from pay 91 times in the 2019-2023 sample.

Pension fund: org.type trust; org.leadership thesaurus
title pay hours boxes title only step 09 without the thesaurus
Real Estate Manager 120,000 40 K NA STAFF CEO
Fund Administrator 95,000 40 K MANAGER CEO (thesaurus) MANAGER
Chairman 0 2 T BOARD CHAIR BOARD BOARD

Benefit trust. The fund administrator runs the trust. Without the thesaurus, pay picks the better-paid real estate manager: the title holds MANAGER, a leadership word, even though the title is uncoded.

University: org.type university; org.leadership thesaurus
title pay hours boxes title only step 09 without the thesaurus
Chancellor 262,000 40 O CEO OFFICER CEO
President 366,000 40 TO BOARD CHAIR CEO (thesaurus) BOARD
Vice President for Advancement 300,000 40 O OFFICER OFFICER OFFICER
Chair 0 2 TO BOARD CHAIR BOARD BOARD

University. The president runs the university. The paid chancellor holds a CEO-level title (step 07 rewrites a paid CHANCELLOR to CEO), so the rules alone make the chancellor the designated CEO. The university entry outranks a chancellor, provost or vice president, so the president is the CEO and the chancellor an officer. Because step 07 makes a chancellor CEO on the strength of pay, the president outranks a chancellor only when paid at least as much; a better-paid chancellor stays the CEO.

Church: org.type ministry; org.leadership thesaurus
title pay hours boxes title only step 09 without the thesaurus
Senior Pastor 0 50 T CEO CEO (thesaurus) BOARD
Chair 0 2 T BOARD CHAIR BOARD BOARD
Treasurer 0 2 T BOARD TREASURER BOARD BOARD

Church. A senior pastor runs the church whether paid or not. Here the pastor is unpaid and has only the trustee box, so neither the pay rule nor the unpaid full-time rule applies.

How much it helps

The type-specific labels (FINDINGS.md F-031 to F-033) cover 750 filings of 150 organizations from 2019-2023. The table gives the share of filings where step 09 names the right chief executive (or rightly names none):

Stratum Before (F-031) Rules fixed (F-032) With the thesaurus (F-033) Chancellor fix (F-034)
All 750 filings 80.9% 85.1% 87.6% 88.1%
University 54% 78% 82% 90%
Veterans post 54% 60% 66% 66%
Club or co-op 74% 84% 92% 92%
Lodge 86% 86% 92% 92%
Ministry 88% 88% 96% 96%
Benefit trust or cemetery 84% 84% 90% 90%

The thesaurus entries were written from these labels. On 126 held-out filings from 64 organizations of the same types, the share rose from 79.4% to 81.7%. The gain is about the same size as in the sample, and comes mostly from lodges.

Known limits

  • Two-pastor churches. ASSOCIATE PASTOR maps to the CEO-level standard PASTOR. A church with a senior and an associate pastor therefore gets two co-CEOs. The thesaurus does not split them, because both are designated by title.
  • Combined titles. The union pattern misses compressed titles such as BMFINSEC (business manager and financial secretary).
  • Former and interim CEOs who served part of the year can be named alongside the current CEO. Telling them apart needs the tax period’s dates.

4. The 990 and 990-EZ divide

Smaller organizations file the 990-EZ. Its Part VII lists the same people, titles, pay and hours, but not the position checkboxes: no trustee, officer, key employee or highly compensated box. In 2022, 990-EZ filings supplied 1.2 million of the 5.1 million Part VII rows.

Most of the rules lean on those boxes:

Rule On a full 990 On a 990-EZ
Position from the boxes from the title and pay alone
Designated a CEO-level title, unless the boxes say board only a CEO-level title
Imputed from pay needs the officer box or a leadership title needs a leadership title: a paid treasurer who runs the organization is missed
Unpaid full-time leader needs the officer box never applies
Stipend rule a board title under 10 h/wk and $25k is a board seat the same, read from the title, since there is no trustee box

Without the boxes, the rules miss most officers and call too many people staff. On the 40 hand-labeled 990-EZ people, the rules get 82.5% of roles right. So on a 990-EZ, step 09 does three things:

  1. The model replaces the rules. When the xgboost package is installed, each person’s role on a 990-EZ comes from the no-checkbox role model (section 5). role.method is model.
  2. A guard on the model’s CEO. If the model names as CEO someone with no CEO-level title who works under 20 hours a week for under $50,000, the person keeps the role the rules give instead. On the labeled filings, those model CEOs were mostly stipend-paid officers of board-run organizations.
  3. The thesaurus still applies. It overrides the model’s CEO in the same cases as above, so a club’s general manager outranks a golf professional whom the model would pick.

With the model, 92.5% of the labeled 990-EZ people get the right role. On 23,931 people at organizations that switched between the forms, the model agrees with their full-990-year role 95.0% of the time, against 92.0% for the rules. Use resolve_roles(use_model = FALSE) to use the rules everywhere.

5. The role model

The model is a classifier trained to answer one question: what would the checkboxes have said? It predicts each person’s role (BOARD, CEO, OFFICER, MANAGER, PROFESSIONAL or STAFF) from what a 990-EZ does report.

  • Teacher. About 557,000 people on full-990 filings from 2019-2023, each labeled with the role the rules give them with the boxes. The boxes are then hidden from the model.
  • 990-EZ examples. 20,800 people at organizations that switched forms, labeled with their role in the full-990 year.
  • Features. 100 per person, built by role_model_features():
    • title keywords (PRESIDENT, TREASURER, DIRECTOR, PASTOR, …);
    • the title’s level, board role, domain and SOC group from the taxonomy;
    • pay and hours;
    • the person’s rank and share of the filing’s pay and hours;
    • the filing’s make-up: how many people, how many paid, how many other CEO and board titles;
    • status flags.
  • Model. Gradient-boosted decision trees (xgboost), shipped in inst/extdata/role-model/. See Rules and models.

In effect the model has learned from full-990 filers what a paid person’s situation implies about the boxes. In a small filing where the board is unpaid, the one person paid for real hours almost always ticks the officer box and runs the organization, whatever their title says. A board officer on a small stipend almost always ticks only the trustee box.

Four 990-EZ filings show where the model changes the CEO, and where step 09 holds it back. rules alone is use_model = FALSE. model's pick is the model’s raw prediction, before the guard and the thesaurus. P(CEO) is the model’s probability that the person is the CEO.

EZ-1 paid treasurer: org.type none; org.leadership model
title pay hours boxes title only step 09 rules alone model’s pick P(CEO)
Treasurer 30,000 25 none BOARD TREASURER CEO (model) STAFF CEO 0.93
President 0 4 none BOARD CHAIR BOARD BOARD BOARD 0.00
Secretary 0 2 none BOARD SECRETARY BOARD BOARD BOARD 0.00

The model adds a CEO. The treasurer is the only paid person, at $30,000 for 25 hours a week. TREASURER is not a leadership title, so the rules cannot impute a CEO: the treasurer is STAFF and the filing has no CEO. In full-990 data, an organization’s only paid person, working real hours while the board is unpaid, nearly always has the officer box and runs the organization. The model makes the treasurer the CEO.

EZ-2 stipend president: org.type none; org.leadership board_governed
title pay hours boxes title only step 09 rules alone model’s pick P(CEO)
President 30,000 10 none BOARD CHAIR BOARD CEO BOARD 0.34
Vice President 0 2 none BOARD VICE CHAIR BOARD BOARD BOARD 0.00
Treasurer 0 2 none BOARD TREASURER BOARD BOARD BOARD 0.00

The model removes a CEO. The president is paid $30,000 for 10 hours a week. That is over the pay rule’s $25,000, and just over the stipend rule’s limits, so the rules impute the president as CEO. On full 990s, a president paid like this for so few hours, in a filing with no one else paid, mostly ticks only the trustee box: a board chair with a stipend. The model reads the president as a board seat, and the filing as run by its board.

EZ-3 part-time coordinator: org.type none; org.leadership board_governed
title pay hours boxes title only step 09 rules alone model’s pick P(CEO)
Coordinator 18,000 15 none STAFF STAFF STAFF CEO 0.41
President 0 4 none BOARD CHAIR BOARD BOARD BOARD 0.00
Secretary 0 2 none BOARD SECRETARY BOARD BOARD BOARD 0.00

The guard holds the model back. The model leans toward naming the only paid person as CEO: a coordinator, here, at $18,000 for 15 hours a week. But the coordinator has no CEO-level title and works under 20 hours a week for under $50,000. The guard keeps the rules’ answer, STAFF, and the filing has no CEO.

EZ-4 club: org.type club; org.leadership thesaurus
title pay hours boxes title only step 09 rules alone model’s pick P(CEO)
Golf Professional 60,000 40 none PROFESSIONAL PROFESSIONAL PROFESSIONAL CEO 0.50
General Manager 45,000 40 none MANAGER CEO (thesaurus) CEO MANAGER 0.09
President 0 3 none BOARD CHAIR BOARD BOARD BOARD 0.00

The thesaurus overrides the model. The model picks the best-paid person, the golf professional. This is a club, and the club entry ranks the general manager above a golf pro.

The model’s limits are the teacher’s: - It inherits the rules’ errors. It learned from the rules applied to full-990 filings, so it repeats what the rules get wrong there. - It does not know organization types. That is why the thesaurus runs after it. - It is less transparent than a rule. To see why it decided, compare role.method and run resolve_roles(use_model = FALSE) on the same rows.

Putting it together

data(tinypartvii)
set.seed(11)
df <- dplyr::sample_n(tinypartvii, 1500) |>
  standardize_df() |> remove_dates() |> standardize_conj() |> split_titles() |>
  standardize_spelling() |> gen_status_codes() |> standardize_titles() |>
  categorize_titles() |> conditional_logic()
#> [OK] standardize df step complete
#> [OK] remove dates step complete
#> [OK] standardize conjunctions step complete
#> [OK] split titles step complete
#> [OK] standardize spelling step complete
#> [OK] generate status codes step complete
#> [OK] standardize titles step complete
#> [OK] categorize titles step complete
#> 
#> [OK] conditional logic step complete

# one row per filing: how it is led
df |> dplyr::distinct(object.id, formtype, org.leadership) |> dplyr::count(formtype, org.leadership)
#>   formtype org.leadership   n
#> 1      990 board_governed  62
#> 2      990     designated  35
#> 3      990        imputed  63
#> 4      990        no_paid 777
#> 5    990EZ board_governed  20
#> 6    990EZ     designated  11
#> 7    990EZ          model   4
#> 8    990EZ        no_paid 361

# the CEOs, with how each was found
df |> dplyr::filter(role.primary, role.final == "CEO") |>
  dplyr::count(formtype, role.ceo, role.method)
#>   formtype   role.ceo role.method  n
#> 1      990 designated       rules 34
#> 2      990    imputed       rules 63
#> 3      990    interim       rules  1
#> 4    990EZ designated       model 11
#> 5    990EZ      model       model  4