One real academic CV: first what CVParsa understands about it, then what it verifies.
Excerpts from the CV. Margin notes: what CVParsa extracted from all 19 pages.
Each record is counted once, in its own section, so the honor never inflates the funding totals and the grant never inflates the honors.
| As written on the CV | As recorded by CVParsa | |
|---|---|---|
| Entry | A. Clauset, “How large should whales be?” PLOS ONE 8(1), e53967 (2013). | How Large Should Whales Be? Journal article, PLoS ONE, 2013 |
| DOI | not given | 10.1371/journal.pone.00539671 |
| Author | A. Clauset | Aaron Clauset, ORCID iD 0000-0002-3529-87461 |
| Affiliation | not given | Santa Fe Institute; University of Colorado Boulder2 |
| Impact | not given | 45 citations; field-weighted citation impact 3.93 |
Across the whole CV: 106 of 114 entries were matched, 99 in Crossref and 7 in other scholarly databases. The record now carries 96 DOIs that the CV never states, and it shows the owner as first author on 25 publications and last author on 38.
| As written on the CV | As recorded by CVParsa | |
|---|---|---|
| Award | no award number given | NSF 14527181 |
| Title | “CAREER: Hierarchical probabilistic models for networks with rich data in scientific domains.” | CAREER: Hierarchical Probabilistic Models for Networks with Rich Data in Scientific Domains |
| Amount, period | NSF CISE, $550,000, 2015 – 2020 | $550,000, 2015 to 2020 |
| Role | PI | PI2 |
| Award | no award number given | NSF 20221381 |
| Title | “NRT: Integrated Data Science (Int dS): Teams for Advancing Bioscience Discovery.” | NRT-HDR: Integrated Data Science (Int dS): Teams for Advancing Bioscience Discovery3 |
| Amount, period | NSF DGE, $3,000,000, 2020 – 2025 | $3,000,000, 2020 to 20264 |
| Role | co-PI, with … | co-PI2 |
Across the whole CV: 22 grants listed. 13 come from funders with public award databases, 10 of those were confirmed in NSF and NIH records, and the CV owner's role was confirmed on 9.
Across this CV, 7 of 8 honors were recognized and 1 receipt was independently confirmed. An unconfirmed receipt is not a negative finding; it means no public record lists it yet.
| General-purpose chatbot (ChatGPT, Claude) | CVParsa | |
|---|---|---|
| Read one CV and summarize it | Does this well | Does this well |
| Apply the same fields and vocabulary to every CV in a pool of hundreds | Output varies between runs | One schema, fixed academic vocabularies |
| Know that a fellowship title can be a postdoc, and that a CAREER award is both an honor and a grant | Inconsistently | Applied the same way to every CV |
| Count publications | Depends on how the question is asked | 114 items listed, 94 counted as publications; preprints and patents kept separate |
| Confirm each record against Crossref, NSF, NIH, and Cevian Labs databases | Not systematically, and prone to inventing citations it cannot find | Every record states which authority confirmed it, or that none did |
| Handle confidential applicant files | Consumer accounts raise data-governance questions | Encrypted, never used to train AI models, originals deleted within 30 days |
| Listed | Confirmed | Confirmed against | Not confirmed | |
|---|---|---|---|---|
| Publications | 114 | 106 | Crossref and other scholarly databases | 8, kept as listed |
| Grants | 22 | 10 | NSF and NIH award recordsowner's role confirmed on 9 | 12, kept as listed |
| Honors | 8 | 7 | Cevian Labs Academic Honors Registryreceipt independently confirmed on 1 | 1, not in the registry |
Example: A. Clauset, “How large should whales be?” PLOS ONE (2013) was matched in Crossref, which supplied its DOI, 10.1371/journal.pone.0053967. The CV gives none.