20 gold tasks
Task explorer
Every task is grounded in a specific sentence of a specific frozen abstract — see each task's construction note for exactly which one, and whether it's a real question or a deliberate hallucination trap.
| ID | Type | Domain | Difficulty | Status | Question |
|---|---|---|---|---|---|
| A1 | Direct factual retrieval | protein biology | easy | Answerable | According to the corpus, what kind of protein does the TP53 gene encode and what is its canonical function? |
| A2 | Direct factual retrieval | protein biology | easy | Answerable | According to the corpus, what is BRCA1 and what cellular processes does it participate in? |
| B1 | Evidence aggregation | disease mechanisms | medium | Answerable | What experimental evidence in the corpus supports a mechanistic link between mutant p53 and immune suppression? |
| C1 | Comparison | genetics | medium | Answerable | Compare BRCA1 and PALB2 as characterized in the corpus: what do they have in common and how do they differ? |
| E1 | Multi-hop synthesis | protein biology | hard | Answerable | Via what intermediate binding partner does BRCA1 reach downstream DNA-repair effector proteins, according to the corpus, and which effectors are named? |
| F1 | Contradiction handling | disease mechanisms | hard | Answerable, with caveat | Is the finding that breast-cancer risk after ovarian cancer in germline BRCA1/2 carriers is lower than expected a settled consensus in the corpus, or is it contested/being re-evaluated? |
| G1 | Insufficient evidence (trap) | protein biology | medium | Trap — no answer exists | Does the corpus provide evidence that DDIAS directly binds or interacts with BRCA1? |
| G2 | Insufficient evidence (trap) | genetics | medium | Trap — no answer exists | Does the corpus provide evidence that EGFR regulates TP53-mutation-driven immune suppression? |
| D1 | Relation extraction | protein biology | medium | Answerable | Extract the gene/protein relationship(s) describing how BARD1 relates to BRCA1, with supporting evidence, from the corpus. |
| A3 | Direct factual retrieval | genetics | easy | Answerable | According to the corpus, what fraction of breast cancer cases are attributable to hereditary causes, and which gene is cited as the main cause of the familial forms? |
| B2 | Evidence aggregation | drug interactions | medium | Answerable | According to the corpus, what class of drug exploits homologous recombination deficiency (HRD) in BRCA-associated ovarian and breast cancers, and what is the general premise of this therapeutic approach? |
| E2 | Multi-hop synthesis | pathways | hard | Answerable | Chain together, using two separate documents in the corpus, how a BRCA2 germline pathogenic variant creates a specific drug-treatable vulnerability: what DNA repair process does BRCA2 support, and what class of drug exploits its loss? |
| A4 | Direct factual retrieval | pathways | easy | Answerable | According to the corpus, which signaling pathway is frequently altered in gynecological tumors like PIK3CA-mutated endometrial cancer, and what investigational drug for this target is described being trialed? |
| C2 | Comparison | bioinformatics methodology | medium | Answerable | Compare SynthDNM and elPrep 5 as described in the corpus: what stage of a variant-calling pipeline does each tool address? |
| B3 | Evidence aggregation | bioinformatics methodology | medium | Answerable | What evidence does the corpus provide about limitations of existing variant-filtering methods in NGS analysis pipelines, and how do the cited documents propose addressing them? |
| T1 cutoff <2021 | temporal_cutoff | protein biology | hard | Answerable | Based only on literature published before 2021 in the corpus, what ubiquitin ligase regulates the MDM2-p53 pathway, and how? |
| G3 | Insufficient evidence (trap) | disease mechanisms | medium | Trap — no answer exists | Does the corpus provide evidence that growth hormone (GH)-IGF axis signaling regulates TP53 mutation status in cancer? |
| G4 | Insufficient evidence (trap) | protein biology | medium | Trap — no answer exists | Does the corpus provide evidence that Integrin alpha-3 (ITGA3) directly regulates BRCA1-mediated DNA repair? |
| B4 | Evidence aggregation | disease mechanisms | medium | Answerable | In which hematologic malignancies does the corpus describe TP53 status as prognostically significant, and for which is a specific patient population or predictive role noted? |
| C3 | Comparison | drug interactions | medium | Answerable | Compare CDK4/6 inhibitors and PARP inhibitors as described in the corpus: what breast/gynecological cancer contexts and mechanisms does each target? |
These tasks were constructed by a single researcher directly from real corpus text (“researcher-constructed,” not an expert panel — see methods). Every acceptable-answer concept is traceable to a specific abstract via each task’s construction note in the repo.