Skip to main content
model-family passport · Review date not recorded

Geneformer

A transfer-learning foundation model of gene networks.

2/7Evidence fields documented
60-SECOND EVALUATION VIEW

What should a scientist know before using Geneformer?

UnresolvedEvidence direction is incomplete or not yet resolved
Best suited forGeneration · Prediction
Evidence supportsPrimary links may be present, but BioAtlas does not claim a review date without a record-level timestamp.
Evidence does not establishUniversal superiority, therapeutic success, clinical utility or regulatory acceptance.
Major limitationPerformance depends on the evaluation dataset and operating conditions.
Current registry recordVersion history not yet curated1 recorded release · Review date not recorded. A newer version is not assumed to be universally better.

What it is

Geneformer is pretrained on tens of millions of single-cell transcriptomes to learn a context-aware model of gene networks, enabling predictions about regulation and disease with limited task-specific data. It was among the first single-cell foundation models used to nominate therapeutic targets.

Evidence trail

BioAtlas keeps the path from source to decision visible. A connection records provenance; it does not imply that evidence is sufficient for every context.

Sources2 connectedPrimary resources and normalized claims
Claims0 normalizedNo normalized claim yet
EntityGeneformermodel-family · Version history not yet curated
ReviewReview date not recordedReview date not claimed
ConclusionContext requiredAdd to an evaluation before operational use

Model passport

Entity typemodel-family
OrganizationBroad Institute
Model family introducedNot normalized
AccessOpen source
Commercial useAllowed / verify checkpoint terms
DeploymentSelf-hosted
ComputeGPU recommended
Domainsgenomics
Biology → representation → computation → evidence

How Geneformer represents biology

model-familygenomics

Category is navigation. These fields describe the model-specific computational transformation and deliberately override broad category defaults.

1 · Biological inputs
DNA sequence
2 · Input representation
Nucleotide / genomic tokens
3 · Internal representation
Genomic representation
4 · Architecture
Genomic foundation model
5 · Learning objective
Sequence modelling
6 · Output representation
Dense vectorsGenomic tracksSequence

Biological scale

Modalities & tasks

DNAGenerationPredictionRepresentation

Registry, claims and frontier intelligence

Versioned registry

Version history not yet curated

1 version record · release year not yet normalized. Model-family identity remains separate from capability and access changes.

Explore version lineage →
Benchmark claim ledger

0 normalized claims

No task, dataset, split and metric claim has been normalized for this record yet.

Open claim intelligence →

Connected research frontiers

These records describe active research directions, not guaranteed capabilities of this model. Evidence stages and unresolved questions are preserved separately.

Virtual cells

Virtual cells that predict perturbation response

Arc Institute · Virtual Cell research community · 2026-04-30
Recent preprint

Can models forecast how cell populations respond to unseen drugs, gene edits, cytokines and environmental changes across biological contexts?

Evidence boundary and unresolved questions

Recent strict evaluations show marked performance drops under unseen contexts and metric-dependent rankings; simple baselines remain competitive on some global trends.

  • Can models recover perturbation-specific mechanisms rather than average expression shifts?
  • How should cell distributions, dose and time be represented?
  • Which metrics predict prospective experimental usefulness?
virtual cells · perturbation · single cell · OOD generalization · world modelsOpen frontier record →

Inputs and outputs

Inputs

DNA sequence

Outputs

Sequence predictionsEmbeddings or generated sequence

Scientific and technical profile

Scientific principles

Single-cell language modelingNetwork biologyTransfer learning

Technology

Rank-value gene encodingTransformerIn-silico perturbation
Ideas before algorithms

Scientific lineage

Explore all foundations

These are transparent concept matches—not claims that one scientist alone caused this model. Each connection is based on the model’s recorded domain, scientific principles, technical terms or an explicit lineage link.

Computational intelligence

Transformer self-attention

Ashish Vaswani and colleagues

Protein, genome, molecule and single-cell foundation models use attention to learn dependencies across biological sequences and multimodal inputs.

Matched concepts: transformer, language model, sequence
Genomics & cell systems

DNA as the hereditary transforming principle

Oswald Avery, Colin MacLeod & Maclyn McCarty

Genomics, variant interpretation, gene therapy and sequence foundation models depend on DNA being the durable molecular carrier of biological information.

Matched concepts: dna, sequence
Computational intelligence

Information, entropy and communication

Claude E. Shannon

Sequence modelling, cross-entropy training, language models, mutual information and representation learning all use Shannon’s framework.

Matched concepts: language model, sequence
Genomics & cell systems

X-ray evidence for the helical structure of DNA

Rosalind Franklin & Raymond Gosling

Structural genomics and sequence-to-structure reasoning began with experimentally grounded molecular geometry.

Matched concepts: dna, sequence

Evaluation evidence

Dataset or evaluationNot yet curated
Task or metricNot yet extracted
Evidence statusPrimary paper linked; benchmark extraction pending
Open source ↗

BioAtlas has not yet extracted a structured benchmark claim for this record.

Known limitations

  • Performance depends on the evaluation dataset and operating conditions.
  • A structured benchmark claim has not yet been extracted for this record.
  • Outputs require task-specific scientific and experimental validation.

Milestones

Not normalized

Trained on ~30M single-cell transcriptomes.

Evidence

Used to identify candidate cardiomyopathy targets.