SciCore-Omics

🧬 SciCore-Omics A tri-modal foundation model unifying histology, spatial transcriptomics, and biological language 🔍 Overview SciCore-Omics** is a tri-modal biomedical foundation model that connects **histology images**, **spatial transcriptomic profiles**, and **biological language** for spatial biology and pathology-related reasoning. The model introduces a gene-aware branch based on **NicheFormer + Gene Q-Former + Gene Projector**, enabling transcriptomic information to be aligned with the language-model token space. SciCore-Omics supports: 🖼️ image-only reasoning; 🧬 gene-only reasoning; 🖼️🧬 joint image-gene reasoning; 💬 natural-language biomedical interpretation. ✨ Highlights Tri-modal modeling of histology, spatial transcriptomics, and language Gene-aware transcriptomic encoding with NicheFormer Unified image-gene-text reasoning in the language-model space Designed for spatial biology, pathology reasoning, and biomedical interpretation Open-source model weights, code, and demo 🚀 Quick Start This Hugging Face repository hosts the model weights. For full inference and training code, please refer to the GitHub repository: Download the model weights: Minimal loading example: For complete examples, please see: https://github.com/OpenBMB/Scicore-Omics/tree/main/eval 📦 Resources | Resource | Link | | ------------- | ----------------------------------------------------- | | Model weights | https://huggingface.co/openbmb/SciCore-Omics | | GitHub code | https://github.com/OpenBMB/Scicore-Omics | | Online demo | https://huggingface.co/spaces/Alkaidxxy/SciCore-Omics | ⚠️ Limitations SciCore-Omics is released for research use only. It may generate inaccurate or incomplete biomedical interpretations and should not be used as a standalone clinical diagnostic or treatment recommendation system. 📚 Citation 📄 License This project is released under the Apache-2.0 License.