vsubasri/joint-nt-esm2-transcript-coding-protein

ESM2 Protein Model

This is the protein component of a jointly trained NT-ESM2 model pair for DNA-protein analysis.

Model Details

• Model Type: ESM2 for protein sequences
• Training: Jointly trained with NT DNA model
• Architecture: Transformer-based language model for proteins

Usage

from transformers import AutoModel, AutoTokenizer

# Load model and tokenizer
model = AutoModel.from_pretrained("vsubasri/joint-nt-esm2-transcript-coding-protein")
tokenizer = AutoTokenizer.from_pretrained("vsubasri/joint-nt-esm2-transcript-coding-protein")

# Example usage
protein_sequence = "MKTVRQERLKSIVRILERSKEPVSGAQLAEELSVSRQVIVQDIAYLRSLGYNIVATPRGYVLAGG"
inputs = tokenizer(protein_sequence, return_tensors="pt")
outputs = model(**inputs)

Training Details

• Jointly trained with DNA sequences for cross-modal understanding
• Large model variant
• Transcript-specific protein coding sequences

Files

• config.json: Model configuration
• model.safetensors: Model weights
• tokenizer_config.json: Tokenizer configuration
• vocab.txt: Vocabulary file
• special_tokens_map.json: Special tokens mapping

Citation

If you use this model, please cite the original ESM2 paper and your joint training work.