Transformers documentation
Troubleshooting
Get started
Tutorials
Pipelines for inferenceLoad pretrained instances with an AutoClassPreprocessSummary of the tasksSummary of the modelsFine-tuning a pretrained modelDistributed training with 🤗 AccelerateShare a modelSummary of the tokenizersMulti-lingual models
How-to guides
Create a custom modelInference for multilingual modelsExamplesTroubleshootingFine-tuning with custom datasets
Fine-tune for downstream tasks
Text classificationToken classificationQuestion answeringLanguage modelingTranslationSummarizationMultiple choice
🤗 Transformers NotebooksRun training on Amazon SageMakerCommunityConverting Tensorflow CheckpointsMigrating from previous packagesHow to contribute to transformers?How to add a model to 🤗 Transformers?How to add a pipeline to 🤗 Transformers?Using tokenizers from 🤗 TokenizersPerformance and Scalability: How To Fit a Bigger Model and Train It FasterModel ParallelismTestingDebuggingExporting 🤗 Transformers modelsSharing custom modelsChecks on a Pull RequestResearch
API
Main Classes
CallbacksConfigurationData CollatorKeras callbacksLoggingModelsONNXOptimizationModel outputsPipelinesProcessorsTokenizerTrainerDeepSpeed IntegrationFeature Extractor
Models
ALBERTAuto ClassesBARTBARThezBARTphoBEiTBERTBertweetBertGenerationBertJapaneseBigBirdBigBirdPegasusBlenderbotBlenderbot SmallBORTByT5CamemBERTCANINEConvNeXTCLIPConvBERTCPMCTRLData2VecDeBERTaDeBERTa-v2DeiTDETRDialoGPTDistilBERTDPRELECTRAEncoder Decoder ModelsFlauBERTFNetFSMTFunnel TransformerHerBERTI-BERTImageGPTLayoutLMLayoutLMV2LayoutXLMLEDLongformerLUKELXMERTMarianMTMaskFormerM2M100MBart and MBart-50MegatronBERTMegatronGPT2MLUKEMobileBERTmLUKEMPNetMT5NyströmformerOpenAI GPTOpenAI GPT2GPT-JGPT NeoHubertPerceiverPegasusPhoBERTPLBartPoolFormerProphetNetQDQBertRAGREALMReformerRemBERTRetriBERTRoBERTaRoFormerSegFormerSEWSEW-DSpeech Encoder Decoder ModelsSpeech2TextSpeech2Text2SplinterSqueezeBERTSwin TransformerT5T5v1.1TAPASTransformer XLTrOCRUniSpeechUniSpeech-SATViLTVision Encoder Decoder ModelsVision Text Dual EncoderVision Transformer (ViT)ViTMAEVisualBERTWav2Vec2Wav2Vec2PhonemeWavLMXGLMXLMXLM-ProphetNetXLM-RoBERTaXLM-RoBERTa-XLXLNetXLSR-Wav2Vec2XLS-RYOSO
Internal Helpers
You are viewing v4.17.0 version. A newer version v5.9.0 is available.
Troubleshooting
This document is to help find solutions for common problems.
Firewalled environments
Some cloud and intranet setups have their GPU instances firewalled to the outside world, so if your script is trying to download model weights or datasets it will first hang and then timeout with an error message like:
ValueError: Connection error, and we cannot find the requested files in the cached path.
Please try again or make sure your Internet connection is on.One possible solution in this situation is to use the “offline-mode”.