/tokenizer.model

/tokenizer_checklist.chk

Showing first 2 matched files of 26 total files

/models/openai--clip-vit-large-patch14/tokenizer_config.json

/models/sentence-transformers_all-MiniLM-L6-v2/tokenizer.json

/models/sentence-transformers_all-MiniLM-L6-v2/tokenizer_config.json

Showing first 3 matched files of 37 total files

/tokenizer.model

Showing first 1 matched files of 4 total files

/3. LLaMA Architecture/2. The LLaMA tokenizer.mp4

Showing first 1 matched files of 28 total files

/tokenizer.model

Showing first 1 matched files of 4 total files

/tokenizer.model

Showing first 1 matched files of 4 total files

/tokenizer.model

/tokenizer_checklist.chk

Showing first 2 matched files of 25 total files

/4. Fine-Tuning (Intermediate)/3. Models and Tokenizers.mp4

/4. Fine-Tuning (Intermediate)/3. Models and Tokenizers.srt

/4. Fine-Tuning (Intermediate)/4. Models and Tokenizers in Python.mp4

/4. Fine-Tuning (Intermediate)/4. Models and Tokenizers in Python.srt

/5. Named Entity Recognition (NER) and POS Tagging (Intermediate)/2. Data & Tokenizer (Code Preparation).mp4

Showing first 5 matched files of 267 total files

/prodmodels/tokenizer.json

/prodmodels/tokenizer_config.json

Showing first 2 matched files of 573 total files

/[TutsNode.net] - Azure ChatGPT and OpenAI Service - The Complete Guide/2. Introduction to ChatGPT/7.1 OpenAI Tokenizer.html

Showing first 1 matched files of 193 total files

/Blender 2.82 Portable x64/2.82/python/lib/lib2to3/pgen2/tokenize.py

/Blender 2.82 Portable x64/2.82/python/lib/site-packages/pip/_vendor/html5lib/_tokenizer.py

/Blender 2.82 Portable x64/2.82/python/lib/tokenize.py

Showing first 3 matched files of 3995 total files

/~Get Your Files Here !/2. Understanding LLMs/3.1 You can use the tool below to understand how a piece of text might be tokenized by a language model, and the total count of tokens in that piece of text..html

Showing first 1 matched files of 43 total files

/Modules/StringTokenizer.mfx

Showing first 1 matched files of 63 total files

/~Get Your Files Here !/8 - SustHugging Face The GitHub of language models/27 - Tokenizer and Hugging Face Models.mp4

Showing first 1 matched files of 53 total files

/4. Tokenize a String.html

/4. Tokenize a String.mov

Showing first 2 matched files of 22 total files

/tokenizer_checklist.chk

/tokenizer.model

Showing first 2 matched files of 25 total files

/Engine/Binaries/ThirdParty/Python3/Win64/Lib/lib2to3/pgen2/tokenize.py

/Engine/Binaries/ThirdParty/Python3/Win64/Lib/site-packages/pip/_vendor/html5lib/_tokenizer.py

/Engine/Binaries/ThirdParty/Python3/Win64/Lib/tokenize.py

/Engine/Binaries/ThirdParty/Python3/Win64/Lib/__pycache__/tokenize.cpython-37.pyc

Showing first 4 matched files of 3491 total files

/tokenizer_config.json

/tokenizer.model

Showing first 2 matched files of 17 total files

/main/tokenizer.model

/main/tokenizer_config.json

Showing first 2 matched files of 30 total files

/[TutsNode.com] - Machine Learning, Deep Learning and Bayesian Learning/13 - Deep Learning Transformers and BERT/006 Tokenizers and data prep for BERT models_en.vtt

/[TutsNode.com] - Machine Learning, Deep Learning and Bayesian Learning/13 - Deep Learning Transformers and BERT/006 Tokenizers and data prep for BERT models.mp4

Showing first 2 matched files of 548 total files