models/openai--clip-vit-large-patch14/tokenizer_config.json

models/sentence-transformers_all-MiniLM-L6-v2/tokenizer.json

models/sentence-transformers_all-MiniLM-L6-v2/tokenizer_config.json

Showing first 3 matched files of 37 total files

tokenizer.model

tokenizer_checklist.chk

Showing first 2 matched files of 26 total files

tokenizer.model

Showing first 1 matched files of 4 total files

tokenizer.model

Showing first 1 matched files of 4 total files

12 Токенизация, контекстные окна, test time scaling/tokenizers.ipynb

Showing first 1 matched files of 120 total files

14 - Core Foundations of Generative AI/5 -Implementing a Custom Tokenizer in Python.en_US.vtt

14 - Core Foundations of Generative AI/5 -Implementing a Custom Tokenizer in Python.mp4

Showing first 2 matched files of 568 total files

UBTL-Client/files/runtime3764/tokenize.py

UBTL-Client/files/runtime3764/__pycache__/tokenize.cpython-312.pyc

UBTL-Client/files/runtime3764/tinycss2/tokenizer.py

UBTL-Client/files/runtime3764/tinycss2/__pycache__/tokenizer.cpython-312.pyc

Showing first 4 matched files of 1344 total files

3. LLaMA Architecture/2. The LLaMA tokenizer.mp4

Showing first 1 matched files of 28 total files

32. LLMs Module Hugging Face Transformers/3. Pre-trained tokenizers.mp4

32. LLMs Module Hugging Face Transformers/3. Pre-trained tokenizers.vtt

33. LLMs Module Question and Answer Models With BERT/3. Loading the model and tokenizer.mp4

33. LLMs Module Question and Answer Models With BERT/3. Loading the model and tokenizer.vtt

Showing first 4 matched files of 1269 total files

~Get Your Files Here !/3 - Adding New Tokens and Creating Templates for the Tokenizer/20. Bolum_(Section)__2.ipynb.bin

~Get Your Files Here !/3 - Adding New Tokens and Creating Templates for the Tokenizer/20. Download the Model and Tokenizer.en_US.srt

~Get Your Files Here !/3 - Adding New Tokens and Creating Templates for the Tokenizer/20. Download the Model and Tokenizer.mp4

~Get Your Files Here !/3 - Adding New Tokens and Creating Templates for the Tokenizer/21. Adding New Custom Tokens to the Tokenizer.en_US.srt

~Get Your Files Here !/3 - Adding New Tokens and Creating Templates for the Tokenizer/21. Adding New Custom Tokens to the Tokenizer.mp4

Showing first 5 matched files of 108 total files

09. Preparing Text Data for Use with a Model - Part 3 Getting a Tokenizer - Zero - 1920x1080 892K.mp4

10. Preparing Text Data for Use with a Model - Part 4 Exploring Our Tokenizer - Zero - 1920x1080 700K.mp4

11. Preparing Text Data for Use with a Model - Part 5 Creating a Function to Tokenize Our Data - Zero - 1920x1080 883K.mp4

Showing first 3 matched files of 41 total files

llama-7b-4bit/tokenizer.model

llama-7b-4bit/tokenizer_config.json

llama-13b-4bit/tokenizer.model

llama-13b-4bit/tokenizer_config.json

llama-30b-4bit/tokenizer.model

Showing first 5 matched files of 28 total files

4 - OpenSearch - Text Analysis/5 -Normalization Techniques Tokenizers Token filters.mp4

Showing first 1 matched files of 81 total files

tpldata/python-lib/tokenize.py

Showing first 1 matched files of 590 total files

lib/tokenize.pyc

lib/lib2to3/pgen2/tokenize.pyc

Showing first 2 matched files of 873 total files

12 Токенизация, контекстные окна, test time scaling/tokenizers .ipynb

Showing first 1 matched files of 119 total files

~Get Your Files Here !/3 - Intermediate/49 - Using Stringsplit to Tokenize Text.mp4

Showing first 1 matched files of 177 total files

Modules/StringTokenizer.mfx

Showing first 1 matched files of 63 total files

[TutsNode.net] - Azure ChatGPT and OpenAI Service - The Complete Guide/2. Introduction to ChatGPT/7.1 OpenAI Tokenizer.html

Showing first 1 matched files of 193 total files

tokenizer.model

tokenizer_checklist.chk

Showing first 2 matched files of 25 total files