Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

N

NCD data aggregation and classification
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Wiki
- Environments
- Terraform modules
- Incidents

Snippets Groups Projects

e8f3c549

Commit e8f3c549 authored 1 month ago by Ivan Pavlovich

Downloads
- Patches
- Plain Diff

Added 2 more tokenizers and starting price calculation

parent aeac2c49

Branches

No related tags found

Loading

Changes 3

Hide whitespace changes

Inline Side-by-side

Showing

models/LLM/Tokenizer/doc/token_count.json 536 additions, 45 deletions

models/LLM/Tokenizer/doc/token_count.json
models/LLM/Tokenizer/token_count.py 51 additions, 29 deletions

models/LLM/Tokenizer/token_count.py
models/LLM/prices/calc_llm_prices.py 13 additions, 0 deletions

models/LLM/prices/calc_llm_prices.py

with 600 additions and 74 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment