Skip to content
@NLPOptimize

NLP Optimize

The world's fastest CPU tokenizer library!
README.md

NLPOptimize

NLPOptimize is dedicated to developing and optimizing libraries for natural language processing (NLP), text processing, and string manipulation. Our mission is to contribute valuable improvements to the NLP ecosystem.

Key Projects

How to Contribute

  • Contributions of all types are welcome!
  • Issues and pull requests (PRs) can be submitted freely without any specific format.

Collaboration

For collaboration proposals, please email your project of interest and potential contributions to:
[email protected]

Contact Information

  • LINE ID: xylitolsoft
  • Telegram ID: @xylitolsoft

Pinned Loading

  1. flash-tokenizer flash-tokenizer Public

    EFFICIENT AND OPTIMIZED TOKENIZER ENGINE FOR LLM INFERENCE SERVING

    C++ 297 3

  2. FormatFlex FormatFlex Public

    🚀 A flexible Python library for easy handling and conversion of Hierarchical, Tabular, and Serialized data formats.

    Python 7

  3. awesome-tokenizers awesome-tokenizers Public

    A curated list of tokenizer libraries for blazing-fast NLP processing.

    5

  4. rainbow_logging rainbow_logging Public

    🌈 A flexible and minimal Python logging utility that adds colorful, readable log output to your terminal.

    Python

Repositories

Showing 6 of 6 repositories
  • rainbow_logging Public

    🌈 A flexible and minimal Python logging utility that adds colorful, readable log output to your terminal.

    NLPOptimize/rainbow_logging’s past year of commit activity
    Python 0 MIT 0 0 0 Updated Apr 9, 2025
  • awesome-tokenizers Public

    A curated list of tokenizer libraries for blazing-fast NLP processing.

    NLPOptimize/awesome-tokenizers’s past year of commit activity
    5 0 0 0 Updated Apr 9, 2025
  • flash-tokenizer Public

    EFFICIENT AND OPTIMIZED TOKENIZER ENGINE FOR LLM INFERENCE SERVING

    NLPOptimize/flash-tokenizer’s past year of commit activity
    C++ 297 3 1 0 Updated Apr 9, 2025
  • FormatFlex Public

    🚀 A flexible Python library for easy handling and conversion of Hierarchical, Tabular, and Serialized data formats.

    NLPOptimize/FormatFlex’s past year of commit activity
    Python 7 MIT 0 0 0 Updated Apr 7, 2025
  • .github Public
    NLPOptimize/.github’s past year of commit activity
    0 MIT 0 0 0 Updated Apr 3, 2025
  • NLPOptimize Public
    NLPOptimize/NLPOptimize’s past year of commit activity
    1 0 0 0 Updated Mar 29, 2025

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…