GLiClass: Open-Source JEV (github.com)

GLiClass, a new open-source model for zero-shot sequence classification, has been announced, showcasing impressive computational efficiency compared to traditional cross-encoder models. It achieves performance on par with its predecessors while processing results approximately ten times faster in a single forward pass. This breakthrough allows for rapid classification of various text inputs, making it a valuable tool for tasks such as sentiment analysis, document classification, and search result re-ranking. Significantly, GLiClass supports hierarchical label structures and allows users to improve classification accuracy through in-context examples and custom prompts. The model can handle large documents effectively with automatic text chunking, and it can be deployed in production environments using Ray Serve for dynamic batching and memory-aware processing. With various architecture types, pooling strategies, and scoring mechanisms available, GLiClass is poised to enhance the efficiency and flexibility of AI/ML applications across multiple domains. Researchers and developers can easily install and integrate GLiClass, expanding the utility of machine learning in real-world applications.