Pinned Loading

1. intel/intel-extension-for-transformers intel/intel-extension-for-transformers Public archive

   ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

   Python 2.2k 216

2. intel/neural-speed intel/neural-speed Public archive

   An innovative library for efficient LLM inference via low-bit quantization

   C++ 353 37

3. GenAIComps GenAIComps Public

   Forked from opea-project/GenAIComps

   GenAI components at micro-service level; GenAI service composer to create mega-service

   Python

4. GenAIExamples GenAIExamples Public

   Forked from opea-project/GenAIExamples

   Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.

   Shell

5. GenAIEval GenAIEval Public

   Forked from opea-project/GenAIEval

   Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety, and hallucination

   Python