FlashInfer
FlashInfer is a toolkit that introduces techniques to accelerate large language model deployment, offering optimized solutions for inference and serving.
Introduction
Website: https://flashinfer.ai
Introduce Techniques to accelerate Large Language Model Deployment
Key Features
The tool is currently under continuous development. For more features, please visit the official website.
