Native LLM and Embedding Inference for PHP

💻 Native LLM and Embedding Inference for PHP

ext-infer has been released — an extension for PHP 8.3+ that allows performing LLM inference and creating embeddings directly inside the PHP process. The tool is based on llama.cpp and utilizes Rust via ext-php-rs.

🌍 Integration of local models into traditional server environments without complicating infrastructure.

👤 Native use of LLMs (GGUF) without Python or external APIs.

Source 1: https://infer.displace.tech Source 2: https://github.com/DisplaceTech/ext-infer