google-ai-edge/LiteRT-LM Installation Guide

⚡

Automated Install (Recommended)

Quick installation instructions for google-ai-edge/LiteRT-LM. This is the fastest way to complete project installation and setup.

Install via curl

curl -fsSL https://hexmos.com/ipm-install | bash && 
ipm i google-ai-edge/LiteRT-LM

Install via PowerShell

iwr https://hexmos.com/ipm-install-ps -UseBasicParsing | iex; 
ipm i google-ai-edge/LiteRT-LM

Install via npx

npx @hexmos/ipm i google-ai-edge/LiteRT-LM

Prerequisites

uv

python_package_manager

Version: >=0.1.0

git

version_control

curl

command_line_tool

make

build_tool

Version: >=4.0

Manual Installation Methods

Install LiteRT-LM CLI using uv

uv tool install litert-lm --python

litert-lm run --from-huggingface-repo=google/gemma-3n-E2B-it-litert-lm gemma-3n-E2B-it-int4 --prompt="What is the capital of France?"

Install LiteRT-LM CLI using uv (Gemma 4)

uv tool install litert-lm --python

litert-lm run --from-huggingface-repo=litert-community/gemma-4-E2B-it-litert-lm gemma-4-E2B-it.litertlm --prompt="What is the capital of France?"

Download Linux x86_64 Binary

curl -LO https://github.com/google-ai-edge/LiteRT-LM/releases/download/v0.10.1/litert_lm_main.linux_x86_64

chmod +x litert_lm_main.linux_x86_64

Download macOS arm64 Binary

curl -LO https://github.com/google-ai-edge/LiteRT-LM/releases/download/v0.10.1/litert_lm_main.macos_arm64

chmod +x litert_lm_main.macos_arm64

Download Windows x86_64 Binary

curl -LO https://github.com/google-ai-edge/LiteRT-LM/releases/download/v0.10.1/litert_lm_main.windows_x86_64.exe

Build from Source

git clone https://github.com/google-ai-edge/LiteRT-LM.git

cd LiteRT-LM

make

Post Installation Steps

Refer to the language-specific guides for API integration.

← Back to library All Installation Guides