LiteLLM

LiteLLM

LiteLLM is an API proxy that allows you to route requests to various AI providers through a unified interface. Uniport fits in seamlessly as a backend.

🔧 How to Integrate

1. Install LiteLLM:

bashCopyEditpip install litellm

1. Add Uniport to your litellm.yaml:

yamlCopyEditmodel_list:
  - model_name: gpt-4-uniport
    litellm_provider: openai
    api_base: https://api.uniportai.site/v1
    api_key: YOUR_UNIPORT_API_KEY

1. Run LiteLLM locally:

bashCopyEditlitellm --config litellm.yaml