> ## Documentation Index
> Fetch the complete documentation index at: https://docs.openliate.tech/llms.txt
> Use this file to discover all available pages before exploring further.

# [L] Large Models Layer

> Model abstraction, Sarvam AI sovereign inference, and dynamic LLM routing

## Overview

Layer **`[L]`** abstracts foundational models behind a standardized client interface (`SarvamClient` in `src/llm/`).

It dynamically normalizes model identifiers and handles token limits, temperature, and multi-turn message formatting.

***

## Supported Providers

### 1. Sarvam AI (Sovereign Primary)

OpenLiate natively defaults to **Sarvam AI**, India's frontier sovereign AI models:

* `sarvam/sarvam-105b` — High-capacity multi-step reasoning.
* `sarvam/sarvam-2b` — Ultra-lightweight edge execution.
* Direct integration via `hub/llm/sarvam.json`.

### 2. Ollama & Local Silicon

Run completely offline on local Apple Silicon or NVIDIA edge devices.

### 3. Cloud Frontier Models

Anthropic (Claude 3.5 Sonnet) and OpenAI (GPT-4o).

***

## Configuration in `agent.json`

Layer `[L]` can be declared as a clean string or a detailed object:

```json Shorthand String theme={"dark"}
{
  "L": "sarvam/sarvam-105b"
}
```

```json Structured Object theme={"dark"}
{
  "L": {
    "provider": "sarvam",
    "model": "sarvam-2b",
    "temperature": 0.2,
    "maxTokens": 4096
  }
}
```


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.