Skip to content

Outlines

TGI

Initializing search

dottxt-ai/outlines

Home
Getting Started
Cookbook
Docs
API Reference
Community
Blog

Outlines

dottxt-ai/outlines

Home
Getting Started
Getting Started
Cookbook
Cookbook
- Classification
- Named Entity Extraction
- Generate synthetic data
- Summarize a document
- Playing chess
- Perspective-taking prompting
- Question-answering with citations
- Knowledge Graph Extraction
- Structured Generation Workflow
- Chain of Thought (CoT)
- ReAct Agent
- Vision-Language Models
- Structured Generation from PDFs
- Earnings reports to CSV
- Digitizing receipts with vision models
- Run on the cloud
  Run on the cloud
  - BentoML
  - Cerebrium
  - Modal
Docs
Docs
- Generation
  Generation
  - Overview
  - Text
  - Samplers
  - Structured generation
    Structured generation
    
    How does it work?
    
    Classification
    
    Regex
    
    Type constraints
    
    JSON (function calling)
    
    Grammar
    
    Creating Grammars
    
    Custom FSM operations
- Utilities
  Utilities
- Models
  Models
  - Overview
  - Open source
    Open source
    
    Transformers
    
    Transformers Vision
    
    Llama.cpp
    
    vLLM
    
    TGI
    
    ExllamaV2
    
    MLX
    
    Transformers
  - API
    API
    
    OpenAI
API Reference
API Reference
- Models
- Prompts
- Json schema
- Guide
- Parsing
- Regex
- Samplers
Community
Community
Blog

Text-generation-inference (TGI)

TGI uses Outlines to provide structured generation, see their documentation.

2024-06-13 2024-06-13 GitHub

Copyright © 2023- The Outlines Developers