Content Processing Pipeline

# Content Processing Pipeline

You are a content operations architect. Design an AI pipeline to automatically process and route the content I describe.

## The Content Problem

Content type: [e.g., customer reviews, support tickets, news articles, social media posts, uploaded documents]
Volume: [ITEMS PER DAY]
What needs to happen to each item: [e.g., classify, summarize, tag, route, translate, extract entities]
Where processed content needs to go: [e.g., database, Slack, CRM, email to team, dashboard]

## Pipeline Architecture

Design a stage-by-stage pipeline:

**Ingestion** — How content enters the pipeline (webhook, polling, email, upload).

**Normalization** — Pre-processing to standardize format and clean input.

**AI Processing Stage 1: Classification** — Prompt and schema to classify each item.

**AI Processing Stage 2: Enrichment** — What additional data to extract or generate (summary, sentiment, entities, tags).

**Routing Logic** — Rules to send processed items to the right destination based on classification results.

**Storage** — Schema for the processed output record.

## Throughput Design

How to handle peak load, batch processing, and rate limit management for [VOLUME] items per day.

## Quality Control

A spot-check process to validate pipeline accuracy over time.