🚌

Transdev Mobility: AI-Powered Knowledge Platform

Enterprise AI Platform for Transportation Operations

Multi-City
Transportation Network
1000s
Employee Users
StackIT
German Cloud
100%
Data Sovereignty

Project Introduction

Transdev, one of Germany's leading mobility companies managing city transportation infrastructure including buses and trains in partnership with Deutsche Bahn, faced a critical challenge: their employees needed instant access to internal operational knowledge spanning thousands of processes, regulations, and procedures across multiple cities and transportation modes.

Traditional knowledge management systems—static wikis, scattered documentation, and email chains—were failing to provide timely answers to operational questions. Drivers, dispatchers, maintenance teams, and administrative staff were spending hours searching for information about route changes, safety protocols, vehicle maintenance procedures, customer service policies, and regulatory compliance requirements.

The solution: Build an AI-powered company chat portal where employees can interact with open-source language models (Google Gemma, Mistral) fine-tuned on Transdev's internal knowledge base, deployed on StackIT—Germany's sovereign cloud infrastructure—ensuring complete data privacy and regulatory compliance.

Key Objectives

✓ Instant access to operational knowledge
✓ Fine-tuned models on company data
✓ German cloud infrastructure (StackIT)
✓ Complete data sovereignty
✓ Multi-model support (Gemma, Mistral)
✓ SSO integration with existing systems
✓ Enterprise-grade security & compliance
✓ Scalable for thousands of employees

Project Challenges

☁️

StackIT Cloud Integration

Integrating with StackIT, Germany's sovereign cloud provider, for model hosting. Utilizing StackIT's managed model endpoints instead of self-hosted vLLM, requiring adaptation of architecture to cloud-native services while maintaining control.

🎯

Multi-Model Fine-Tuning

Fine-tuning multiple open-source models (Google Gemma, Mistral) on Transdev's internal knowledge base covering transportation operations, safety protocols, maintenance procedures, and customer service across different cities and vehicle types.

📚

Domain-Specific Knowledge

Encoding complex transportation domain knowledge including route planning, vehicle maintenance schedules, safety regulations, customer service protocols, and regulatory compliance requirements specific to German public transportation.

🔐

SSO with StackIT Identity

Implementing Single Sign-On with StackIT's identity services instead of self-hosted Keycloak, integrating with existing employee directories while maintaining seamless authentication across the platform.

🔄

GitOps with Flux

Implementing GitOps workflows using Flux instead of ArgoCD, managing infrastructure and application deployments through StackIT's Git repository and container registry with automated synchronization and rollbacks.

🏙️

Multi-Tenancy for Cities

Supporting multiple city operations with different routes, vehicles, and procedures while maintaining data isolation between regions, allowing city-specific customizations while sharing core infrastructure.

Real-Time Operations Data

Integrating real-time operational data including current vehicle locations, route status, delay information, and maintenance schedules to provide context-aware responses to employee queries.

🛡️

Compliance & Security

Meeting German data protection regulations (GDPR), transportation industry compliance requirements, and Transdev's internal security policies while ensuring all data remains within German jurisdiction.

Solution Architecture: StackIT-Native Design

Five-Layer Cloud-Native Architecture

Designed specifically for StackIT's managed services ecosystem, the platform leverages cloud-native capabilities while maintaining complete data sovereignty within German infrastructure.

🖥️
Layer 1
Frontend
OpenWebUI
User-facing chat interface
🔄
Layer 2
LLM Gateway
LiteLLM Proxy
Model routing to StackIT endpoints
🔐
Layer 3
Authentication
StackIT SSO
Cloud-native identity management
🤖
Layer 4
Model Endpoints
StackIT AI Services
Managed Gemma & Mistral models
📊
Layer 5
Data & Knowledge
StackIT Storage
Vector DB and document storage

Technical Implementation

🖥️

OpenWebUI: Customized for Transportation

ChatGPT-like interface tailored for mobility operations

Transdev Branding
  • • Corporate identity and color scheme
  • • Transportation-specific UI elements
  • • Multi-language support (German/English)
  • • Mobile-responsive for field operations
  • • Accessibility for all employee roles
Operational Features
  • • Quick access to route information
  • • Vehicle maintenance query shortcuts
  • • Safety protocol lookups
  • • Real-time operational context
  • • Conversation export for compliance

StackIT Managed Model Endpoints

Cloud-native AI services on German infrastructure

Why StackIT Instead of vLLM?

StackIT provides fully managed model endpoints for open-source models, eliminating the operational complexity of GPU management while ensuring data sovereignty and German regulatory compliance.

Managed Service
No GPU infrastructure management
Data Sovereignty
All data stays in Germany
Auto-Scaling
Cloud-native scaling
Supported Models
  • • Google Gemma (fine-tuned on Transdev data)
  • • Mistral (optimized for German language)
  • • Model versioning and A/B testing
  • • Custom fine-tuning on operational data
  • • Automatic model updates from StackIT
Integration
  • • OpenAI-compatible API endpoints
  • • LLM Gateway routes to StackIT services
  • • Built-in load balancing
  • • Automatic failover and health checks
  • • Usage-based billing integration

LLM Gateway: Intelligent Routing

Unified interface to StackIT model endpoints

Model Routing
  • Routes requests to StackIT endpoints
  • Automatic model selection
  • Load balancing across models
  • Fallback strategies
Cost & Usage Tracking
  • Per-department cost allocation
  • Usage quotas per employee
  • Budget alerts and limits
  • Detailed analytics dashboard
Performance Optimization
  • Response caching
  • Request queuing
  • Rate limiting
  • Priority routing for critical queries
Monitoring
  • Real-time latency tracking
  • Error rate monitoring
  • Model performance metrics
  • Usage pattern analysis

StackIT SSO Integration

Cloud-native identity and access management

Single Sign-On
  • Seamless integration with StackIT identity services
  • Federation with Transdev employee directory
  • OAuth2/OIDC protocol support
  • Multi-factor authentication (MFA)
  • Session management across services
Role-Based Access
Operations Manager: Full access to all data
Driver: Route and vehicle-specific information
Dispatcher: Real-time operational queries
Maintenance: Vehicle and maintenance procedures
Customer Service: Protocol and policy queries
Administrator: Platform configuration

DevOps & GitOps with Flux

Flux GitOps Workflow

Using Flux instead of ArgoCD for GitOps, fully integrated with StackIT's Git repository and container registry for automated infrastructure and application deployment.

  • Git-based declarative infrastructure
  • Automated sync from StackIT Git repositories
  • Helm chart management with Flux
  • Automated rollbacks on failure
  • Multi-environment deployments (dev/staging/prod)

StackIT CI/CD Pipeline

Leveraging StackIT's Git Actions for continuous integration and deployment, with automated testing and security scanning.

  • StackIT Git Actions for automated builds
  • Container registry on StackIT infrastructure
  • Automated security scanning
  • Blue-green deployment strategies
  • Compliance and license checking

Kubernetes on StackIT

  • Managed Kubernetes service (StackIT)
  • Helm charts for all microservices
  • Auto-scaling based on usage patterns
  • High availability across zones
  • Pod security policies

Monitoring & Observability

  • Prometheus for metrics collection
  • Grafana dashboards
  • Centralized logging with ELK
  • Distributed tracing
  • Real-time alerting

Complete Technology Stack

Frontend

OpenWebUIReactTailwindCSSTypeScript

Cloud Provider

StackITGerman InfrastructureManaged ServicesData Sovereignty

AI Models

Google GemmaMistralFine-Tuned ModelsStackIT Endpoints

LLM Gateway

LiteLLM ProxyCost TrackingModel RoutingAnalytics

Authentication

StackIT SSOOAuth2/OIDCMFARBAC

GitOps

FluxHelmStackIT GitAutomated Deployment

CI/CD

StackIT Git ActionsContainer RegistrySecurity ScanningBlue-Green

Orchestration

KubernetesStackIT ManagedAuto-ScalingHigh Availability

Monitoring

PrometheusGrafanaELK StackAlerting

Security

GDPRData SovereigntyGerman JurisdictionCompliance

Data Storage

StackIT StorageVector DatabaseDocument StorageBackups

Languages

PythonTypeScriptGoBash

Project Impact

80%
Faster Knowledge Access
Reduced search time for procedures
100%
Data Sovereignty
All data in German infrastructure
1000s
Employee Users
Across multiple cities

Transformed Transdev's operational efficiency by deploying an AI-powered knowledge platform on StackIT's German cloud infrastructure. Employees across multiple cities now have instant access to operational procedures, safety protocols, and maintenance guidelines through natural language queries to fine-tuned models—all while maintaining complete data sovereignty, GDPR compliance, and German regulatory requirements. The platform demonstrates that enterprise AI can be both powerful and sovereign when built on local cloud infrastructure.