OperationsJune 2026 2 min read

Deployment and Operations: From Lab to Production

How we deployed the URA Chatbot to production infrastructure and established operational best practices for maintainability.

DeploymentDevOpsOperations

Deployment and Operations: From Lab to Production

Deployment Infrastructure

The URA Chatbot is deployed on Makerere University's Crane Cloud, a robust cloud infrastructure designed for academic and public sector projects.

Architecture

┌─────────────────┐
│  Load Balancer  │
└────────┬────────┘
         │
    ┌────┴────┐
    │          │
┌───▼──┐   ┌──▼───┐
│ API  │   │ API  │
│Pod 1 │   │Pod 2 │
└───┬──┘   └──┬───┘
    │         │
    └────┬────┘
         │
    ┌────▼────────┐
    │  Database   │
    │  & Cache    │
    └─────────────┘

Containerization

  • Docker: Each component containerized for consistency
  • Kubernetes: Orchestration across multiple machines
  • Auto-scaling: Automatically scales based on demand
  • Health Checks: Continuous monitoring of component health

Deployment Process

Stages

1. Development: Local testing and validation
2. Staging: Full replica of production for final testing
3. Canary Deployment: Roll out to 5% of traffic first
4. Production: Full deployment after validation
5. Monitoring: Continuous observation for issues

Rollback Strategy

  • Automated rollback on performance degradation
  • Version control enables quick reversion
  • Zero-downtime deployments

Operations and Maintenance

Monitoring

Metrics Tracked:
- Response time and latency
- Error rates and error types
- Resource utilization (CPU, memory)
- Number of concurrent users
- Answer quality scores
- Security incidents

Alerting:
- Automatic alerts for anomalies
- On-call rotation for critical issues
- Escalation procedures defined

Log Management

  • Centralized logging for all components
  • 30-day retention of detailed logs
  • Searchable logging for debugging
  • PII redacted from all logs

Updates and Patches

  • Security patches applied within 24 hours
  • Feature updates deployed during maintenance windows
  • Automatic testing before production deployment

Performance Targets

MetricTargetActual
Response Time<2s1.2s avg
Availability99.9%99.95%
Error Rate<0.1%0.02%
Max Concurrent Users1000Tested to 2000

Cost Optimization

  • Right-sizing: Containers sized appropriately for their workload
  • Auto-scaling: Reduces costs during low-traffic periods
  • Caching: Minimizes database queries and API calls
  • CDN Integration: Serves static assets efficiently

Documentation

  • Runbooks: Step-by-step guides for common operations
  • Architecture Diagrams: Visual representations of system components
  • API Documentation: Complete OpenAPI/Swagger documentation
  • Troubleshooting Guide: Solutions to common issues

Disaster Recovery

  • Backups: Automated daily backups with encrypted storage
  • Recovery Time Objective (RTO): <1 hour
  • Recovery Point Objective (RPO): <15 minutes
  • Disaster Recovery Testing: Quarterly DR drills

The deployment infrastructure is designed to be reliable, scalable, and maintainable, ensuring the URA Chatbot continues serving taxpayers effectively.