Admin Console Integration
- Centralized Configuration: Manage all settings through a database-driven admin console
- Multi-Tenant Support: Deploy multiple instances with different configurations
- Real-Time Updates: Configuration changes apply without restarts
Vector Search Engine
- Local Embeddings: Uses sentence-transformers for local vector generation
- Hybrid Search: Combines local vectors with Azure Cognitive Search
- Persona-Specific Collections: Each AI persona can have specialized knowledge
Security & Compliance
- Azure AD Integration: Enterprise-grade authentication and authorization
- Document-Level Access Control: Fine-grained permissions using Azure AD groups
- Managed Identity: Secure service-to-service authentication
- Microsoft Defender: Integrated security scanning
Performance Optimization
- Multi-Stage Docker Builds: Optimized container images with build caching
- CDN Integration: Fast asset delivery through Azure CDN
- Auto-Scaling: Automatic scaling based on demand with Azure Container Apps
- Caching: Intelligent caching for embeddings and search results
Key Metrics
- Response Time: < 2s for chat responses, < 10s for document processing
- Throughput: Handles 1000+ concurrent users with auto-scaling
- Availability: 99.9% uptime with Azure Container Apps
- Token Usage: Built-in monitoring for Azure OpenAI consumption
Monitoring Integration
- Azure Monitor: Comprehensive logging and metrics
- Application Insights: Detailed telemetry and performance tracking
- Custom Dashboards: Real-time monitoring of chat activity and resource usage
Prerequisites
- Azure Subscription with appropriate permissions
- Docker 20.10+ installed
- Azure CLI installed and configured
- Git for cloning the repository
Latest posts
AI, and how to make sense of the UK Government’s Budget announcement, without resorting to reading it
News
KnowledgeFlow in the Housing Sector with Helen White, CEO Taff Housing Association
Webinars