Skip to main content

Week 1: RAI Foundations for Architects

Week Overview

Objective: Build the mental model for RAI as an architectural discipline β€” not a compliance checkbox applied at the end.
Time Estimate: 8–10 hours
Deliverable: RAI Architecture Lens β€” a 1-page reference card mapping each RAI principle to design-time questions


The Core Shift​

Traditional software architecture asks: What should this system do, and how fast?

RAI-aware architecture adds: Who could this system harm, how, and what design decision prevents that?


Framework 1: Microsoft RAI Standard v2 β€” The 6 Principles as Design Constraints​

PrincipleWhat It EliminatesDesign-Time Question
FairnessSystems that produce disparate outcomes across demographic groupsWhat populations does this system serve? How is disparate impact measured?
Reliability & SafetySystems that fail unpredictably or cause harm when they failWhat happens when the model returns a wrong answer? Is there a fallback?
Privacy & SecuritySystems that expose personal data beyond its intended useWhat data does this system access? What is the minimum necessary scope?
InclusivenessSystems that exclude users or produce lower quality for edge groupsWhich user populations are underrepresented in training data?
TransparencySystems where users cannot understand what is AI-generatedIs it clear to users when they are interacting with AI?
AccountabilitySystems where no human owns the outcome of an AI decisionWho reviews high-stakes outputs? Who owns the audit trail?

Framework 2: NIST AI RMF 1.0 β€” Govern, Map, Measure, Manage​

GOVERN β†’ Establish policies, roles, culture
↓
MAP β†’ Identify context, stakeholders, and risks for a specific AI system
↓ ← YOU DESIGN FOR THIS
MEASURE β†’ Analyze and assess identified risks (metrics, evaluations, red teaming)
↓ ← AND THIS
MANAGE β†’ Prioritize, respond, and monitor risks continuously

What "designing for MEASURE" means:

  • Build in evaluation hooks β€” the system must be independently testable
  • Choose architectures where component outputs are observable
  • Design for A/B testing of safety mitigations

What "designing for MANAGE" means:

  • Every AI component needs a monitoring owner in the architecture diagram
  • Alerting thresholds must be defined at design time, not after launch
  • Audit logs must be in the architecture β€” incident response requires them

Framework 3: EU AI Act Risk Tiers β€” Architecture Decisions Change by Tier​

UNACCEPTABLE RISK β€” BANNED (Feb 2025)
β”œβ”€ Social scoring | Real-time biometric surveillance | Subliminal manipulation
β”‚ β†’ Architecture decision: Do not build.

HIGH RISK β€” Strict obligations (Aug 2026 deadline for deployed systems)
β”œβ”€ HR/hiring | Credit scoring | Medical devices | Critical infrastructure
β”‚ β†’ Required: human oversight mechanism, audit logging, accuracy testing,
β”‚ data governance documentation, EU AI database registration

LIMITED RISK β€” Transparency only
β”œβ”€ Chatbots | Deepfakes
β”‚ β†’ Required: AI disclosure to users

MINIMAL RISK β€” No obligations
└─ Spam filters | Recommendation engines
β†’ Best practice: document anyway for future re-classification

This Week's Resources​

ResourceTypeEstimated Time
Microsoft RAI PrinciplesReading1 hour
NIST AI RMF 1.0 β€” Govern + Map sectionsReading2 hours
Azure Well-Architected Framework β€” AI WorkloadsReading1.5 hours
Microsoft Learn: Responsible AI principles in practiceCourse2 hours
OWASP LLM Top 10Reference scan1 hour

Hands-On Exercise​

Exercise β€” Gap Analysis Against NIST AI RMF

Take an AI system you have previously designed or reviewed. Map it against the four NIST AI RMF functions:

  1. Govern: Is there a documented policy for this system? Who owns it?
  2. Map: Are all stakeholders identified β€” including adversarial actors and autonomous agents?
  3. Measure: Can the system's fairness, safety, and accuracy be measured independently? Are evaluation hooks built in?
  4. Manage: Are alerting thresholds defined? Is there an incident response plan?

For each function, score: Strong / Partial / Missing. Write a 1-paragraph explanation for any Missing score.


Week 1 Deliverable: RAI Architecture Lens​

Build a 1-page reference card you will use for every architecture review going forward:

RAI PrincipleDesign-Time QuestionArchitecture Smell (what absence looks like)
FairnessWhat populations does this serve? How is disparate impact measured?No evaluation dataset; no bias testing
Reliability & SafetyWhat happens when the model is wrong? Is there a fallback?No fallback; no monitoring owner
Privacy & SecurityWhat is the minimum data scope? Is consent modeled?Overly broad data access; no consent flow
InclusivenessWho is underrepresented? How is accessibility handled?No accessibility review; monoculture test data
TransparencyIs AI disclosed to users? Can decisions be explained?No AI disclosure; no explainability hook
AccountabilityWho owns each AI decision? What is the escalation path?No human review gate; no audit log

Knowledge Check​

  1. What is the difference between RAI as a compliance checklist and RAI as an architectural constraint?
  2. Which NIST AI RMF function is most directly influenced by architecture decisions β€” and why?
  3. Under the EU AI Act, what architecture components are legally required for a High-Risk AI system?
  4. An architect says: "We'll add the safety filters after the MVP ships." Which RAI principle is most at risk?