Skip to main content

Extend the same project into operational practice

For: learners who already demonstrate software, ML evaluation and retrieval foundations. Additional proposed budget: 24 weeks Γ— 15 hours = 360 hours: 16 shared weeks (240 hours) plus one eight-week focus (120 hours). Allocate about 4 hours reading, 9 implementation/debugging and 2 review/communication weekly.

This is optional depth, not a prerequisite for A/B/C completion. Select it after capability review, or choose individual exercises with an explicit additional budget. It does not award professional experience.

Before you start​

Independently show a tested API, SQL joins/window functions, a containerized release, a clean ML split, a held-out retrieval experiment and one diagnosed CI/runtime failure. Repair missing foundations in A/C first.

Keep the same public/synthetic learning-support workbench. Add a mock external question API and human-reviewed draftβ€”not real integrations or writes. Use the existing stack; LangGraph and MCP illustrate state and protocol concepts, not a requirement to collect frameworks. Pin compatible versions and record them.

Shared practice, one assignment per week​

WeekSelected readingBuild and show
1uv projects and pytestA typed package, locked environment, tests and clean-clone commands.
2FastAPI concurrencyCompare blocking and nonblocking I/O; test timeout and cancellation without claiming CPU parallelism.
3FastAPI request validation and security overview; PostgreSQL transactionsAdd application-level access checks, synthetic identity-isolation tests and a failed migration/rollback exercise.
4MLOps orchestration: repeatable parameterized workMake repeated requests idempotent; cap worker/queue/retry use and test throttling.
5pgvector: search, filters and index tradeoffsRebuild a persistent index; compare lexical/vector search and test update/delete/access filtering.
6MLflow trackingVersion prompts/models/data and run baseline/candidate evaluation. Calibrate any model judge against human labels.
7LangGraph persistence: checkpointers vs storesResume after process restart with durable storage. Test session isolation, retention and deletion; in-memory examples alone do not show durability.
8MCP architecture: host/client/server and data layerConnect one local read-only tool. Pin protocol/SDK versions and test malformed and unauthorized calls.
9LangGraph interruptsPause a draft for external review; bind application approval to identity and payload. Deny changed/replayed approval. An interrupt is not authorization.
10Agent failure modesTrace a failed tool and budget exhaustion. Redact logs; explain latency and token/cost counting without double counting.
11MLOps monitoringPredeclare load/duration and cost/latency/error budgets; run a load experiment and simulate an outage.
12MLOps best practices: versioned infrastructure and deliveryRecreate one sandbox from reviewed configuration; if using IaC/cloud, review the plan and verify targeted teardown.
13Docker application tutorial: multi-container applicationRecreate API/data/worker processes locally; test restart behavior and readiness. No cluster is required.
14Python CI and MLOps best practicesMake CI block a critical seeded regression; rehearse rollback and record an incident timeline.
15Upstream Career Practice: feedback and ownershipIntegrate the mock API; recover a broken contract, explain alternatives and improve one issue from actual review feedback.
16Shared review rubric and capability guideHave someone reproduce one failure/result. Present a design walkthrough and short recovery brief; mark review unavailable if needed.

These are focused readings/labs, not completion of every course or documentation site. Some source examples use different frameworks/clouds; transfer the concept to your project, do not adopt all their infrastructure.

Choose one eight-week focus​

Each row covers two weeks: read/experiment first, implement/review second. Do not combine all focuses within the same 120 hours.

Stateful workflows​

WeeksSelected resourceAssignment
17–18LangGraph persistenceSeparate conversation checkpoints from long-lived data; test restart and isolation.
19–20MCP architectureAdd one tool contract; document compatibility and denied/malformed requests.
21–22LangGraph interrupts, failure modesTest lost state, stale approval, timeout and deletion. Keep permissions outside model output.
23–24Project evidence rubricCompare direct vs framework flow on the same tasks; show quality, latency, cost and recovery differences.

Data and model operations​

WeeksSelected resourceAssignment
17–18MLOps orchestrationBackfill a missing period; prove duplicate handling and dataset lineage.
19–20Experiment trackingCompare two versioned models with unchanged splits; explain promotion criteria.
21–22Deployment and monitoringAdd batch scoring, test feature consistency and simulate drift vs corrupted data.
23–24MLOps best practicesReproduce training-to-serving and rollback; show what the operational test does not establish.

Evaluation and design communication​

WeeksSelected resourceAssignment
17–18Retrieval Evaluation LabDiagnose per-query regressions hidden by an aggregate improvement.
19–20Cross-validation, answer rubricWrite a controlled offline experiment with untouched data, slice results and stop criteria.
21–22Upstream Career PracticeRun a peer design review and simulated incident; record actual feedback and an implemented improvement.
23–24Evidence recordPresent the same decision to technical and nontechnical audiences; distinguish measured results from assumptions.

Exit assessment​

Use demonstrated / needs practice / not assessed / outside current scope for API/data contracts, state/tools, evaluation, load budgets, recovery and communication. Attach run commands and actual test results. A reviewer should recreate the sandbox and one failed/recovered operation.

An offline experiment is not live A/B testing; a local container is not production operations; a practice discussion does not certify a language level. Keep customer information private and obtain authorization before sharing professional artifacts or operating outside the synthetic lab.

Next: focused resources and verification limits.