Topic 33

From Model to Product

Concept

The churn model wins its tournament, clears the sealed final exam, and… nothing happens. Not one customer notices. Not one win-back email goes out. The winner is — remember Topic 04 — a file: learned numbers plus a recipe, sitting on a data scientist's laptop, changing exactly nothing about the world.

For customers to feel it, the model must become something the product can actually ask — a program that is always on, always reachable, always answering. Crossing that gap has a name: deployment. It is where the data team's work meets ordinary software engineering, and it is the half of every ML project that beginners never hear about.

Where the churn model lives after deployment — one service, two rhythms
Plateful production
Model servicethe model fileanswering wrapper
Real time — ask now"customer 4711?""churn risk 0.71"
Batch — nightly at 2 a.m.score all customerstomorrow's churn listwin-back emails

The Model Becomes a Service

The move itself is almost anticlimactic. The model file is copied to a server, and a small program is wrapped around it — a program whose whole job is to answer questions. Ask it "customer 4711?" and it runs the model and replies "churn risk 0.71". The asking and answering happen over an API — an agreed-upon way for one program to ask another program a question and get an answer back. That one sentence is all the plumbing this book needs; the point is what it buys. The model is no longer a file someone has to open — it is a service: always on, reachable by any part of Plateful's software, answering thousands of questions an hour without a human in the loop.

Notice what did not change: the model itself. Same numbers, same recipe, exactly as it left the tournament. Deployment moves the model into position; it does not make it smarter. Everything the model will ever know, it learned before this page began.

Two Serving Rhythms

There are two rhythms a deployed model can serve in, and the choice between them was made back in Topic 30 — the team just didn't know it yet. Real-time serving answers the moment it is asked: a payment-fraud model must score the transaction while the customer waits at checkout, in a fraction of a second, or it is useless. Batch serving answers on a schedule: run the model over everyone, all at once, and store the results for later use.

Which rhythm does churn need? Look at the action on the framing card: win-back emails, sent by the marketing team in the morning. Nobody is standing at a checkout waiting for a churn score. So the churn model runs as a batch job — every night at 2 a.m. it scores every active customer, and by morning there is a fresh list of who is at risk this week. The action dictates the rhythm, not fashion: a team that builds real-time serving for a nightly email list has bought a sports car to deliver newspapers.

Production Has Opinions

Here an analogy earns a page of its own. Winning the tournament is like winning a cooking competition with a prize recipe — the hard science is done. But now the dish goes on the menu, and it must be cooked four hundred times a night, fast, identically, by equipment that does not fall over during the Friday rush. Same recipe, entirely new discipline. That new discipline is what the word production means: software serving real users, at real volume, with real consequences when it stumbles.

Production's demands are concrete. Speed: a fraud check that takes ten seconds is a failed fraud check, however accurate. Load: Friday dinner rush multiplies requests, and the service must not buckle. And safe rollouts: a new model is not switched on for everyone at once — it first serves a small share of traffic, say 5%, while the team watches for trouble, and only then takes over (engineers borrow a mining term for this pattern and call it a canary release). None of this is modeling work, which is why a distinct role exists for people who carry models into production — Chapter 11 will name it when we map the field's jobs.

The Bridge to the Rest of the Catalog

One honest orientation note, because this is where the course touches the wider world of software. The churn service runs on the same rails as every other service: it lives on cloud servers — the rented, always-on computers that the Cloud from Zero course explains from scratch. It ships inside containers — a standard way to package a program so it runs the same everywhere, taught properly in the Docker course. And it reaches those servers through automated build-test-deploy pipelines — the craft of the DevOps course.

The point of naming them is what it tells you about ML: a deployed model is ordinary software with an extraordinary component inside. ML inherits the software world's infrastructure; it does not replace it with something exotic. When you are ready for that world, those courses are the path — this book's job was only to show you where the bridge is.

Common Confusions
  • "Training the model is the finish line." A trained model serving nobody changes nothing — it is cost with no effect. Deployment is where value starts; "the model is done" and "the feature is live" can be months apart.
  • "The model runs inside the app on my phone." Usually the app asks a service where the model lives, and shows you the answer. On-device models do exist — face unlock runs on the phone itself — but the service pattern dominates, especially for models like churn.
  • "Deployment is a five-minute upload." Making a model fast enough, sturdy under load, and safe to roll out is real engineering with its own specialists. The upload is the smallest part of it.
Why It Matters
  • This explains the second half of every data team's org chart — and why the gap between "the model works" and "customers feel it" is measured in engineering, not in more tuning.
  • It connects this course to the rest of the catalog honestly: cloud, containers, and pipelines are where a model actually lives, and now you know which course teaches which rail.

Knowledge Check

The churn model has won the tournament and passed the sealed exam. Why has nothing changed for Plateful's customers yet?

  • The model still needs more rounds of evaluation first
  • It's still just a file — no running service the product can ask
  • Customers haven't opted in to being scored by the churn model yet
  • The model needs additional training on live production data first

Why does the churn model run as a nightly batch job rather than answering in real time?

  • Churn models are too slow to answer individual requests one at a time
  • The team couldn't afford the infrastructure real-time serving requires
  • The action is a morning email list — nobody needs an instant answer
  • All ML models run on nightly schedules by convention

Which of these is a production concern — something the tournament never tested, but deployment must handle?

  • Whether the model scores well on the held-out data from the tournament
  • Whether any of the features leak the answer into the question at training time
  • Whether the model beats the dumb baseline the team agreed on in framing
  • Whether the service stays fast and standing during the Friday dinner rush

The churn service runs on cloud servers, ships in containers, and deploys through automated pipelines. What does this tell you about ML in production?

  • ML inherits ordinary software infrastructure rather than replacing it
  • ML requires special infrastructure that ordinary software teams can't use
  • This course has now taught you cloud, Docker, and DevOps
  • Data scientists personally manage the servers their models run on

You got correct