Jan 2024 · 2 min read
By Jonathan Lwowski
A Practical Guide to Starting Machine Learning Work
A product-minded sequence for moving from a meaningful problem to a responsible machine learning investment.
Machine Learning · Product Strategy · Leadership
Machine learning work is easier to start than to finish well. The hard part is rarely opening a notebook or choosing a model. It is building enough shared understanding that the team knows what problem it is solving, what evidence matters, and what a useful result looks like.
This is an original companion to the AI & PM Insights guide to building machine learning models. It collects the questions I would want a product, engineering, and operations team to answer before committing serious time and budget.
Treat the model as one part of a decision
A model is useful only when it improves a real decision or workflow. Start by naming the person affected, the action they need to take, and the cost of getting it wrong. Then work backward through the data, evaluation, integration, and operating model required to make that improvement dependable.
This sequence avoids a common trap. A team can prove that a model learns patterns without proving that anyone can use its output.
Work through the evidence in order
I use five checkpoints to keep early work grounded.
- Problem Is the customer problem specific, consequential, and worth changing?
- Data Do representative examples exist, and can the team use them responsibly?
- Evaluation Will the success measure reflect the real decision rather than a convenient proxy?
- Delivery Can the capability fit into a product workflow with a clear owner?
- Investment Does the evidence support moving forward, narrowing the scope, or stopping?
The order matters because each answer shapes the next question. It also makes uncertainty visible early, when it is cheaper to learn.
Keep the first commitment small
The best early milestone is usually not a full platform or production rollout. It is a bounded test of the assumption most likely to change the plan. That might be a data audit, a labeling trial, a prototype integrated into one workflow, or an evaluation with domain experts.
Good ML strategy is less about predicting every step and more about creating a disciplined way to learn what the next step should be.