In this article, you will learn how to combine a classical machine learning pipeline with an agentic AI system to build a hybrid, autonomous customer retention workflow.
Topics we will cover include:
How to generate a synthetic dataset and train a random forest classifier for customer churn prediction using scikit-learn.
How to design an agentic AI system — complete with tools and an LLM-powered reasoning core — that interprets machine learning predictions and acts on them autonomously.
How to wire the machine learning pipeline and the agent together into a single, end-to-end runnable Python application.
Introduction
Agentic AI and machine learning pipelines are far from incompatible when it comes to building production-ready AI applications. In fact, embracing them as two sides of the same coin has become more than a mere trend: it constitutes a modern foundational architecture pattern that drives the shift from passive predictive analytics to autonomous decision-making and action.
Traditional machine learning pipelines excel at pattern recognition tasks of varying complexity, but they are purely reactive in their base form. Meanwhile, agentic AI systems are all about proactivity: combined with predictive machine learning models, they can build on the insights yielded by such models to plan, use tools, and address real-world use cases with little or no human guidance.
In this hands-on article, we will show you how to bridge the gap between reactive machine learning models and proactive AI agents. We will construct a lightweight, free, runnable Python pipeline that:
Predicts customer churn based on a classical machine learning model built with scikit-learn.
Hands the obtained predictions over to an agent endowed with a state-of-the-art LLM to autonomously reason and execute different customer retention strategies.
Prerequisites
The entire coding tutorial can be run for free in Google Colab or a local Jupyter notebook, provided you have the necessary libraries installed and imported.
If you are using Colab, at the time of writing, the only library you might need to manually install is Groq:
1
!pip install groq
Make sure you also import the following:
1
2
3
4
import numpy asnp
from sklearn.ensemble import RandomForestClassifier
from sklearn.model_selection import train_test_split
from groq import Groq
Since Groq — one of today’s most capable open-source LLM providers — requires an API key, be sure to register on their website and create your own API key here. You will need to incorporate it in your notebook or Google Colab account. The code below is designed to read the API key from the “Secrets” section found on the left-hand sidebar in Google Colab: create a new secret variable there called GROQ_API_KEY, and paste your actual Groq API key into the “value” field.
These instructions will help you inject the newly added API key into your program:
1
2
3
4
5
import os
from google.colab import userdata
# Injecting the Colab secret into standard environment variables
Once the prerequisites are set up, we will start building the classical machine learning pipeline — for customer churn prediction — that will later be extended by incorporating agentic AI principles and tools.
First, we need a customers dataset to feed to our machine learning model. For this example, we will synthetically generate our own dataset containing 500 customers, each described by two predictor features plus a target variable indicating whether the customer is prone to churn. The two input features are the monthly customer spend and the number of support tickets issued by the customer: both are real-world predictors of a customer’s willingness to stay with or abandon a brand. Notice that the code uses numpy functions to introduce random noise, making the artificially generated data look realistic:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
# ==========================================
# 0. SYNTHETIC DATASET GENERATION
# ==========================================
# Generating a realistic dataset of 500 customers described by two input features
np.random.seed(42)
n_samples=500
# Feature 1: Monthly customer's spend (uniformly distributed between $10 and $150)
spend=np.random.uniform(10,150,n_samples)
# Feature 2: Support tickets issued by customer (Poisson distribution, averaging 1.5 tickets)
tickets=np.random.poisson(lam=1.5,size=n_samples)
# Generate target variable / Binary class (Churn):
# Churn risk increases with more tickets and decreases with higher spend
Next, we build a simple, classical machine learning pipeline by splitting the dataset into training and test sets and training a random forest ensemble classifier. We verify the model’s performance on the test set before continuing:
1
2
3
4
5
6
7
8
9
10
11
12
# ==========================================
# 1. CLASSIC ML PIPELINE (Predictive -> Classification)
print(f"Model Accuracy on Test Set: {ml_model.score(X_test, y_test)*100:.1f}%\n")
Prediction results on the test data:
1
2
Training ML Model on400records...
Model Accuracy on Test Set:91.0%
A 91% accuracy is good enough for our purposes, so we will proceed to incorporating our agent into the loop.
The first aspect we will create for our agent is its “hands” — in other words, the tools the agent can use to perform specific actions as a result of its reasoning and decision-making. While in real-world settings these tools typically interact with external components, services, and databases via API calls or similar protocols, we mock two customer-oriented actions here using simple printed messages:
1
2
3
4
5
6
7
8
9
10
# ==========================================
# 2. THE TOOLS (Agentic "Hands")
# ==========================================
# These are two functions the agent will be allowed to trigger in the real world.
# Actions are mocked and emulated by using parameterized print messages
def send_discount(customer_id):
returnf"[Action Executed] Sent a 20% discount code to Customer {customer_id}."
def schedule_support_call(customer_id):
returnf"[Action Executed] Escalated Customer {customer_id} to a human agent for a check-in."
While having the agent call its accessible tools is how it exerts impact once deployed, it is the cognition core — responsible for the agent’s reasoning and execution — where the actual “intelligence” takes place:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
# ==========================================
# 3. THE AGENT'S COGNITION (Reasoning & Execution)
# ==========================================
classRetentionAgent:
def __init__(self):
print("Connecting to Groq API (Llama 3.3 70B)...\n")
# Automatically picks up the GROQ_API_KEY environment variable
# Step B: Autonomous Guardrail - only act if the risk is high
ifchurn_prob<0.5:
return"Agent Decision: No action needed. Customer is low risk.\n"
# Step C: Agentic Reasoning (Context Injection)
# A 70B model from Groq handles this logic effortlessly, including the simple math reasoning needed in this use case.
prompt=(
f"Customer {customer_id} has a {churn_prob*100:.0f}% risk of churning. "
f"They currently spend ${spend_val:.2f} per month and have filed {int(tickets_val)} support tickets. "
f"Business Rule: If a customer has filed more than 2 support tickets, they are frustrated and need a human 'call'. "
f"Otherwise, they are just price-sensitive and we should send a 'discount'."
)
# The LLM "thinks" and decides on the tool
decision=self._reason(prompt)
print(f"Agent Reasoning output: '{decision}'")
# Step D: Tool Execution (Routing to a specific agent's "hand")
if"call"indecision:
result=schedule_support_call(customer_id)
elif"discount"indecision:
result=send_discount(customer_id)
else:
result=f"[Action Failed] Agent returned an unrecognized tool name: {decision}"
returnresult+"\n"
Let’s briefly break down the code above:
Using object-oriented programming, we created a specialized agent for our target domain called RetentionAgent. Importantly, this agent is connected to an LLM that acts as its inner cognition engine. We specifically chose a Llama 3.3 model served by Groq, which is lightweight enough to run feasibly in a notebook but powerful enough to reliably perform the intended reasoning task.
The agent’s _reason() method prepares the prompt for the LLM and configures model settings appropriate to our scenario, such as setting temperature to zero for deterministic output.
The agent’s process_customer() method bridges the gap with the machine learning model built earlier. It fetches customer churn predictions and constructs a prompt that injects the prediction alongside other customer data, asking the LLM what action to take. The core decision logic that triggers agent action is handled here.
Once all the building blocks are in place, it’s time to run our hybrid ML-agentic pipeline. We instantiate the agent and test it on three example customers. Pay close attention to the profiles of these three customers and cross-reference them with the LLM prompt defined inside the agent’s reasoning method:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
# ==========================================
# 4. RUN THE PIPELINE
# ==========================================
agent=RetentionAgent()
# Testing the pipeline on a few specific profiles to see the routing in action
# Test Case 1: Moderate spend, low tickets -> Model might predict low/moderate risk.
The results align with what one would expect. That said, be aware that the model choice matters: we selected an LLM that is well-suited to this task and set its temperature to zero to prevent non-deterministic behavior, which is undesirable in this context. If you choose a different model, your results may vary.
Closing Remarks
In this article, we built a hybrid pipeline step by step that combines classical machine learning for customer churn prediction with an agentic AI solution capable of turning those predictions into an autonomous reasoning, decision-making, and action workflow. This demonstrates how to bridge the gap between two key pillars of modern AI solutions in corporate and organizational environments.
No comments yet.