Fast Agents, Forgotten Rules and a Bill Twice the Budget

Picture a client project where the AI agent writes code faster than anyone on the team, yet keeps forgetting the rule the client set last week. At month end, the model bill is double the budget. Neither problem is about how smart the model is. That gap explains much of the AI infrastructure funding announced in mid-October, led by Modal’s $750 million Series D.

The money in that week went less to new models and more to the layers around them: inference compute to run AI, data to train and test it, context so agents know what they are doing, and tools to keep the bill under control. This piece explains each layer, why investors are paying for it, and what it changes for a small consultancy like ours that uses AI on most projects.

What Did AI Infrastructure Startups Raise in Mid-October?

Counts depend on who is counting. The newsletter Cutoff Report logged 31 startup rounds on 15 October worth about $2 billion, including non-AI deals and without converting foreign currencies. Where the Money Moved counted 17 companies and about $1.03 billion in announcements dated 12 to 14 October, leaving Labelbox out because its round mixes equity and credit. Different windows, different rules: neither total is wrong, and neither should be quoted as the size of a day.

Four rounds from that week show where the money is going.

Four rounds, four layers

Amounts and descriptions as each company announced them.

CompanyRoundLayer
Modal$750M Series D, $15.75B valuationRunning AI: serverless GPU compute
LabelboxOver $100M Series E, equity and creditData: training and evaluation data
Scuba$34M pre-seed and seed combinedContext: team knowledge for agents
North$60M Series BCost: FinOps for cloud and AI spend

What Is an AI Inference Cloud, and Why Is Modal Growing So Fast?

Training teaches a model; inference is every time the model is used, to answer a question, write code or draw a picture. Once AI is inside real products, inference runs on every request. Deloitte forecast that inference would make up roughly two-thirds of all AI compute in 2026, up from a third in 2023, in its TMT Predictions. That is a share of compute rather than spending, but it shows where the work is moving.

Modal sells serverless GPUs: you write the code, it runs it on graphics processors in the cloud, and you pay for the seconds used rather than renting machines that sit idle. The company says it runs image generation, large-model inference and training jobs, plus sandboxes where AI agents execute code, and names customers such as Suno. In its announcement it says it has passed $1 billion in annualized run rate, growing more than 15 times in a year. Run rate takes recent revenue and projects it over twelve months; it is not a year of booked revenue. The valuation went from $4.65 billion at the Series C in May to $15.75 billion five months later.

Hands sorting printed product photos into trays, like data being labelled for AI training.

Why Is Data Labelling Still Raising Money?

Data labelling means people, often helped by software, tagging, rating and correcting data so models can learn from it and be tested against it. Stronger models have not made that work disappear. Labelbox’s own pitch reflects the shift, from drawing boxes on photos to judging agent reasoning. Labelbox, which raised more than $100 million in a Series E of equity and credit, says its new money goes to reinforcement-learning data for frontier labs and to enterprise agents, and that it “reached profitability this year” while growing more than five times year over year, according to its Series E post. If that self-reported profitability holds, labs are still paying for human-reviewed data.

What Is Context for AI Agents, and Who Owns It?

Context is everything an agent needs to know that is not in the model: the project documents, past decisions, the client’s terminology, what the team already tried. Scuba, launched with $34 million across its pre-seed and seed, builds a “shared context engine” that gathers a team’s knowledge and hands it to Claude, ChatGPT, Cursor and Slack. Its co-founder Noah Desai Weiss put the bet plainly to SiliconANGLE: “The frontier models aren’t intelligence bound. They’re context constrained.”

Open project binder full of tabbed dividers and sticky notes, like the shared context AI agents need.

The open question is who ends up owning this layer. Model providers are adding their own memory and project features, and a startup in limited beta is competing with companies that control the model. Our read is that context tied to how a specific team works is harder for a model vendor to absorb than general memory. That is our guess; nothing in these rounds tests it yet.

Why Do AI Bills Need Their Own Management?

Teams have had a decade to learn how cloud bills behave. AI usage is newer and swings faster: one feature launch or one agent stuck in a loop can multiply usage overnight. FinOps, the practice of managing cloud spending as a shared financial responsibility, is stretching to cover it, a practice now called AI FinOps. The FinOps Foundation’s State of FinOps 2026 found 98% of respondents now manage AI spend, up from 31% in 2024.

North, which raised a $60 million Series B, calls itself “the financial operating system for cloud, AI and data” and connects directly to OpenAI, Anthropic and Snowflake alongside the three big clouds, according to its release. The company says it manages nearly $2 billion in cloud spend and has saved customers more than $400 million. Two smaller rounds announced that week point the same way, though both closed months earlier, as Fortune reported: Fragment’s $12 million Series A for billing and accounting at vertical AI companies, and Causa Prima’s $20 million seed for agents that handle billing disputes.

Analog utility meter with a spinning disc beside bundled cables, like metered AI usage.

Where AI Infrastructure Money Is Going, and the Caveats

Put together, these rounds describe AI moving from experiment to operations. The model is one part; running it reliably, feeding it the right data, giving it the right background and paying for it sensibly are the rest, and those are now attracting serious capital. We noted a similar shift toward the plumbing in our look at early-October AI funding rounds.

Two cautions. Valuations are rising faster than anyone can verify: Modal’s more than tripled in five months, on figures the company reports itself, and neither Modal’s nor Labelbox’s round had been reported by Reuters, Bloomberg or TechCrunch when we checked. And daily funding tallies vary with method, so a headline like “31 rounds, $2 billion in a day” says as much about the counter as the market.

What It Means for a Consultancy That Runs on AI

Pine & Birch is a small technology consultancy in Newmarket, Ontario. We use AI on most client projects, work with outsourced delivery teams and build our own apps. Each of the four layers above maps to something we can change now.

  • Treat context as a deliverable. For each client project, keep one structured file of rules, decisions and terminology that both AI agents and the delivery team read. It is usually the cheapest fix for the agent that forgets last week’s decision.
  • Pay for inference by use until usage is steady. For a client feature with uncertain traffic, per-token model APIs or a pay-per-second GPU platform usually cost less than reserved GPUs that sit idle, at the price of start-up delays and a higher unit rate; revisit once the load is predictable.
  • Give every project an AI budget. Tag usage by client and feature, review the bill monthly, and when usage is a real cost driver, show it as its own line in the quote. A rough per-token estimate, for example from the LLM API cost calculator on FreeToolsForWeb (a free tools site our team runs), is enough to size that line before the project starts.
  • Ask outsourced teams to report AI usage. List the tools used, rough usage, and whether the shared context file was followed. That makes duplicated prompts and cost visible.
  • Price our own apps with inference in the numbers. Record the model cost of each feature from the first release, and check that the price covers it. When a feature needs labelled data, start with a small evaluation set built in-house before paying for a large labelling job.

If you are planning how agents, context and AI costs fit into your own projects, that is the work we do in AI agent development.

Questions Worth Following

  • Can revenue catch up with valuations that tripled in months, once these companies disclose audited revenue, for example in an IPO filing?
  • As GPU and model prices fall, does a pay-per-use compute platform keep its margin, or does cheaper inference squeeze it?
  • Will the context layer stay independent, or will model providers build it into their own products?

When AI gets cheaper and more plentiful at the same time, what should a team manage most carefully: the model, the data, the context, or the bill?

FAQ: Modal Series D and AI Infrastructure Funding

What did Modal raise in its Series D?

Modal announced a $750 million Series D on 14 October 2026, led by Accel at a $15.75 billion post-money valuation, with Kleiner Perkins joining and existing investors including Menlo, General Catalyst, Redpoint, Lux, Amplify and Bain Capital Ventures. The company says it has passed $1 billion in annualized run rate, growing more than 15 times year over year. Five months earlier its Series C valued it at $4.65 billion.

What is the difference between AI training and inference?

Training is teaching a model, done up front on very large amounts of data and repeated when the model is updated. Inference is using the trained model, every time it answers a question, writes code or generates an image. As AI moves into everyday products, inference becomes the larger workload: Deloitte forecast that inference would be roughly two-thirds of all AI compute in 2026, up from about a third in 2023.

What is a serverless GPU platform?

A serverless GPU platform runs your code on graphics processors in the cloud without you renting or managing the servers. You write the function, the platform starts machines when requests arrive and shuts them down afterwards, and you pay for the time actually used. Modal is one example of this kind of AI infrastructure; it is used for model inference, image generation, training jobs and sandboxes for AI agents.

What is AI FinOps?

FinOps is the practice of managing cloud spending: seeing where money goes, who is responsible for it and how to reduce it. AI FinOps applies the same discipline to model usage and GPU bills, which can change quickly with traffic. The FinOps Foundation’s State of FinOps 2026 found 98% of respondents now manage AI spend, up from 31% in 2024.

What is context for AI agents?

Context is the background an AI agent needs to do work properly: project documents, past decisions, client rules, terminology and team habits. Without it, a capable model makes avoidable mistakes. Tools such as Scuba organise a team’s knowledge so agents can read it, on the view that models today are limited less by intelligence than by what they know about the situation.