Modal

Erik Bernhardsson graduated with an M.Sc. in Physics from KTH Royal Institute of Technology in Stockholm. He spent approximately six to seven years at Spotify, first managing the Analytics team in Stockholm and later building and leading the machine learning team in New York, where he created the initial versions of key music recommendation features such as Related Artists, Radio, and Discover Weekly, and open-sourced tools including Luigi (a workflow engine) and Annoy (an approximate nearest neighbors library). He then served as CTO of Better.com from 2015 to 2021, scaling the engineering organization from a handful of people to around 300. He is a competitive programming standout with a gold medal from the International Olympiad in Informatics (IOI) and two appearances in the ACM-ICPC world finals, and he completed a six-month internship at Google in Zürich among other early experiences.

Modal+4

Akshat Bubna studied computer science and mathematics at the Massachusetts Institute of Technology. He was the first competitor from India to win a gold medal at the International Olympiad in Informatics (IOI) in 2014, following a bronze medal in 2013. Prior to Modal, he was an early employee and staff software engineer at Scale AI, where he designed and built core engineering and operations systems and led the Natural Language and Quality teams. He previously worked at D.E. Shaw as well as database and fintech startups.

Modal+5

Justin Dignelli co-founded and served as CEO of Pace, a company focused on operationalizing hybrid go-to-market strategies. Prior to that, he spent six years at MongoDB, rising from an inside sales leader to Director of Cloud GTM (and later Senior Director roles), where he helped scale the company's go-to-market organization from roughly $20 million in revenue to over $1 billion as it went public, including building sales motions, playbooks, and productivity tools for MongoDB Atlas. He earlier led enterprise sales teams at Smartling and holds a BBA in Finance from The George Washington University School of Business; before his sales career, he was a pitcher drafted by the Los Angeles Dodgers in the 2009 MLB draft.

Modal+3

Modal Sandboxes provide isolated, ephemeral, secure container environments for executing untrusted or LLM-generated code, supporting AI agents, coding platforms, reinforcement learning rollouts, and background agents at production scale. They use gVisor-based isolation with sub-second scheduling, support custom images and dependencies defined dynamically in Python, attach GPUs (including H100s and A100s) or CPUs on demand, integrate distributed storage via Volumes for persistence across runs, and offer networking features like tunnels and secrets. Sandboxes scale to 100k+ concurrent environments with creation throughput tested to 1,000 per second, and support snapshotting for fast forking and state management. Over 1 billion sandboxes have been launched on the platform; they drive more than a third of Modal's revenue. Notable traction includes powering every Lovable app generation session after handling over 1 million sandboxes (peaking at 20,000 concurrent) during a 48-hour promotional event that created an estimated 250,000 applications, Quora's Poe interactive coding features, Ramp's Inspect background coding agent (authoring 70% of merged PRs), Cognition's RL and inference workloads with millions of sandboxes, and Applied Compute's RL environments. The product has been generally available since early 2025 and is a core primitive for agentic systems requiring safe, elastic execution environments.

Modal+6

Modal Inference enables developers to deploy, serve, and scale any open-source or custom AI models (LLMs, multi-modal generation for image/video/audio, embeddings) with low-latency online serving, dynamic batching, and offline batch processing on elastic multi-cloud GPU capacity. It uses a code-first Python SDK for full control over models and serving stacks (including vLLM, SGLang, and custom engines), with sub-10ms overhead latency via globally distributed compute, support for token streaming/WebRTC/WebSocket, automatic scaling from 0 to 1,000+ GPUs, memory snapshotting for fast cold starts, and integrated observability. Recently launched Modal Auto Endpoints provide one-command or dashboard deployment of optimized OpenAI-compatible endpoints for frontier open models (e.g., GLM 5.2, Qwen, Gemma variants) with SOTA open-source performance, full code visibility/ownership, speculative decoding, and engine-level metrics—without black-box managed services. Customers use it for production real-time multi-node inference (e.g., Runway Characters with 65% latency reduction), edge robot control at 10–15 ms latency (Physical Intelligence), voice AI (Decagon achieving p90 of 342 ms and 60 ms faster than proprietary providers), and large-scale batch workloads. The offering is production-ready with SOC 2 and HIPAA support, multi-region data residency, and usage-based pricing that pools capacity across clouds without reservations.

Modal+4

Modal Training allows researchers and engineers to define and run fine-tuning, multi-node training, reinforcement learning, and hyperparameter sweeps entirely in code via the Python SDK, with automatic dependency and hardware management. It supports single-GPU to multi-node clusters (up to 128 B200s or similar with high-bandwidth Infiniband networking) that spin up in seconds with no commitments, any frameworks (PyTorch, Hugging Face TRL, Unsloth, Axolotl, torchtune), and integration with native distributed Volumes for data plus tools like Weights & Biases. Sub-second container starts and elastic scaling enable rapid iteration from experiments to full training loops, including concurrent RL trajectories that pair natively with Sandboxes. Use cases span domain-specific fine-tunes (e.g., Whisper on specialized vocab, Flux/LoRA image models, Llama/Qwen LLMs) and large-scale parallel experiments. The product is fully commercial and production-oriented, leveraging the same multi-cloud GPU pool and custom runtime as the rest of the platform for high utilization without capacity planning.

Modal+2

Modal Batch enables launching massive parallel jobs—such as embeddings, transcriptions, dataset generation, protein folding, scraping, or data processing—by defining tasks in the Python SDK with inline environment and hardware specs, then queuing up to 1 million inputs. Built-in queues, automatic retries, and instant scaling launch thousands of containers that process inputs to completion with fine-grained per-input and aggregate observability plus notifications. It removes capacity planning and worker orchestration, scaling elastically on the multi-cloud GPU/CPU pool with pay-per-use billing. Customers apply it to media pipelines, computational biology, quantum chemistry datasets, and high-throughput AI evaluation workloads. The service is a core commercial offering integrated with the rest of the Modal stack for end-to-end ML pipelines.

Modal+2

Modal Notebooks deliver collaborative, serverless Jupyter-style environments that start in under 5 seconds on high-performance GPUs (up to 8x H100/B200) or CPUs, with on-the-fly GPU swapping, real-time multi-cursor collaboration, AI-assisted editing, rich visualizations, and automatic idle shutdown. They mount petabyte-scale distributed Volumes for large datasets, share Secrets/Volumes/Functions with the rest of a Modal workspace, and use second-level billing so researchers pay only for active compute. Designed for exploratory ML research, profiling, and team sharing (e.g., post-training model handoff), they eliminate setup friction compared to traditional notebooks or Colab. The product is generally available as a commercial offering and integrates tightly with Training, Inference, and Sandboxes for seamless progression from exploration to production.

Modal+2

The Modal Core Platform is the underlying AI-native serverless infrastructure—custom container runtime with memory snapshotting, optimized filesystem, scheduler, multi-cloud GPU capacity pool spanning dozens of providers/regions, storage primitives (Volumes, Dicts, Queues), networking, and first-class observability—that powers all Modal products. Developers define entire environments (logic, dependencies, hardware) in Python via the SDK; containers boot in sub-seconds and autoscale from 0 to thousands of GPUs/CPUs with near-max utilization via intelligent batching and routing, paying only for active runtime with no reservations. It supports SOC 2, HIPAA, team controls, RBAC, data residency, and integrations for production reliability. This foundation enables the full ML lifecycle (pre-processing through serving and agents) for over 10,000 teams across generative AI, biotech, media, robotics, and more, with structural advantages in cold-start performance, capacity pooling, and developer experience that differentiate it from traditional clouds or point GPU providers. Recent primitives like Modal Servers further optimize low-latency routing for inference endpoints.

Modal+5

Baseten operates a high-performance inference platform optimized for deploying and serving open-source, custom, and fine-tuned AI models at scale, with tools like Truss for packaging models, dedicated and self-hosted options, training support, and specialized runtimes for LLMs, embeddings, transcription, and multi-modal workloads. It directly overlaps with Modal by targeting the same AI application builders and product teams needing reliable, low-latency production inference and related compute, often powering consumer-facing or enterprise AI features with autoscaling and observability. The platform has achieved substantial scale through successive large funding rounds that support enterprise compliance, multi-cloud/single-tenant deployments, and forward-deployed engineering support, making it a durable threat via deep performance optimizations and relationships with high-growth AI companies. Structural strengths include inference-focused infrastructure engineered for throughput and latency, plus flexibility for regulated workloads via self-hosting, which positions it well against pure serverless abstractions. Relative to Modal's broader general-purpose Python compute and sandboxes, Baseten is more specialized on model serving APIs and may involve more framework-specific packaging, potentially constraining arbitrary code or training-heavy workflows. Its business model emphasizes managed high-scale inference with enterprise controls, creating switching costs through optimized stacks and customer integrations that endure beyond individual product launches.

Baseten+2

Beam provides an open-source serverless platform for AI workloads including GPU inference, sandboxes for agents and code execution, task queues, and training, using a Python decorator-based SDK that enables sub-second cold starts via custom runtime and memory snapshots, with multi-cloud support including bring-your-own infrastructure. It competes most directly with Modal through nearly identical primitives for developer-defined functions, ephemeral sandboxes, burst scaling, and pay-per-use GPU access without infrastructure management, appealing to the same startups and teams building AI apps, agents, and pipelines. As a YC-backed company with self-hostable runtime, it emphasizes no lock-in and cross-cloud utilization as structural advantages that reduce vendor dependence over time. Durable strengths lie in its open-source core allowing self-hosting and custom compute addition, plus features like snapshot branching for parallel RL rollouts and sandboxes that mirror Modal's agent-focused roadmap. Relative constraints include a smaller team and ecosystem maturity compared to better-funded peers, which can limit documentation depth, global capacity, and enterprise features in the near term. Its model of composable primitives for full AI lifecycle compute creates long-term positioning as a flexible alternative that prioritizes portability over proprietary optimizations.

Beam+2

Cerebrium delivers serverless GPU infrastructure for real-time AI applications such as voice agents, video models, LLMs, and custom workloads, featuring sub-second cold starts via memory and GPU snapshots, instant autoscaling, multi-region support, and a code-first approach that runs existing Python or Dockerfiles without heavy rewrites. It overlaps closely with Modal on developer experience for deploying and scaling inference, training, and agent environments with pay-per-use economics and strong isolation via gVisor. Backed by seed funding including Gradient Ventures and YC, it targets production reliability for latency-sensitive multimodal apps with compliance features like SOC 2 and data residency. Key durable strengths include snapshotting for fast restores and global routing for high availability, enabling reliable bursts without capacity planning. Weaknesses relative to Modal center on earlier-stage ecosystem scale, more limited integrations and community tooling, and potentially narrower hardware/regional options that constrain the largest enterprise multi-node runs. Its focus on real-time, high-performance serverless for AI agents and pipelines provides structural competition through similar zero-ops model while emphasizing observability and security for regulated or production use cases.

Cerebrium+2

RunPod offers an AI developer cloud combining serverless GPU endpoints with sub-200ms cold starts via FlashBoot, on-demand pods for persistent compute, and multi-GPU clusters for training, all with transparent per-second or hourly pricing and global regions. It competes directly on serverless inference, fine-tuning, and scaling for custom ML workloads, serving overlapping developer and startup customers who need flexible GPU access without heavy ops, while also covering more reserved or DIY use cases. With over a million developers and substantial ARR supported by large funding, it has achieved broad traction as a cost-effective full-lifecycle platform. Structural strengths include a hybrid model of serverless plus marketplace-style pods that accommodates both bursty and sustained workloads, plus community templates that lower barriers. Relative to Modal's polished Python-native experience and custom runtime depth, RunPod can feel more marketplace-oriented with variable host reliability on some instances and less seamless abstraction for complex multi-service apps. Its durable positioning rests on accessibility, pricing transparency, and capacity for independent researchers through enterprises, creating a broad distribution network that challenges premium serverless offerings on value.

RunPod+2

Replicate enables running open-source and custom AI models via simple APIs, with tools like Cog for packaging, fine-tuning support, and serverless GPU-backed endpoints that scale automatically for inference on community and private models. It overlaps with Modal in providing frictionless deployment of generative and ML models for product features, targeting developers who want production APIs without managing infrastructure, particularly for image, video, and LLM inference. The platform has built a large developer base and paying customers including media and AI startups through its model registry and ease of use. Durable advantages include a rich public model ecosystem that accelerates prototyping and a clean API surface that minimizes custom code for common workloads. Compared to Modal's general-purpose compute for arbitrary Python functions, training clusters, and sandboxes, Replicate is narrower on pure inference and custom logic, with less emphasis on multi-node or agent environments. Its model of community-driven model hosting plus custom deploys creates network effects around popular open models, though its acquisition by Cloudflare introduces structural integration into a larger edge and developer platform.

Replicate+2

Modal's entire business model as a serverless AI infrastructure platform depends on aggregating and reselling scarce GPU capacity from third-party cloud providers rather than owning hardware, leaving it exposed to industry-wide supply shortages, price spikes from NVIDIA and cloud vendors, and capacity constraints that can directly limit customer growth or compress margins. As of May 2026, computational resources had become more expensive and harder to find amid AI demand, forcing Modal to expand from five to 13 cloud providers (including a key Oracle Cloud Infrastructure partnership for bare-metal H100/A100/A10 GPUs) and source from lesser-known operators simply to meet demand. The platform routes workloads across clouds and regions in real time with no customer reservations, but this multi-cloud bin-packing still cannot create GPUs that do not exist; peak demand periods or provider outages/price hikes would throttle Modal's ability to deliver instant autoscaling from 0 to 1000+ GPUs. Sacra explicitly flags GPU supply constraints as a core risk that multi-cloud only partially offsets. While Modal has demonstrated the ability to grow annualized revenue fivefold to approximately $300 million between September 2025 and May 2026 by casting a wider net for capacity, any sustained tightening in the GPU market remains a structural ceiling on scaling and profitability.

Reuters+4

Modal faces direct competitive threats from hyperscalers (AWS SageMaker, Google Cloud Run, Azure AI Studio) that are adding scale-to-zero serverless GPU capabilities, aggressive pricing cuts, and seamless integration with existing enterprise committed-spend programs and contracts that Modal cannot match. Specialized providers such as RunPod, Baseten, Replicate, Together AI, CoreWeave, and Lambda Labs compete aggressively on raw price (Modal H100 rates of approximately $3.95/hour have been called roughly 2x some alternatives like Lambda or RunPod), flexibility, or dedicated deployments, while Modal's pure Python SDK and sub-second cold starts provide differentiation that can erode as competitors copy DevEx features. Sacra notes the risk of market commoditization on price rather than features as serverless GPU primitives standardize, potentially compressing Modal's margins and reducing its stickiness. Marketplace integrations allowing customers to apply AWS/GCP committed spend help reduce friction but also highlight how easily customers can shift budgets back to hyperscalers offering millions in incentives. Modal's multi-cloud aggregation and custom stack (own file system, container runtime, scheduler) have enabled rapid scaling to thousands of customers and roughly $300M ARR as of May 2026, yet the structural power of hyperscalers' ecosystems and balance sheets remains a durable threat to long-term pricing power and share.

Sacra+4

Modal's explosive growth—from roughly $60M annualized revenue in September 2025 to about $300M by May 2026—has been driven disproportionately by AI-native startups and the surge in AI coding/agents, with sandboxes (isolated environments for untrusted AI-generated code) already accounting for more than one-third of revenue and powering customers such as Cognition, Ramp, DoorDash, Lovable, Suno, Physical Intelligence, and Chai Discovery. This creates structural concentration risk and high beta to the AI hype cycle and 'vibe coding' movement: if AI startups mature, optimize costs, or face funding pressure, they can migrate workloads to hyperscalers offering large credits and incentives, or if the agentic boom cools, net-new developer adoption and expansion could stall. Bear-case analyses note that Modal functions more as a developer-first serverless platform that happens to serve AI workloads rather than irreplaceable core AI infra, raising questions about long-term loyalty of its largest customers once they graduate from startup stage. Named high-profile customers and the 1 billion+ sandboxes launched demonstrate product-market fit, and the platform's usage-based model plus startup credit programs create a funnel, yet the revenue base remains highly sensitive to the fortunes of a relatively concentrated set of fast-growing AI firms rather than diversified enterprise workloads.

Modal+3

As a 2021-founded company that reached a $4.65B valuation and ~$300M ARR with a team of approximately 165 employees by late May 2026, Modal remains heavily dependent on co-founders CEO Erik Bernhardsson (ex-Spotify early engineer/data leader and Better.com CTO) and CTO Akshat Bubna for technical vision, product direction, customer relationships, and capital-raising execution. Bernhardsson is the highly visible public face who personally announced the Series C terms, explained the multi-cloud expansion, and drives the narrative around AI-native infrastructure; any departure, reduced involvement, or inability to scale the organization beyond founder-led mode would create material execution, talent-retention, and investor-confidence risk. The company has built a strong technical team (including open-source creators and olympiad medalists) and raised $466M total with top-tier backers, yet the early-stage profile and custom full-stack infrastructure (own file system, container runtime, scheduler, image builder) mean institutional knowledge and architectural decisions remain concentrated. Governance includes new board influence from Series C leads General Catalyst and Redpoint, providing some oversight, but the investment thesis still rests substantially on the founders' continued leadership and ability to attract/retain elite talent at scale.

Modal+3

Modal operates a pure consumption/usage-based model (pay-per-second for GPU/CPU/memory with no idle charges or reservations) that essentially resells third-party GPU capacity with a software and orchestration layer on top, creating inherent exposure to input-cost volatility and potential gross-margin compression if cloud GPU prices rise or utilization/bin-packing efficiency falls. At a $4.65B post-money valuation on roughly $300M annualized revenue as of May 2026 (approximately 15x), the company is priced for continued hypergrowth and eventual high-margin software economics, yet the underlying cost of goods is dominated by expensive, scarce accelerators whose pricing Modal does not control. Competitors often undercut on raw GPU rates, and non-preemptible or regional multipliers can push effective customer costs higher, pressuring Modal either to absorb margin hits or lose price-sensitive workloads. The multi-cloud strategy and Oracle partnership provide some cost optimization levers, and the fivefold revenue expansion demonstrates strong demand capture, but sustained profitability at scale remains unproven publicly and vulnerable to any slowdown in AI compute intensity or competitive price wars. Investors must weigh whether the DevEx moat and sandbox/inference attach rates can expand gross margins enough to support the valuation without perpetual high reinvestment.

Modal+3

Modal has built its own custom file system, container runtime, scheduler, image builder, and multi-cloud orchestration layer from the ground up (engineered for sub-second cold starts, GPU snapshotting, and scale-to-zero), creating a complex proprietary stack whose bugs, reliability issues, or scaling limits could disrupt production AI inference, training, and sandboxes for customers running mission-critical or untrusted code. The platform explicitly relies on gVisor for isolation of untrusted agent/LLM-generated code (a major revenue driver), and documentation acknowledges real-world challenges such as flaky NVIDIA drivers on certain L4 instances causing CUDA initialization failures at multi-thousand-GPU scale. Any systemic outage, isolation failure, or data-plane issue would be particularly damaging given the production nature of workloads (real-time robot control, music generation at thousands of GPUs, RL rollouts, drug discovery) and the shared-responsibility model that still leaves Modal responsible for platform integrity. The platform has experienced multiple short-duration incidents in 2026 involving storage subsystems, image builds, container scheduling, and upstream cloud dependencies, underscoring execution exposure even as most resolved quickly. SOC 2 Type 2 and HIPAA support provide compliance foundations and continuous monitoring is in place, yet the decision to own the full stack for performance advantages simultaneously concentrates technological and operational risk on Modal's engineering execution rather than commodity cloud primitives. Demonstrated traction with high-scale customers and 1B+ sandboxes shows the stack works at volume today, but the complexity remains a durable execution risk as the company scales further.

Modal+4

Independent practitioners, AI engineers, and communities widely agree that Modal delivers exceptional Python-native developer ergonomics that remove YAML, Docker, and infra friction, enabling near-instant spin-up of GPU jobs, functions, and apps. Matt Stockton, who works with companies on AI/ML, calls it 'an amazing technology... It just works and it is extremely well designed. They 100% get dev ergonomics correct,' noting he uses it even for non-core use cases successfully after the Latent Space podcast with Modal CTO Akshat Bubna. Reddit users in Machine Learning and deep learning forums repeatedly highlight short cold starts (e.g., ~30s for large models), free credits for trials, and simplicity for deploying models or ComfyUI backends without DevOps overhead, with one calling it 'the best thing in the AI compute market right now. Love the UX, love ease of deployment.' Thoughtworks assessed it positively in 2023 for seamless local-to-cloud switches and on-demand GPUs. Latent Space hosts frame Modal as a leader in evolving from DX to agent experience with sandboxes and elastic primitives that make complex AI loops practical. This view is broad among hands-on builders who value speed of iteration over raw cost.

Matt Stockton on X+4

Users and operators frequently note Modal commands a markup (often ~2x bare-metal or alternatives like Lambda Labs, RunPod, or Voltage Park) for its true serverless instant scale-to-zero, yet many report net savings via reduced idle time and fewer engineer hours. In a r/MachineLearning thread seeking cheaper 8xH100 options, the OP acknowledged paying more per hour but saving overall on total GPU-hours thanks to quick up/down, while a Modal employee explained the economics of maintaining spare capacity for seconds-scale boots. Joel Simonoff (AI at LatchBio) argues it is 'expensive for agents running computationally heavy science work loads i.e. tens of thousands of agents that need 6 cpus and 32 GiB' and 'isn't feasible' for biotech at scale, forcing in-house builds. Others seek or recommend alternatives for pure cost or high concurrency, with some X users noting limits on concurrency caps for 'more serious' production. The consensus among practitioners is that the premium buys DX and elasticity that pays off for intermittent, experimental, or short-burst AI (transcription, fine-tuning, privacy-sensitive inference), but continuous high-volume or massive agent fleets tip toward cheaper reserved or self-managed options.

Reddit r/MachineLearning+3

A recurring independent analyst view, most clearly articulated by John Hwang (Next Word Substack, himself a Modal customer), questions whether Modal (and peers like Supabase) are true 'core AI infra' or developer-first serverless platforms with high beta to AI startups, vibe-coding apps, and temporary hyperscaler capacity shortages. Hwang argues elite DevEx drives current multiples and adoption but over-indexes for enterprise retention once AWS/GCP/Azure incentives kick in or large customers 'graduate'; structural factors matter more than product quality, as seen with vector DBs. He notes Modal excels for GPU-accelerated workloads like transcription but faces risks of commoditization, lower stickiness, and margin pressure. Broader AI-infra discourse on HN and elsewhere echoes that many 'AI infra' startups are not physical or deeply differentiated infrastructure and may not sustain high revenue multiples. This remains a minority but substantive counterpoint even as Modal's reported ARR scaled dramatically to hundreds of millions; it frames valuation and long-term positioning debates rather than denying current product strength.

John Hwang / Next Word Substack+2

Hands-on engineers and the Latent Space community highlight Modal's systems work—custom container runtime, distributed filesystem, GPU snapshotting/checkpointing, RDMA, multi-cloud capacity across many providers, and sandboxes—as genuinely differentiated for bursty inference, training, RL rollouts (up to 100k sandboxes), and agent loops that traditional Kubernetes or raw GPU rental cannot match. Practitioners praise it for fine-tuning (e.g., Modal + Unsloth), short-burst private inference, ComfyUI APIs, and science workloads that need elastic scale without ops. Recent podcasts and X discussions frame the post-Series C evolution toward 'agent-native cloud' and AX (agent experience) as timely and well-executed. While company voices amplify this, independent users and analysts corroborate the practical outcomes: reliable scale-to-hundreds of GPUs in seconds, reproducible environments, and reduced friction that lets small teams or researchers achieve what previously required dedicated infra teams. Critiques of lock-in or limited multi-service orchestration exist but do not dominate the technical conversation.

Latent Space podcast+4