AI Developer Frameworks & Infrastructure

91 tools in this category.

OpenCode logo
OpenCodeOpen-source, model-agnostic AI coding agent for terminals, integrating 75+ model providers, supporting offline and enterprise-level deployment
Replicate logo
ReplicateRun open-source AI models with one API call.
Kernel logo
KernelCloud browser infrastructure for AI agents, with millisecond-level cold start, built-in anti-detection, and proxy, making it possible for agents to browse and interact with websites like humans.
Pydantic AI logo
Pydantic AIPython agent framework from Pydantic team, bringing FastAPI development feel to GenAI
MLflow logo
MLflowOpen-source AI engineering platform for end-to-end tracking, evaluation, monitoring, and optimization of ML models, LLMs, and agents
LiteLLM logo
LiteLLMOpen-source AI gateway to unify 100+ LLMs with cost tracking, load balancing, and logging
TensorZero logo
TensorZeroThe open-source LLMOps platform that integrates gateway, observability, evaluation, and automated model and prompt optimization loop, enabling your AI applications to continuously learn from real-worl
cubic logo
cubicAI-powered code review platform from Y Combinator, understanding complex logic across files and providing actionable insights
Kilo Code logo
Kilo CodeOpen-source AI coding proxy, untethered from single models and editors, with transparent costs and flexible integration
D
DifyOpen-source LLM application development platform
Pinecone logo
PineconePopular vector database service
Langfuse logo
LangfuseOpen-source LLM application observability platform
Omnara logo
OmnaraTake control of your AI agents on-the-go with Omnara, the mobile and web command center for Claude Code and other AI agents.
Promptfoo logo
PromptfooOpen-source LLM evaluation and red team testing tool for comparing GPT, Claude, and Gemini performance with declarative settings, and vulnerability scanning for AI applications
Bifrost logo
BifrostA high-performance, open-source LLM gateway written in Go, boasting 50x faster speed than LiteLLM and microsecond-level latency at 5000 RPS
Daytona logo
DaytonaA secure sandbox for running AI-generated code, with 90ms cold start and compatibility with Docker and OCI
LangWatch logo
LangWatchAI Agent Testing and Evaluation Observability Platform
Z
ZeroEntropyAccurate RAG search with high-precision re-ranking and embedding models
Cua logo
CuaEmpowering AI with a true cloud computer. Cua offers Linux, Windows, and macOS sandbox desktops with an open-source SDK, enabling agents to interact like humans.
Qdrant logo
QdrantHigh-performance open-source vector database.
Weaviate logo
WeaviateOpen-source vector database
RunPod logo
RunPodAffordable cloud GPU platform
Cerebras logo
CerebrasDelivering ultra-fast AI inference with its own chip.
Fal logo
FalHigh-speed inference platform for generative media.
LangSmith logo
LangSmithThe observation and evaluation platform for LLM applications.
Modal logo
ModalCloud platform for running AI and compute workloads.
LangChain logo
LangChainBuilding the development framework for LLM applications.
Fireworks AI logo
Fireworks AIHigh-speed open-source model inference platform
TA
Together AICloud Inference and Fine-tuning Platform for Open-source Models
LlamaIndex logo
LlamaIndexLlamaIndex is ideal for building and managing large language model data indexes and query systems.
Coalesce logo
CoalesceEmpowering Cloud Data Warehouses with AI-Driven Data Transformation and Modeling
Keploy logo
KeployAutomate API testing and mocking with real traffic
TrueFoundry logo
TrueFoundryUnified Platform for Governing, Deploying, Scaling, and Tracking Agentic AI Workloads
Steel logo
SteelOpen-source browser API for large-scale cloud management, providing a REST/WebSocket service for AI agents and web crawlers
RAGFlow logo
RAGFlowOpen-source RAG engine, strong in 'deep file understanding', transforming PDFs, tables, images, and more into high-quality semantic fragments for enhanced search and retrieval
Kiro logo
KiroAWS's spec-driven development tool that brings AI programming back to disciplined engineering
Dyad logo
DyadOpen-source, local-first AI app builder, giving you full code ownership and flexibility
C
CoderOpen-source, self-hosted cloud development environment platform that turns infrastructure into code with Terraform templates, deployable on AWS, GCP, Azure, Kubernetes, and bare metal, with governed w
Ona logo
OnaEvolve your cloud development environment into a command center for software engineering agents with Ona, the rebranded Gitpod
VoltAgent logo
VoltAgentOpen-source TypeScript AI agent framework with built-in memory, RAG, fencing, tools, MCP, voice, and workflow engine, supporting supervisor and sub-agent scheduling
S
SiliconFlowOne API to access 200+ open-source and commercial models, with serverless inference, model fine-tuning, and dedicated GPU deployment
Trieve logo
TrieveOpen-source, self-hostable, all-in-one search API. Trieve integrates search, RAG, recommendation, and analysis into a single API, enabling you to add accurate and fast semantic search and retrieval ca
B
BytebotOpen-source, self-hosted AI desktop agent
Lightrun logo
LightrunAI-powered SRE platform for dynamic debugging and telemetry in production environments without restarts or redeployments
Korbit AI logo
Korbit AIAutomate your PR review process with Korbit AI, your team's new 24/7 review robot that catches bugs, writes summaries, and provides actionable modification suggestions.
Zilliz logo
ZillizThe Cloud-Native Vector Database Behind Milvus
Haystack logo
HaystackBuilding Open-Source Frameworks for LLM Applications
Chroma logo
ChromaAn open-source, embedded vector database for AI applications.
Portkey logo
PortkeyAI Gateway and Management Platform for LLM Applications
Braintrust logo
BraintrustAI Application Evaluation and Experimentation Platform
Helicone logo
HeliconeOpen-source platform for LLM monitoring and analysis.
H
HumanloopLLM Evaluation and Prompt Management Platform
Vellum logo
VellumBuild, test, and deploy LLM applications with ease.
Baseten logo
BasetenA platform for deploying and serving AI models.
L
LocofyTransform Designs into Frontend Code with AI
D
DatatureTrain and deploy computer vision models without coding
Metoro logo
MetoroKubernetes-dedicated AI SRE platform with eBPF zero-instrumentation observability
AB
Anchor BrowserCloud-based browser automation infrastructure for agentic AI, enabling agents to browse like humans with built-in anti-detection and CAPTCHA solving
Hyperbrowser logo
HyperbrowserCloud-based browser infrastructure built for AI agents, with simultaneous support for thousands of isolated sessions and a HyperAgent framework that understands natural language commands.
Vibe Kanban logo
Vibe KanbanOrchestrate multiple AI coding agents with a Kanban board, streamlining task planning, parallel execution, and visual code review.
Upstage logo
UpstageEmpowering enterprises with AI-driven document intelligence and large language models
Northflank logo
NorthflankOne-stop deployment platform for applications, databases, AI models, and scheduled tasks with GPU support and multi-cloud capabilities
AgentOps logo
AgentOpsThe observability platform built for AI agents, supporting over 400 frameworks and models, including OpenAI, CrewAI, and Autogen, with a focus on time-travel debugging
BaseRock AI logo
BaseRock AIAgent-based QA platform that tests with real business scenarios, automatically verifying business logic and uncovering hidden errors
Diffblue logo
DiffblueEnterprise-grade Java unit testing agent from the University of Oxford, using reinforcement learning to write and maintain tests at scale.
SambaNova logo
SambaNovaAccelerating AI Inference with Proprietary Chips
FastGPT logo
FastGPTOpen-source knowledge base Q&A and workflow platform
LanceDB logo
LanceDBAn open-source vector database built for AI.
Lunary logo
LunaryOpen-source LLM monitoring and management platform.
LA
Literal AIYour go-to platform for monitoring and evaluating LLM applications.
Sieve logo
SieveDeveloper Platform for AI-powered Audio-Visual Processing
Nomic logo
NomicEmbedded Model and Data Visualization Platform
Hyperbolic logo
HyperbolicAffordable AI Inference and GPU Platform
Patronus AI logo
Patronus AIAI Evaluation and Protection Platform
DeepInfra logo
DeepInfraAffordable Open-Source Model Inference API
Anyscale logo
AnyscaleScalable AI Computing and Deployment Platform
Predibase logo
PredibaseThe platform for fine-tuning and serving open-source models.
OpenPipe logo
OpenPipeThe platform for fine-tuning and optimizing models.
AA
Athina AILLM Evaluation and Monitoring Platform
PromptLayer logo
PromptLayerStreamline Prompt Management and Monitoring
Ciroos logo
CiroosAI-Driven SRE Platform for Accelerated Incident Resolution Across Domains
Kodus logo
KodusOpen-source, model-agnostic AI code review agent that integrates with GitHub, GitLab, and Bitbucket, learning your team's rules and offering transparent, cost-effective solutions
KitOps logo
KitOpsOpen-source AI/ML packaging and version control tool, creating signed OCI standard artifacts for seamless container repository management
Blaxel logo
BlaxelThe perpetual sandbox platform for AI agents, with zero compute costs when idle and 25ms wake-up time
Agenta logo
AgentaOpen-source LLM application development platform that streamlines prompt management, evaluation, observability, and collaboration in one interface
Truffle AI logo
Truffle AIThe AWS of AI agents, making it easy to deploy and integrate AI into your applications
Coral Protocol logo
Coral ProtocolCross-framework multi-agent infrastructure for secure collaboration
Panto AI logo
Panto AIUnifying dynamic code review, security scanning, and mobile App QA automation into a single, proactive quality platform.
I
InferlessServerless Model Deployment Platform
L
LaminiEnterprise-level LLM fine-tuning and deployment platform
RuntimeAI logo
RuntimeAIThe control plane for autonomous AI agents, emphasizing security, governance, and compliance, with features like runtime logging, human oversight, and risk management to help enterprises meet EU AI Ac