AI Development & Infrastructure shortlist
AI Agent Data & Runtime
Vector retrieval, memory systems, and runtime foundations for agents
Tool List
101 toolsmilvus
High-performance cloud-native vector database for large-scale ANN and semantic retrieval
LightRAG
[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"
free-llm-api-keys
Free LLM API keys for GPT-5.4, Claude, DeepSeek, Gemini, Grok — copy, paste, use. Updated 3-5x daily. No credit card needed
tidb
TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling
GoModel
AI gateway written in Go. Lightweight unified OpenAI-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI & Ollama. LiteLLM alternative with observability, guardrails, streaming, costs and usage tracking
PumaDB
Database and retrieval layer for AI apps, supporting data use in semantic search and intelligent applications
ClickHouse
ClickHouse® is a real-time analytics database management system
sycamore
🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data
openmeter
Metering and Billing for AI, API and DevOps. Collect and aggregate millions of usage events in real-time and enable usage-based billing
cube
📊 Cube Core is open-source semantic layer for AI, BI and embedded analytics
mempalace
The best-benchmarked open-source AI memory system. And it's free
WFGY
WFGY is heading toward WFGY 5.0 Polaris Protocol, a major open-source release for AI reasoning, RAG, agents, and real-world workflows. Includes Problem Map, Global Debug Card, WFGY 4.0, and the CFV Easter Egg
hermes-lcm
Lossless Context Management plugin for Hermes Agent — DAG-based context engine that never loses a message
supabase
The Postgres development platform. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications
materialize
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
ragflow
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
risingwave
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale
vespa
The AI search platform
rustfs
🚀2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph
gcsfuse
A user-space file system for interacting with Google Cloud Storage
NornicDB
Nornicdb is a distributed low-latency, Graph+Vector, Temporal MVCC with all sub-ms HNSW search, graph traversal, and writes. Using Neo4j Bolt/Cypher and qdrant's gRPC means you can switch with no changes. Then, adding intelligent features like schemas, managed embeddings, LLM reranking+inferrence, GPU accel, Auto-TLP, Memory Decay, and MCP server
mcp-memory-service
Open-source persistent memory for AI agent pipelines (LangGraph, CrewAI, AutoGen) and Claude. REST API + knowledge graph + autonomous consolidation
mcp-toolbox
MCP Toolbox for Databases is an open source MCP server for databases
Token Harbor
Simple unified access to frontier AI models
apisix
The Cloud-Native API Gateway and AI Gateway
relay-pulse
Availability monitoring system for LLM relay services with real-time status dashboards
relay
Real-time agent to agent communication
CreateOS Sandbox
Fast hardware-isolated execution sandboxes for AI agents and untrusted code
Creed
A shared personal context file for every connected AI agent
BaseRT
Native Metal local LLM inference runtime optimized for Apple Silicon
ZooData
Agent-ready web extraction and commerce intelligence delivered through structured APIs, CLI, and MCP
Kit For AI
Persistent memory and knowledge layer for AI agents with MCP-native access to files, URLs, and context
Unabyss for Claude
MCP-native self-updating context layer shared across Claude, ChatGPT, Cursor, and everyday apps
AgentKey
Real-time external data marketplace for AI agents, connecting search, web, social, finance, and ecommerce data through one MCP plugin
Auriko
Trading desk for LLM calls that optimizes token cost, latency, reliability, and quality through routing and arbitrage
Edgee Claude Code Compressor V2
Token compression gateway for coding agents that keeps context while reducing cost
Hivemind
DeepLake tool that gives Claude Code, Codex, Cursor, and other AI agents persistent shared team memory
Epsilla
Epsilla is an Agent-as-a-Service platform for creating and operating AI agents on enterprise knowledge
HydraDB
HydraDB is context infrastructure that makes AI applications intelligent, stateful, and memory-aware
chroma
Data infrastructure for AI applications with vector storage and retrieval workflows
Mem0
Mem0 enables AI apps to continuously learn from past user interactions, enhancing their intelligence and personalization
N71
Shared context and living knowledge graph for multiple AI agents
Stigg
Usage runtime, metering, and entitlement governance platform for AI products
scritty
Shared, searchable external memory for every AI coding agent
Memori Labs
Model-agnostic persistent memory infrastructure for production agents
ContextPool
ContextPool gives AI agents persistent memory between sessions by extracting useful context and feeding it back automatically
InstantDB
InstantDB is an open-source realtime backend that bundles database, auth, storage, and sync for AI-built and full-stack applications
LiteRT
Google's on-device ML/GenAI runtime framework and successor to TensorFlow Lite
Wafer
Wafer uses autonomous AI agents to profile and optimize GPU inference performance across production stacks
vm0
Open workflow automation project that runs natural-language-described tasks automatically
Geekflare API
Geekflare API provides scraping, screenshot, and RAG-ready extraction APIs to turn raw web pages into clean, structured data
Actian VectorAI DB
Vector database capability for AI applications, semantic search, and intelligent data infrastructure
Bitfield
Local-first plug-in runtime and database for building products with extensible runtime slots
Powabase
Backend, database, and user system platform for AI applications
AlgoFly AI
On-premise-first AI data platform for computer vision datasets, annotation workflows, quality control, and AI operations
Sipcode
Claude Code context hygiene tool that caps verbose tool output and deduplicates same-session re-reads to keep context cleaner
Oxlo AI
OpenAI-compatible inference API for accessing 45+ frontier AI models with request-based pricing and privacy-focused handling
Blaxel Agent Drive
Distributed shared filesystem for AI agents and sandboxes
FluentDB
Native macOS AI database client with approval-first SQL generation
Fluree AI
Trusted, permissioned, and verifiable data context for apps and AI agents
Firecrawl /search
Search API returning source-linked web excerpts selected for agent queries
Screencap
Open-source, local-first macOS workflow capture that turns reviewed screen interactions into structured AI training data
Memmy Agent
Local-first personal memory hub that shares user-controlled long-term context across Claude Code, Codex, OpenClaw, and other AI tools
Paritok
Locally compress tool results, files, and session history for coding agents
Unsloth Desktop
Open-source desktop app for locally running and fine-tuning LLM, diffusion, and audio models
Blume
Open-source, AI-ready documentation framework built on Astro and Vite with Markdown as the source
session-indexer
Index Claude Code sessions into a per-project local SQLite store and automatically recall relevant context
Dropstone
Model-independent runtime for persistent memory, skill learning, self-verification, and cross-environment agent execution
HFlow
Open-source multimodal data-pipeline SDK for robotics and physical AI with orchestration, versioning, provenance, and curation
ngrok AI Gateway
One private gateway for cloud and self-hosted AI models
BackEngine MCP
Give AI assistants secure access to internal company knowledge for real business work
Atlaso
Shared persistent memory for Claude Code, Cursor, Codex, and other AI tools
Glasp MCP Connector
Search personal highlights, notes, and reading memories from Claude and ChatGPT
ARBR
Control every AI request
Onset MCP
Write and publish release notes from an AI assistant through MCP
Desert Ant Labs
On-device specialist models for speech, text and vision
jurniti
Run persistent AI agents in dedicated Firecracker microVMs
Weave Router 2.0
Route coding requests by task complexity, cache state and subscription quota
Eggshell
Keep local work results and evidence for coding agents
XCrawl
Supply agents with web data through APIs, MCP and SDKs
Voxel51 Multimodal
Multimodal data platform for finding failures in physical AI models
Backenly
Autonomous backend platform built for coding agents over MCP
Agnos
Clean documents for AI locally while showing each removal
Context Engine
Shared memory for AI agents and human teammates
CCRent
Rent a remote Mac mini configured for Claude Code
Intel® GPU D-series
Data-center GPUs for agentic AI and long-context inference
TwitterAPI.io
Access public X data through a REST API and hosted MCP server
Yap MCP
Transcribe local media and search Yap dictations through an on-device MCP server
Web Search API
Give AI agents access to live internet data
FastRouter.ai
Route requests to the right LLM for cost, latency, and quality
Hemory
Always-listening searchable memory for AI agents
Hopscotch AI
Access more than 500 AI models through one API
Busabase
An open-source system of record shared by AI agents and teams
Edgee Mod for Claude Code
Switch among 200+ models inside Claude Code and see compression and routing savings
Kyvenza
Create and manage macOS, Linux, and Windows virtual machines on Apple Silicon Macs
AIGoCode
Access OpenAI-, Anthropic-, and Gemini-compatible APIs through one key
SpicyAPI
Use 200+ video, image, audio, and chat models through a pay-per-request API and no-code Studio
AI Sandboxes by Buddy
Give coding agents persistent isolated Linux machines in the cloud
Navige
Optimize agent model usage and set spending controls while tasks run
Scalebrowser
Give AI agents persistent self-hosted browser sessions
Toad
Let AI agents access your own devices with approval
Related categories
AI Code Generation & Completion
Code generation, completion, and dev assistance
AI Application Generator
Build apps, websites, and prototypes quickly from prompts
AI Testing & Debugging
Automated testing, debugging, and quality assurance
AI Agent Framework
Agent frameworks, orchestration, MCP integration, and execution platforms
AI Developer Tools & SDKs
Developer libraries, APIs, CLIs, and integration tools
AI Model Training & Runtime
Model training, inference, compilation, and deployment infrastructure