Self Learning Agent Optimization

via “loop agent for autonomous prompt and dataset optimization”

AI evaluation and observability — eval framework, tracing, prompt playground, CI/CD integration.

Unique: Autonomous agent that generates prompt variations and test cases based on evaluation feedback; unlike manual prompt engineering, Loop explores the optimization space systematically and tracks all iterations with version history, enabling reproducible optimization workflows

vs others: More autonomous than manual prompt iteration because Loop generates and evaluates variations automatically rather than requiring human-in-the-loop for each change

via “teachable agent with dynamic knowledge acquisition”

Microsoft AutoGen multi-agent conversation samples.

Unique: Separates learning mechanism from agent execution, allowing agents to update behavior via memory system updates without modifying agent code or redeploying; feedback is stored as structured patterns that agents can query during reasoning

vs others: Simpler than fine-tuning approaches because learning happens at inference time through memory augmentation, avoiding retraining costs and enabling immediate feedback incorporation

via “agent optimization framework with pluggable optimization algorithms”

LLM evaluation and tracing platform — automated metrics, prompt management, CI/CD integration.

Unique: Uses a BaseOptimizer abstract class pattern, allowing new optimization algorithms to be plugged in without modifying core Opik code. Optimizers receive full trace and evaluation context, enabling sophisticated optimization strategies that consider the entire execution history.

vs others: More extensible than fixed optimization strategies because custom algorithms can be implemented; more integrated than external optimization tools because optimizers have direct access to traces and evaluation results.

via “agent optimization with hyperparameter tuning”

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Unique: Implements a pluggable BaseOptimizer framework supporting multiple optimization algorithms (Bayesian, genetic, etc.) integrated with the experiment system, enabling automated hyperparameter search without external optimization libraries

vs others: More specialized than generic hyperparameter optimization tools because it understands LLM-specific hyperparameters (temperature, top_p, system prompts) and integrates with the evaluation system

via “agentic rl and model fine-tuning for agent behavior optimization”

Multi-agent platform with distributed deployment.

Unique: Integrates agentic RL and fine-tuning as a built-in optimization framework that collects agent trajectories, uses evaluation metrics as reward signals, and fine-tunes underlying LLMs through provider APIs, enabling continuous agent improvement without external ML infrastructure.

vs others: More integrated than external fine-tuning services because optimization is coordinated with agent execution and evaluation; more flexible than single-approach solutions because it supports both RL and supervised fine-tuning.

via “agentic reinforcement learning training pipeline for agent optimization”

📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程

Unique: Provides concrete patterns for implementing RL training loops for agents, including reward signal generation and trajectory collection, treating RL as an optional optimization layer rather than a requirement, enabling teams to start with prompt-based agents and add RL training as they scale

vs others: More sophisticated than pure prompt engineering but more practical than full policy learning from scratch; enables continuous improvement of agent behavior based on real-world performance

via “model fine-tuning and optimization with rl and prompt tuning”

Build and run agents you can see, understand and trust.

Unique: Integrates RL-based fine-tuning and prompt tuning as first-class optimization capabilities, allowing agents to improve their behavior through learning rather than requiring manual prompt engineering or model retraining

vs others: More integrated than LangChain's optimization support because fine-tuning and prompt tuning are built into the framework; more practical than AutoGen's optimization because it provides concrete RL and prompt tuning implementations

via “agent behavior learning and policy optimization”

Hi HN,I’m Vincent from Aden. We spent 4 years building ERP automation for construction (PO/invoice reconciliation). We had real enterprise customers but hit a technical wall: Chatbots aren't for real work. Accountants don't want to chat; they want the ledger reconciled while they slee

Unique: Learns topology and routing policies from execution traces using ML, enabling data-driven optimization of agent networks without manual tuning

vs others: More sophisticated than heuristic-based evolution, but requires more data and expertise; less predictable than rule-based optimization

via “adaptive agent behavior learning from interaction feedback”

aiAgentsEverywhere

Unique: Implements closed-loop learning where user feedback directly influences agent behavior through automated policy updates, rather than one-way feedback collection for manual model retraining

vs others: Enables continuous improvement without manual retraining cycles, unlike static agent systems that require explicit model updates; more practical than full RLHF by using lightweight preference learning on interaction data

via “self-evolving agent with continuous capability expansion”

Mobile-Agent: The Powerful GUI Agent Family

Unique: Self-evolving architecture maintains capability registry and learns new action patterns through interaction; integrates user feedback directly into the learning loop to guide capability expansion

vs others: More adaptive than static automation frameworks because it improves continuously; more practical than full retraining because it uses incremental learning on new capabilities

via “self-evolving agent patterns through workspace modification”

An Open Agent Computer for ANY digital work.

Unique: Treats workspace as a mutable, agent-modifiable surface that agents can update during execution to evolve their own capabilities and behavior. Self-modification is enabled through runtime APIs and persisted in state store, supporting true self-evolution patterns.

vs others: Enables agents to modify their own workspace and capabilities during execution, whereas most agent frameworks treat agent behavior as static and require external intervention for capability changes.

via “self-learning via automated knowledge generation and feedback indexing”

An autonomous agent that takes work, does work, gets paid, and gets better at it.

Unique: Implements BM25+ search with temporal decay weighting for knowledge retrieval, meaning recent successful patterns are prioritized while older knowledge gradually loses relevance. Feedback storage is separate from knowledge, allowing the agent to track execution context (task type, complexity, outcome) and correlate improvements to specific strategies without manual annotation.

vs others: Unlike fine-tuning-based approaches, CashClaw's knowledge indexing enables instant feedback incorporation without retraining, and temporal decay prevents stale patterns from dominating decision-making in evolving marketplaces.

via “self-learning agent behavior adaptation”

Show HN: Agent Swarm – Multi-agent self-learning teams (OSS)

Unique: unknown — insufficient data on specific learning algorithms, whether learning is prompt-based or model-based, and how learning state persists across agent restarts

vs others: Positions as self-improving agents vs static LLM-based agents, but implementation details and learning guarantees are not documented

via “performance monitoring and autonomous optimization”

🤖 A fully autonomous AI company that runs 24/7. 14 AI agents (Bezos, Munger, DHH...) brainstorm ideas, write code, deploy products & make money — no human in the loop. Powered by Claude Code.

Unique: Implements closed-loop optimization where agents continuously monitor performance and autonomously adjust strategies without human intervention, using real-time metrics to drive decision-making rather than static plans

vs others: More automated than traditional performance management because it eliminates human analysis and decision-making; less reliable than human optimization because agents may lack domain expertise and real-world grounding

via “self-learning-gnn-for-memory-optimization”

AgentDB v3 - Intelligent agentic vector database with RVF native format, RuVector-powered graph DB, Cypher queries, ACID persistence. 150x faster than SQLite with self-learning GNN, 6 cognitive memory patterns, semantic routing, COW branching, sparse/part

Unique: GNN learns from agent's actual memory access patterns rather than generic workload assumptions — optimization is domain and agent-specific, adapting as knowledge base and query patterns evolve

vs others: More adaptive than static index tuning, and more efficient than querying all patterns in parallel — learns which optimizations provide best latency/throughput trade-offs for specific agent

via “self-observation engine (improve) for autonomous agent reflection and learning”

Autonomous agent framework with structured memory, safety hooks, and loop management. Built by the agent that runs on it.

Unique: Implements a closed-loop self-observation system where agents query their own git-native memory to identify execution patterns, generate improvement hypotheses, and update their own knowledge base — enabling autonomous learning without external feedback or retraining

vs others: Unlike fine-tuning approaches (which require external data and retraining), Improve operates within a single agent's memory; unlike human-in-the-loop systems, it enables continuous autonomous adaptation without manual review cycles

via “self-improving agent loop with trace feedback”

We built meta-agent: an open-source library that automatically and continuously improves agent harnesses from production traces.Point it at an existing agent, a stream of unlabeled production traces, and a small labeled holdout set.An LLM judge scores unlabeled production traces as they stream.A pro

Unique: Creates a closed-loop system where agents improve themselves by analyzing their own execution traces, using trace-derived insights to automatically refine prompts and tool selections without human intervention

vs others: Goes beyond static prompt optimization (like DSPy or PromptOpt) by continuously learning from live execution traces, enabling agents to adapt to changing environments and task distributions in real-time

via “self-modifying skill acquisition during conversation”

44 plug-and-play skills for OpenClaw — self-modifying AI agent with cron scheduling, security guardrails, persistent memory, knowledge graphs, and MCP health monitoring. Your agent teaches itself new behaviors during conversation.

Unique: Implements runtime skill generation with integrated security validation — agents don't just call tools, they generate and register new Python functions into their own capability set during conversation, with prompt-injection guardrails preventing malicious skill injection

vs others: Unlike static tool registries (Copilot, LangChain agents), OpenClaw agents can create entirely new capabilities on-demand without redeployment, making them suitable for open-ended problem domains

via “self-modifying agent configuration via llm-driven rewrites”

Show HN: Phantom – Open-source AI agent on its own VM that rewrites its config

Unique: Phantom isolates the self-modifying agent on its own VM, preventing configuration changes from affecting other system components and enabling true sandboxed self-optimization. Most agent frameworks (AutoGPT, LangChain agents) modify external state or require human approval for config changes; Phantom gives the agent direct filesystem write access within a contained environment.

vs others: Unlike cloud-based agent platforms that require API calls to modify configuration, Phantom's VM-local approach eliminates latency and enables the agent to rewrite its config synchronously as part of its reasoning loop, supporting tighter feedback cycles for self-improvement.

via “self-improvement mechanisms”

A curated list of AI Agent evolution, memory systems, multi-agent architectures, and self-improvement projects. | evomap.ai

Unique: Incorporates a unique feedback loop that combines real-time performance metrics with historical data to guide self-improvement, unlike static learning models that lack adaptability.

vs others: More responsive to changing environments than traditional supervised learning models.