Skip to content

Feature: Clarvia AEO integration for agent tool quality pre-validation #1992

@digitamaz

Description

@digitamaz

Feature Request: Clarvia AEO Tool Integration for MetaGPT Tool Quality Validation

Background

MetaGPT is a multi-agent framework where agents take on specialized roles (Engineer, PM, QA, etc.). When these agents use external tools and APIs, the quality of those tools impacts overall system output quality.

Clarvia provides AEO (Agent Experience Optimization) scores for 27,000+ tools, giving MetaGPT agents a reliable signal for tool quality before use.

Proposed Integration

Add Clarvia as a MetaGPT action or tool:

from metagpt.tools.tool_registry import register_tool
import requests

@register_tool()
class ClarviaTool:
    """Check if a tool or API is optimized for autonomous agent use."""
    
    async def check(self, tool_name: str) -> dict:
        """Get AEO score for a tool. Score 60+ = reliable for agent workflows."""
        resp = requests.get(f"https://clarvia-api.onrender.com/v1/check/{tool_name}")
        return resp.json()
    
    async def search(self, capability: str, min_score: int = 60) -> list:
        """Find tools by capability with minimum quality threshold."""
        resp = requests.get(
            f"https://clarvia-api.onrender.com/v1/search",
            params={"q": capability, "min_score": min_score}
        )
        return resp.json()

Use Case: Engineer Agent Pre-flight Checks

When MetaGPT's Engineer agent is about to use a new API:

  1. Check Clarvia score first
  2. If score < 50: use alternative or add extra error handling
  3. If score 60+: proceed with standard integration

API: https://clarvia-api.onrender.com
MCP: npx -y clarvia-mcp-server@latest
GitHub: https://github.com/clarvia-project/clarvia-mcp-server
npm: 714 weekly downloads

Would MetaGPT consider listing Clarvia as a recommended tool quality validator?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions