Arxiv Search

arXiv Search

Search the complete arXiv database of preprints across physics, mathematics, computer science, and quantitative biology using natural language queries powered by Valyu's semantic search API.

Why This Skill is Powerful

• No API Parameter Parsing: Just pass natural language queries directly - no need to construct complex search parameters
• Semantic Search: Understands the meaning of your query, not just keyword matching
• Full-Text Access: Returns complete article content, not just abstracts
• Image Links: Includes figures and images from papers
• Comprehensive Coverage: Access to all of arXiv's preprint archive across multiple disciplines

Requirements

1. Node.js 18+ (uses built-in fetch)
2. Valyu API key from https://platform.valyu.ai ($10 free credits)

CRITICAL: Script Path Resolution

The scripts/search commands in this documentation are relative to this skill's installation directory.

Before running any command, locate the script using:

bashCopy code
ARXIV_SCRIPT=$(find ~/.claude/plugins/cache -name "search" -path "*/arxiv-search/*/scripts/*" -type f 2>/dev/null | head -1)

Then use the full path for all commands:

bashCopy code
$ARXIV_SCRIPT "quantum entanglement" 15

API Key Setup Flow

When you run a search and receive "setup_required": true, follow this flow:

1. Ask the user for their API key: "To search arXiv, I need your Valyu API key. Get one free ($10 credits) at https://platform.valyu.ai"

2. Once the user provides the key, run:

   bashCopy code
   scripts/search setup <api-key>
   

3. Retry the original search.

Example Flow:

Copy code
User: Search arXiv for transformer architecture papers
→ Response: {"success": false, "setup_required": true, ...}
→ Claude asks: "Please provide your Valyu API key from https://platform.valyu.ai"
→ User: "val_abc123..."
→ Claude runs: scripts/search setup val_abc123...
→ Response: {"success": true, "type": "setup", ...}
→ Claude retries: scripts/search "transformer architecture papers" 10
→ Success!

When to Use This Skill

• Searching preprints across physics, mathematics, and computer science
• Finding research before peer review publication
• Cross-disciplinary research combining fields
• Staying current with rapid developments in AI and theoretical physics
• Prior art searching for new ideas
• Tracking emerging research trends

Output Format

jsonCopy code
{
  "success": true,
  "type": "arxiv_search",
  "query": "quantum entanglement",
  "result_count": 10,
  "results": [
    {
      "title": "Article Title",
      "url": "https://arxiv.org/abs/...",
      "content": "Full article text with figures...",
      "source": "arxiv",
      "relevance_score": 0.95,
      "images": ["https://example.com/figure1.jpg"]
    }
  ],
  "cost": 0.025
}

Processing Results

With jq

bashCopy code
# Get article titles
scripts/search "query" 10 | jq -r '.results[].title'

# Get URLs
scripts/search "query" 10 | jq -r '.results[].url'

# Extract full content
scripts/search "query" 10 | jq -r '.results[].content'

Common Use Cases

AI/ML Research

bashCopy code
# Find recent machine learning papers
scripts/search "large language model architectures" 50

Physics Research

bashCopy code
# Search for quantum physics papers
scripts/search "topological quantum computation" 20

Mathematics

bashCopy code
# Find math papers
scripts/search "representation theory and Lie algebras" 15

Computer Science

bashCopy code
# Search for CS theory papers
scripts/search "distributed systems consensus algorithms" 25

Error Handling

All commands return JSON with success field:

jsonCopy code
{
  "success": false,
  "error": "Error message"
}

Exit codes:

• 0 - Success
• 1 - Error (check JSON for details)

API Endpoint

• Base URL: https://api.valyu.ai/v1
• Endpoint: /search
• Authentication: X-API-Key header

Architecture

Copy code
scripts/
├── search          # Bash wrapper
└── search.mjs      # Node.js CLI

Direct API calls using Node.js built-in fetch(), zero external dependencies.

Adding to Your Project

If you're building an AI project and want to integrate arXiv Search directly into your application, use the Valyu SDK:

Python Integration

pythonCopy code
from valyu import Valyu

client = Valyu(api_key="your-api-key")

response = client.search(
    query="your search query here",
    included_sources=["valyu/valyu-arxiv"],
    max_results=20
)

for result in response["results"]:
    print(f"Title: {result['title']}")
    print(f"URL: {result['url']}")
    print(f"Content: {result['content'][:500]}...")

TypeScript Integration

typescriptCopy code
import { Valyu } from "valyu-js";

const client = new Valyu("your-api-key");

const response = await client.search({
  query: "your search query here",
  includedSources: ["valyu/valyu-arxiv"],
  maxResults: 20
});

response.results.forEach((result) => {
  console.log(`Title: ${result.title}`);
  console.log(`URL: ${result.url}`);
  console.log(`Content: ${result.content.substring(0, 500)}...`);
});

See the Valyu docs for full integration examples and SDK reference.