Skip to main content

2 posts tagged with "real-time news"

View All Tags

Fetch RSS Connector - Direct Access to News Feeds

· 5 min read
ApudFlow OS
Platform Updates

Access to real-time news is essential for staying informed about market movements and global events. Introducing the Fetch RSS Connector - a lightweight and powerful worker that provides direct access to RSS feeds from major news sources without requiring API keys or complex authentication.

What is Fetch RSS Connector?

The Fetch RSS Connector allows you to pull news articles directly from RSS feeds of trusted publications like Bloomberg, Investing.com, Yahoo Finance, and The New York Times. Unlike API-based news services, RSS feeds are freely accessible and provide real-time updates as soon as articles are published.

With built-in sorting by publication date and support for multiple feeds in a single request, you can quickly aggregate news from various sources for comprehensive market monitoring.

Key Features

  • No API Key Required: Direct access to public RSS feeds without authentication
  • Multiple Sources: Aggregate articles from multiple RSS feeds simultaneously
  • Real-time Updates: Get the latest articles as soon as they're published
  • Pre-configured Defaults: Ready-to-use feed URLs for major financial news sources
  • Date Sorting: Automatic chronological sorting with newest articles first
  • Flexible Limits: Control the number of articles returned (up to 500)
  • Structured Output: Consistent article format with title, body, date, source, and URL

How It Works

Core Functionality

RSS Parsing: Fetches and parses XML feeds from specified URLs Multi-source Aggregation: Combines articles from multiple feeds into one stream Date Extraction: Parses publication dates from various RSS formats (RFC 2822, ISO) Chronological Sorting: Orders articles by date, newest first Content Extraction: Pulls title, summary/description, source, and link

Default News Sources

The worker comes pre-configured with high-quality financial news feeds:

  • Investing.com - Stock market and forex news
  • Bloomberg Markets - Global financial markets coverage
  • Yahoo Finance - Comprehensive financial news
  • New York Times Economy - Economic analysis and reporting

Getting Started - Interface Configuration

Basic Setup

  1. Select Worker Type: Choose "fetch_rss" from the worker selection dropdown
  2. Review Default URLs: The worker includes pre-configured feeds for major sources
  3. Customize If Needed: Add or remove RSS feed URLs as desired
  4. Set Limit: Configure maximum number of articles (default: 100)
  5. Execute: Run the worker to retrieve articles from all feeds

Parameter Configuration

rss_urls (array): List of RSS feed URLs to fetch

[
"https://www.investing.com/rss/news_1063.rss",
"https://feeds.bloomberg.com/markets/news.rss",
"https://news.yahoo.com/rss/finance"
]

limit (number): Maximum articles to return (1-500, default: 100)

Practical Implementation Examples

Financial News Aggregation

Combine Fetch RSS with VectorAnalyzer for intelligent news filtering:

Workflow:

  1. Schedule Trigger - Run every 15 minutes
  2. Fetch RSS - Collect from default financial feeds
  3. VectorAnalyzer - Filter by query "market volatility earnings"
  4. Table Widget - Display relevant articles

Multi-Source News Dashboard

Build a comprehensive news monitoring system:

Configuration Example:

{
"rss_urls": [
"https://www.investing.com/rss/news_1063.rss",
"https://feeds.bloomberg.com/markets/news.rss",
"https://news.yahoo.com/rss/finance",
"https://rss.nytimes.com/services/xml/rss/nyt/Economy.xml",
"https://feeds.reuters.com/reuters/businessNews"
],
"limit": 200
}

Sentiment Analysis Pipeline

Combine with VectorAnalyzer for sentiment-aware news monitoring:

Workflow Chain:

  1. Fetch RSS → Collect articles from multiple sources
  2. VectorAnalyzer → Apply semantic search with sentiment analysis
  3. Filter by Polarity → Focus on strongly positive or negative news
  4. Telegram Notify → Alert on significant sentiment shifts

Integration with VectorAnalyzer

The Fetch RSS worker pairs perfectly with VectorAnalyzer for AI-powered news analysis:

Example Configuration:

// Step 1: Fetch RSS
{
"rss_urls": ["https://feeds.bloomberg.com/markets/news.rss"],
"limit": 100
}

// Step 2: VectorAnalyzer
{
"data": "{{workers[0].[result]}}",
"query": "Federal Reserve interest rates monetary policy",
"fields": ["title", "body"],
"top_percentage": 30,
"sort_by": "relevance"
}

Result: Articles semantically related to Federal Reserve policy, ranked by relevance with sentiment scores.

SourceRSS URLFocus
Investing.com Stockshttps://www.investing.com/rss/news_1063.rssStock market
Investing.com Forexhttps://www.investing.com/rss/news_14.rssCurrency markets
Bloomberg Marketshttps://feeds.bloomberg.com/markets/news.rssGlobal markets
Yahoo Financehttps://news.yahoo.com/rss/financeGeneral finance
NYT Economyhttps://rss.nytimes.com/services/xml/rss/nyt/Economy.xmlEconomic analysis
Reuters Businesshttps://feeds.reuters.com/reuters/businessNewsBusiness news

Best Practices

Feed Selection

  • Choose feeds that match your analysis focus
  • Mix broad coverage (Yahoo, Reuters) with specialized sources (Investing.com sectors)
  • Test feed availability periodically as URLs can change

Performance Optimization

  • Use appropriate limits based on your processing needs
  • Schedule updates based on your real-time requirements
  • Consider combining with caching for frequently accessed data

Workflow Design

  • Chain with VectorAnalyzer for intelligent filtering
  • Use sentiment_polarity for market mood analysis
  • Implement alerts for breaking news patterns

Conclusion

The Fetch RSS Connector provides a simple yet powerful way to access real-time news from trusted sources without the complexity of API authentication. Combined with VectorAnalyzer's semantic search and sentiment analysis capabilities, you can build sophisticated news monitoring workflows that surface the most relevant market intelligence.

Whether you're tracking market sentiment, monitoring specific sectors, or building comprehensive news dashboards, the Fetch RSS worker offers the flexibility and reliability you need. Start with the default feeds, then customize your sources to match your specific monitoring requirements.

For detailed guides on combining Fetch RSS with semantic analysis, check out our dedicated articles covering AI-powered news workflows and real-time sentiment monitoring strategies.

Fetch NewsAPI Connector - Comprehensive News Data Access

· 7 min read
ApudFlow OS
Platform Updates

In today's information-driven world, access to reliable and comprehensive news data is crucial for informed decision-making across various domains. Introducing the Fetch NewsAPI Connector - a powerful worker that provides seamless access to one of the most comprehensive news databases available through EventRegistry's NewsAPI.

What is Fetch NewsAPI Connector?

The Fetch NewsAPI Connector integrates with EventRegistry's NewsAPI to provide access to millions of news articles from thousands of trusted sources worldwide. Whether you're building news aggregators, conducting sentiment analysis, performing market research, or developing AI-powered content systems, this connector offers everything you need in one unified interface.

With advanced filtering capabilities by categories, sources, languages, and date ranges, the Fetch NewsAPI connector eliminates the need for multiple news APIs and complex data aggregation pipelines.

Key Features

  • Comprehensive Coverage: Access to millions of articles from 100,000+ news sources worldwide
  • Advanced Filtering: Filter by categories, sources, languages, and date ranges
  • Real-time & Historical Data: Access both breaking news and extensive historical archives
  • Trusted Sources: Pre-configured with major financial and news publications
  • Flexible Categories: Support for DMOZ taxonomy with business, finance, and industry categories
  • Language Support: Multi-language news retrieval with English as default
  • Date Range Filtering: Precise temporal filtering for time-sensitive analysis
  • Rate Limiting: Built-in API key management and usage tracking
  • Structured Output: Consistent article data with titles, content, dates, and metadata

How It Works

Core Functionality

Article Retrieval: Fetches news articles using complex queries with category and source filtering Temporal Filtering: Supports date range queries for historical and current news analysis Source Validation: Ensures articles come from reputable news sources Language Filtering: Retrieves articles in specified languages Result Limiting: Configurable result limits with intelligent ranking

Data Processing Pipeline

  1. Query Construction: Builds complex EventRegistry queries with category and source filters
  2. API Communication: Secure connection to EventRegistry NewsAPI
  3. Article Filtering: Applies date ranges, language filters, and result limits
  4. Data Normalization: Standardizes article format across all sources
  5. Result Packaging: Returns structured data ready for downstream processing

Getting Started - Interface Configuration

Basic Setup

  1. Select Worker Type: Choose "fetch_newsapi" from the worker selection dropdown
  2. Configure API Key: Enter your EventRegistry API key or use environment variable
  3. Set Parameters: Configure categories, sources, date ranges, and limits
  4. Execute: Run the worker to retrieve filtered news articles

Common Parameters

  • apiKey: Your EventRegistry API key (optional if set as environment variable)
  • categories: Array of category URIs for topic filtering
  • sources: Array of news source URIs for publication filtering
  • lang: Language code for article filtering (default: "eng")
  • dateFrom/dateTo: ISO date range for temporal filtering
  • limit: Maximum number of articles to return (1-500)

Parameter Configuration Examples

Default Financial News Setup:

  • categories: ["dmoz/Business/Investing/Stocks_and_Bonds", "dmoz/Society/Government/Finance"]
  • sources: ["finance.yahoo.com", "bloomberg.com", "reuters.com", "cnbc.com"]
  • limit: 100

Breaking News Monitoring:

  • dateFrom: Current date (YYYY-MM-DD)
  • categories: Broad business categories
  • limit: 50

Advanced Configuration Options

Category Taxonomy

EventRegistry uses DMOZ taxonomy for categorization. Common financial categories include:

  • dmoz/Business/Investing/Stocks_and_Bonds - Stock market and investment news
  • dmoz/Society/Government/Finance - Government financial policy and regulation
  • dmoz/Business/Investing/Currencies - Forex and currency markets
  • dmoz/Business/Investing/Commodities - Commodity trading and markets

Source Selection Strategy

Major Financial Publications:

  • finance.yahoo.com - Yahoo Finance
  • bloomberg.com - Bloomberg News
  • reuters.com - Reuters
  • cnbc.com - CNBC
  • marketwatch.com - MarketWatch
  • wsj.com - Wall Street Journal

Specialized Sources:

  • investing.com - Investing.com
  • foxbusiness.com - Fox Business
  • nytimes.com - New York Times (business section)

Date Range Optimization

  • Real-time News: Use current date for dateFrom, omit dateTo
  • Historical Analysis: Set specific date ranges for backtesting
  • Trend Analysis: Use rolling date windows for ongoing monitoring

Practical Implementation Examples

Financial News Aggregation System

Create a comprehensive financial news monitoring workflow:

  1. Fetch Breaking News using default financial categories and sources
  2. Apply Vector Analysis using VectorAnalyzer for semantic search
  3. Perform Sentiment Analysis to gauge market sentiment
  4. Generate Alerts based on sentiment scores and relevance

Complete Workflow Example:

  • workers[0]: Fetch NewsAPI Connector
    • type: fetch_newsapi
    • categories: ["dmoz/Business/Investing/Stocks_and_Bonds"]
    • sources: ["bloomberg.com", "reuters.com", "cnbc.com"]
    • dateFrom: 2025-11-01
    • limit: 50
  • workers[1]: VectorAnalyzer
    • type: vector_analyzer
    • data: {{workers[0].result.results}}
    • query: "market volatility and economic indicators"
    • top_percentage: 30

Market Intelligence Dashboard

Build real-time market intelligence:

  • workers[0]: Multiple News Sources
    • type: fetch_newsapi
    • sources: ["finance.yahoo.com", "marketwatch.com", "foxbusiness.com"]
    • dateFrom: Current date
  • workers[1]: Category Analysis
    • type: fetch_newsapi
    • categories: ["dmoz/Business/Investing/Currencies", "dmoz/Business/Investing/Commodities"]
  • workers[2]: Sentiment Aggregation
    • type: sentiment_analyzer
    • data_source: {{workers[0].result.results}} + {{workers[1].result.results}}

Historical News Analysis

Analyze news patterns over time:

  • workers[0]: Historical Data Collection
    • type: fetch_newsapi
    • dateFrom: 2025-01-01
    • dateTo: 2025-11-15
    • categories: Broad business categories
    • limit: 500
  • workers[1]: Trend Analysis
    • type: time_series_analyzer
    • data: {{workers[0].result.results}}
    • group_by: month

Operations Comparison Table

Feature CategoryUse CaseKey ParametersOutput Format
Breaking NewsReal-time monitoringdateFrom=current, limit=50Recent articles array
Historical AnalysisTrend researchdateFrom/dateTo rangesTime-filtered articles
Category FocusTopic-specific newscategories arrayThemed article collection
Source FilteringPublication qualitysources arrayTrusted source articles
Multi-languageGlobal coveragelang parameterLocalized content
Volume ControlPerformance optimizationlimit parameterSized result sets

Best Practices and Tips

API Key Management

  • Use personal API keys for higher rate limits and dedicated quotas
  • Set EVENT_REGISTRY_API_KEY environment variable for security
  • Monitor usage through EventRegistry dashboard to avoid limits

Query Optimization

  • Use specific category URIs for targeted results rather than broad searches
  • Combine category and source filtering for precise content control
  • Limit results appropriately for your processing capacity

Date Range Strategies

  • Use ISO format (YYYY-MM-DD) for all date parameters
  • Omit dateTo for ongoing "breaking news" monitoring
  • Use dateFrom only for "from this date forward" queries

Performance Considerations

  • Lower limits (50-100) for real-time applications
  • Higher limits (200-500) for batch processing and analysis
  • Consider pagination for very large result sets

Integration with Other Workers

AI-Powered News Analysis

Combine with VectorAnalyzer for semantic search:

  • VectorAnalyzer: Find articles most relevant to your query
  • Sentiment Analysis: Understand market sentiment from news content
  • Topic Modeling: Discover trending themes across news corpus

Financial Data Correlation

Link news with market data:

  • Price Data Integration: Correlate news events with price movements
  • Economic Calendar: Connect news with economic indicators
  • Technical Analysis: Use news sentiment as additional signals

Content Processing Pipelines

Build automated content workflows:

  • Text Summarization: Generate article summaries for quick review
  • Entity Extraction: Identify companies, people, and organizations
  • Trend Detection: Monitor topic frequency and sentiment changes

Conclusion

The Fetch NewsAPI Connector represents a comprehensive solution for news data access, providing everything from breaking financial news to historical archives in a single, easy-to-use interface. Whether you're a financial analyst, data scientist, content creator, or developer building news applications, this connector offers the flexibility and reliability you need to build sophisticated news-driven workflows.

With support for global news sources, advanced filtering capabilities, and seamless integration with AI analysis tools like VectorAnalyzer, the Fetch NewsAPI connector eliminates news data silos and simplifies the development of intelligent news processing systems. Start exploring the power of comprehensive news data today and unlock new possibilities for your news analysis and content processing applications.

For detailed guides on specific use cases, check out our dedicated articles covering advanced filtering techniques, AI-powered news analysis workflows, and real-time news monitoring strategies with step-by-step interface instructions and practical examples.