Creating and Managing Datastreams

Datastreams make your content smarter, sharper, and grounded in reality

By constantly pulling, scoring, and filtering content from real sources, Datastreams inform your workflows with live context, verified quotations, and up-to-date insights from thousands of articles across the web.

Think of them as your brand-aligned research engine, automating the current-events curation your editors are doing manually. Except faster. Smarter. And always on.

This isn’t just AI. This is AI that reads the news, checks the sources, and gets your niche.


Step-by-Step: Creating a Datastream

1. Start From the Dashboard
Go to Datastreams in the main navigation and click + New Datastream.

2. Enter Your Datastream Info
Fill in the required fields:

  • Name – Give your stream a clear, searchable name like "US Sports – No Betting" or "Finance – No Crypto".
  • Description – Optionally describe what the Datastream is for (e.g., "Daily digest for clean sports content excluding fantasy and betting").

3. Choose Datastream Type
Select one of the following:

  • Article – Scores and surfaces the strongest individual articles based on your filters. Great for Agents needing citations.
  • Inspiration – Clusters and ranks groups of articles by trending topic, helping agents surface broader themes or brainstorms.

4. Configure Time Frame

  • For Article type, choose Publication Time Frame (e.g., last 24 hours, 7 days).
  • For Inspiration type, define both Publication Time Frame and Clustering Time Frame, which determines how trends are grouped.

5. Set Your Filters (Metadata) Use the following categories to precisely target content:

  • Included Items – Articles must match one of these.
  • Boosted Items – Rank items higher (0 to 1000).
  • Penalized Items – Rank items lower (0 to –1000).
  • Excluded Items – Fully block anything matching.
  • Repeat the same for Sources.

6. Save & Preview
Click Create Datastream, then use the Preview Articles or Preview Inspirations button to evaluate results.

7. Assign to Agents
From any compatible Agent’s config screen, select this Datastream under "Source Input."


Understanding the Metadata Filters

Filter TypePurpose
Included ItemsRequired match — must appear in metadata to qualify.
Boosted ItemsPrioritized in scoring. Use 600–1000 for strongest influence.
Penalized ItemsLowered in scoring, but not blocked. Use –400 to –700 for soft blocks.
Excluded ItemsFully blocked — removes the article or source from view.
Included SourcesAllows only selected publishers or domains.
Boosted SourcesRaises content from preferred sources.
Penalized SourcesDownranks less-reliable or edge sources.
Excluded SourcesFully blocks sources by name, URL, or domain pattern.

Trial, Error & Iteration

Datastreams require fine-tuning. Here’s how to make yours better over time:

  • Always Preview Before Using – Click the Preview Articles or Preview Inspirations button to see real results.
  • Spot Check Unwanted Topics – If you're seeing off-brand results, go back and exclude those terms or sources.
  • Copy to Iterate – Use the Duplicate Datastream feature to test small variations without rebuilding from scratch.
  • Use Descriptive Names – Add notes like "– No Politics" or "+ Niche Finance" to track their purpose.
  • Refine Over Time – It’s common to adjust filters weekly as your content needs evolve.

Pro Tips

Keep Included Items minimal — just 2–4 high-value tags.

  • Penalize instead of exclude to reduce noise without over-filtering.
  • Pair Boosted Items with Excluded Items to guide tone and focus.
  • Inspiration-type Datastreams work best for brainstorm or outline-style Agents.
  • Article-type Datastreams are better for content that must cite sources.

Real-World Datastream Examples

 

Finance Trends Datastream

FieldValues
Included ItemsInvesting, Stock market, Economic policy, Interest rates, Consumer spending
Boosted ItemsInflation (700), Federal Reserve (800), S&P 500 (650), Monetary policy (600), Mortgage rates (500)
Penalized ItemsCryptocurrency (–600), NFTs (–800), Meme stocks (–500), Forex trading (–400)
Excluded ItemsWealth inequality, Get-rich-quick schemes, Sponsored content, Viral hacks
Included SourcesBloomberg, MarketWatch, CNBC, Yahoo Finance
Boosted SourcesReuters (800), Wall Street Journal (700), Financial Times (650)
Penalized SourcesReddit (–900), Seeking Alpha (–500), Medium (–400)
Excluded SourcesCoinDesk, Daily Express, Business Insider

Health & Wellbeing Datastream

FieldValues
Included ItemsMental health, Nutrition, Preventive medicine, Sleep, Emotional exhaustion
Boosted ItemsAnxiety (650), Burnout (600), Rest (500), Vitamin D (450), Mindfulness (550)
Penalized ItemsDetox (–600), Diet fads (–700), Biohacking (–400), Fitness marketing (–500)
Excluded ItemsSponsored content, Celebrity tips, Miracle cures, Clickbait titles
Included SourcesMayo Clinic, Psychology Today, WebMD, Johns Hopkins Medicine
Boosted SourcesCleveland Clinic (800), Healthline (700), Harvard Health (600)
Penalized SourcesBuzzFeed (–700), Wellness blogs (–500), Medium (–400)
Excluded SourcesGoop, Daily Mail, The Sun

General U.S. News Datastream

FieldValues
Included ItemsNational news, Labor market, Transportation, Public health, Education
Boosted ItemsEmployment (650), Infrastructure (600), Public transit (500), Climate policy (550), Weather (500)
Penalized ItemsPolitical commentary (–700), Foreign affairs (–400), Editorial (–500)
Excluded ItemsSatire, Op-eds, Partisan coverage, Sensational headlines
Included SourcesAssociated Press, NPR, Reuters, USA Today, Axios
Boosted SourcesPew Research (800), Stateline (700), Government websites (600)
Penalized SourcesLocal blogs (–500), Patch (–600), Aggregators (–400)
Excluded SourcesThe Onion, Daily Mail, Breitbart, HuffPost

Sports Highlights Datastream

FieldValues
Included ItemsProfessional sports, Athlete performance, Championship games, Match recaps
Boosted ItemsNBA Finals (750), Olympic Games (700), Player statistics (650), Tournament coverage (600), Injury reports (500)
Penalized ItemsFantasy football (–400), Esports (–800), Trade rumors (–500), Fan blogs (–600)
Excluded ItemsSports betting, Tabloid drama, Off-field scandals, TikTok highlights
Included SourcesESPN, CBS Sports, NBC Sports, Bleacher Report
Boosted SourcesThe Athletic (800), Sports Illustrated (750), Fox Sports (700)
Penalized SourcesSB Nation (–500), Barstool Sports (–800), FanDuel Blog (–1000)
Excluded SourcesTMZ Sports, Sportskeeda, TikTok