The Data Cloud
The Data Cloud is Datafye's market data infrastructure that provides normalized, high-quality market data through multiple access patterns. This section covers everything related to accessing and configuring market data in your Datafye deployment.
What You'll Learn
Understand what datasets are, how they're structured (Reference, Live Ticks, Live Aggregates, Historical), and how they relate to asset classes and providers.
Learn about the two API mechanisms (REST/WebSocket vs SDK) and three data delivery modes (Subscription, Streaming, Fetch) for accessing the Data Cloud.
Understand how REST and WebSocket APIs relate to datasets through dataset routing, and how to use the dataset parameter effectively in own-container scenarios.
Learn how to configure your data requirements using DataSpecs, including which datasets, symbols, live streams, and historical retention you need.
Key Concepts
Datasets are collections of market data (SIP, TotalView, PrecisionAlpha, etc.)
Each dataset contains 4 service types: Reference, Live Ticks, Live Aggregates, Historical
APIs provide access through REST, WebSocket, or SDK
Data delivery modes determine how data flows: Subscription (push), Streaming (bulk), or Fetch (pull)
Data Descriptors specify your data requirements declaratively
When to Use
The Data Cloud is used in all Datafye scenarios:
Foundry: Data Cloud Only - Primary focus, provides market data via APIs
Foundry: Full Stack - Provides data for backtesting and algo development
Trading: Data Cloud + Broker - Provides real-time data for trading
Trading: Full Stack - Provides data for both development and execution
Related Building Blocks
Algo Container - Runs your algo logic, consumes Data Cloud
Backtesting Engine - Uses Data Cloud historical data for strategy validation
Broker Connector - Executes trades based on signals from algos consuming Data Cloud
Last updated: 2025-10-14
Last updated