With a rising need for faster, high-volume database replication, Fivetran is building a series of high-volume agent (HVA) connectors. We currently have HVA connectors for Oracle, SQL Server and Db2 for i with various SAP options coming soon. These connectors support our product vision of combining the power of Fivetran’s managed service connectors with the speed and volumes of Fivetran Local Data Processing's database replication capabilities. 

HVA connectors use log-based change data capture to read directly from the source system’s logs. The addition of an agent minimizes replication latency and supports large volumes of data. This eliminates the need for queries to run against the database and reduces load on the source system.

Incorporating innovative features such as incremental updates and automated schema-drift monitoring, our HVA connectors are the optimal solution to support your high-volume replication use cases.

Data sheet: High volume agent connector for Oracle and SQL Server

DOWNLOAD

Common high-volume database replication use cases

Supply chain. Have a large number of order fulfillment requests? Fivetran’s HVA connectors can handle data replication throughput for all of your orders and tracking data. This allows data engineers and architects to spend more time on analytics and process optimization than building complex data pipelines. 

Event data. If your facility is optimized with IoT devices tracking countless events, a HVA connector can replicate that event data within minutes. HVA connectors have the power to combine data from many sources within your data lake or warehouse destination. This gives you the ability to make updates to people, processes and equipment in near real-time. 

Customer transactions. Do you perform millions of financial transactions per day? With a HVA connector, you can quickly replicate that data from your source to your destination. Our high-volume agent connectors have the highest levels of data quality and integrity. This ensures you have up-to-date and accurate data to perform analytics and visualizations. 

Healthcare records. Need to securely replicate millions of medical records and data points? HVA connectors can efficiently and securely move these records from your database to your cloud destination of choice allowing you to quickly get insights about your patients and practice.

High-volume agent connector features

We combined some of the best features of Fivetran fully-managed and Fivetran Local Data Processing to make the HVA connectors. The installation of an agent supports higher throughput than remote capture connectors and there will no longer be a query component against the database. This design allows for quick and efficient load times into your destination.

Fivetran’s HVA connectors will continue to support the following:

• Multiple connection methods: VPN tunnels, PrivateLink, etc.
  
• Change data capture methodology
  
• Automated schema drift handling
  
• Column blocking, masking and hashing
  
• History mode
  
• All Fivetran supported destinations
  

Benefits of HVA connectors

With a high-volume agent connector, you no longer have to worry about your pipeline supporting your data throughput volumes. The connectors will support your largest volume use cases with ease. Fivetran's managed service connector offering minimizes set-up needs and pipeline management. 

Connectors also support rapid integration between high-volume data sources and your destinations. This allows you to access up-to-date, accurate and granular data in near real-time. Another benefit is reducing your total cost of ownership with our simplistic, end-to-end solution. There is no heavy infrastructure or intensive set-up requirements for high-volume agent connectors.

Reach out to databases@fivetran.com to start replicating large volumes of data with our HVA connectors, today.

Try high-volume replication now

SIGN UP