Key Features

• Pluggable IoT Data Platform: SyncLite offers a versatile platform for IoT application development, facilitating the effortless reading of massive-scale data from message (MQTT) brokers and consolidating it into databases, data warehouses, or data lakes of your choice.

• Decoupled Architectures: With SyncLite QReader and Consolidator operating independently, you can run them separately and configure QReader to pump data into SyncLite telemetry devices shared with Consolidator over a configurable staging storage.

• Many-to-Many IoT Data Pipelines: Orchestrate complex IoT data pipelines with multiple QReader applications on gateways, receiving vast amounts of data from numerous IoT devices. The data is streamed to staging storage through SyncLite devices, and multiple Consolidators can run on-prem/cloud VMs, consolidating the data into one or more destination databases.

• Fine-Grained Control with MQTT Reader: SyncLite QReader provides precise control over data extraction from MQTT brokers. Users can specify data format, delimiters, Quality of Service (QoS) levels, and SQL schema for every topic receiving data.

• Topic Management: QReader provides topic management functionality to add/remove topic configurations, execute schema changes for ALTER TABLE DDLs. 

• Consolidator Configuration: The Consolidator provides the flexibility to configure one or more destination databases, along with fine-tuning options for optimal writing on the destination database.

• Decentralized Telemetry Devices: SyncLite employs telemetry devices that facilitate seamless data streaming between QReader and Consolidator, allowing for efficient consolidation and ingestion.

• Data Format Customization: Users can specify the data format, delimiters, and SQL schema, offering customization according to the specific requirements of each data topic.

• Destination Flexibility: Consolidate data into one or more databases, data warehouses, or data lakes, providing flexibility and adaptability to diverse storage environments.

• Optimal Writing Configuration: Fine-tune Consolidator settings for optimal writing on the destination database, ensuring efficiency and performance.

• Scheduled Execution:  Both SyncLite QReader and Consolidator provide an ability configure daily job schedules for periodically starting/stopping the job during specified intervals and running it for a specified duration.

• Many More Features: SyncLite's IoT platform comes with a range of additional features to enhance data management and consolidation processes.

SyncLite offers a flexibility to implement a more versatile architecture as shown above. In this scenario, numerous IoT devices publish messages to their dedicated brokers deployed on individual gateways. A SyncLite QReader, deployed on each gateway, efficiently extracts data on a large scale and channels it into SyncLite devices which are shared via a configurable staging storage (SFTP/S3/MinIO/Kafka/NFS/Google Drive, One Drive etc.). The consolidated data is then processed by one or more centralized SyncLite consolidators, facilitating data consolidation into a preferred destination such as databases, data warehouses, or data lakes.

This no-code rapid data platform allows you to focus on solving your core challenges, without the hassle of intricate data integrations.