Extract, Load, and Transform (ELT)
AI-first, proprietary ELT layer optimized for analytic workloads
Last updated
AI-first, proprietary ELT layer optimized for analytic workloads
Last updated
The reason why customers are required to send data to Beye.ai is the following:
Performance and reliability: Our infrastructure is optimized for analytic workloads, querying large volumes of data and processing it. Also, as part of our ELT model, we have built in capabilities to report on potential data quality issues, data lineage tracking, and anomalies which all can help your data security and management posture.
Accelerate the time to onboard and implement: By leveraging the Beye architecture, we can leverage our onboarding automation to implement quickly and reliably
Upstream AI-first Capabilities: With data present in Beye, and as historical data grows, we can build on statistical metadata layer that powers our AI engine. With this, users can leverage our no-code capabilities to do data transformations, cleansing and create analytic views all with AI.
Setting up ELT Configuration for a Workspace
Transfer files to the storage location:
Server (S3 Endpoint): storage.googleapis.com
Bucket Path: To be provided by Beye Team
Access Key: To be provided by Beye Team
Secret Key: To be provided by Beye Team
For every Customer Workspace, there is a dedicated (ELT) configuration page (see below). The view of this ELT, is limited to the Workspace Owner role type.
Once you click ELT, you can click Upgrade (see screenshot below). This will provide you with private information to your dedicated, secure file store location.
Step 1: Install Cyberduck
Go to the Cyberduck website: https://cyberduck.io.
Download and install Cyberduck for your operating system (Windows or Mac).
Open Cyberduck once the installation is complete.
Step 2: Configure the Connection
In Cyberduck, click Open Connection (at the top of the main window).
From the dropdown menu, select Amazon S3 as the connection type.
Fill in the required fields:
Server: storage.googleapis.com
Bucket Path: To be provided by Beye Team
Access Key ID: To be provided by Beye Team
Secret Access Key: To be provided by Beye Team.
Step 3: Test the Connection
Click Connect to establish a connection to the storage bucket.
If the connection is successful, you will see the contents of the bucket (it may be empty if no files have been uploaded yet).
If you encounter an error, double-check the server, bucket path, and credentials.
Step 4: Upload Files
Locate the files on your computer that you need to upload.
Drag and drop the files directly into the Cyberduck window.
Alternatively, you can click the Upload button, browse for the files, and select them for upload.
Cyberduck will start uploading the files. You can see the progress in the Transfers window.