We created a solution for a client who wanted to replicate IOT devices data from MySQL cluster to RedShift for further analysis using PowerBI.
Laniakea team came with this unique solution using Talend to replicate data from MySQL. Data was replicated every night.
Redshift database user – admin/pwd
Below Windows Machine holds all the client softwares. Such as Talend, PowerBI and TeamSQL.
Once you log into this Window machine. You would find below softwares under program.
Talend has below Jobs created.
Under Metadata below connections are created.
Open Task Scheduler – There is a bat job program named redshift-sync which runs every hour.
TeamSQL has connections for both RedShift and MySQL to query the databases.
PowerBI is configured to access RedShift.